Hello. Please help to improve code to communicate with model via class ChatOpenAI (from langchain_openai import ChatOpenAI).
Now I have error “Proxy Authentication Required 407”
I’ve tried different options for about 2 weeks and I’m already giving up.I tried using clientx, but in vain.
my code:
from langchain_openai import ChatOpenAI
from langchain_core.message import HumanMessage, AIMessage
class LLMClient:
def init(self):
self.model = “Qwen3-Coder-Next-FP8”
self.headers = {
“Authorization”: “Bearer eyJ…”
}
self.llm = ChatOpenAI (
model = self.model,
api_key = "None",
base_url = "https://mysite.com/codegen/v1",
temperature=0.5,
default_headers=self.headers
)
def SendMessage:
messages =
messages.appdend({“role”:“user”, “content”: “Hello my friend”})
langchain_messages = []
for msg in messages:
if msg["role"] == "user":
langchain_messages.append(HumanMessage(content=msg["content"]))
response = await self.llm.ainvoke([HumanMessage(content=langchain_messages)])
print(response.content)
---
Another way exclude ChatOpenAI working good:
import asyncio
from aiohttp import ClientSession, ClientTimeout
class HTTPClient():
def __init__(self):
self.model = "Qwen3-Coder-Next-FP8",
self.api_key = "None",
self.max_retries = 3
self.base_url = "https://mysite.com/codegen/v1/chat/completions",
self.temperature=0.5,
self.headers = {
"Content-Type": "application/json",
"Authentication": "Bearer eyJ......"
}
async def _call_llm_with_rety(self, messages:list, max_retries: int = None) -> Optional[str]:
url = self.base_url
for attempt in range (max_retries + 1 ):
try:
timeout = ClientTimeout(total=self.timeout)
async with ClintSession(timeout=timeout) as session:
headers= self.headers
payload = { "model": self.model, "messages": messages, "temperature": 0.1 }
async with session.post(url, json=payload, headers=headers) as response:
if response.status == 200:
data = await response.json()
return data.get("choises", [{}])[0].get("message", {}).get("content", "")
--- Please help!