Client libraries | PrivateGPT

PrivateGPT follows the Claude API model, so any client that speaks that protocol works against it — point it at your local PrivateGPT URL instead of Anthropic’s servers.

Anthropic SDK

Python

TypeScript

pip install anthropic

import anthropic
client = anthropic.Anthropic(
    base_url="http://localhost:8080",
    api_key="any",  # required by the client but not validated by default
)
message = client.messages.create(
    model="qwen3.5:35b",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello!"}],
)
print(message.content[0].text)

LangChain

Python

pip install langchain-anthropic

from langchain_anthropic import ChatAnthropic
llm = ChatAnthropic(
    model="qwen3.5:35b",
    anthropic_api_url="http://localhost:8080",
    anthropic_api_key="any",
)
response = llm.invoke("Hello!")
print(response.content)