> ## Documentation Index
> Fetch the complete documentation index at: https://docs.trynito.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# LiteLLM

> The OpenAI-compatible route, pointed at Nito.

```python theme={"theme":{"light":"github-light","dark":"github-dark"}}
from litellm import completion

resp = completion(
    model="openai/moonshotai/kimi-k3",                       # OpenAI-compatible route; moonshotai/kimi-k3 is a Nito catalog ID
    api_key="z_sk_your_key_here",                  # your Nito API key
    api_base="https://app.trynito.ai/v1",  # note: api_base (not base_url)
    messages=[{"role": "user", "content": "Say hello in one short sentence."}],
)

print(resp.choices[0].message.content)
```

The `openai/` prefix is how LiteLLM addresses an OpenAI-compatible third-party endpoint with a custom `api_base`; what follows the prefix is the catalog ID sent to Nito.

Proxy, in `config.yaml`:

```yaml theme={"theme":{"light":"github-light","dark":"github-dark"}}
model_list:
  - model_name: moonshotai/kimi-k3
    litellm_params:
      model: openai/moonshotai/kimi-k3
      api_base: https://app.trynito.ai/v1
      api_key: z_sk_your_key_here
```

Run `litellm --config config.yaml` and call the proxy with the bare `model_name`.

```python theme={"theme":{"light":"github-light","dark":"github-dark"}}
# openai/ = LiteLLM route prefix; z-ai/glm-5.2:confidential = the Nito catalog ID
model="openai/z-ai/glm-5.2:confidential"
```

## Privacy

Use a catalog ID, not an OpenAI name. For attested hardware use a `:confidential` variant; `GET /v1/models` lists their `:confidential` IDs. Encrypted needs client-side encryption and extra headers, which these frameworks do not add. See [Privacy Levels](/privacy/levels).

## Related

<CardGroup cols={3}>
  <Card title="Framework Integrations" icon="link" href="/api/sdks/framework-integrations">
    The shared pattern.
  </Card>

  <Card title="OpenAI Compatibility" icon="arrows-left-right" href="/api/sdks/openai-drop-in/compatibility-notes">
    What differs.
  </Card>

  <Card title="Privacy Levels" icon="file-shield" href="/privacy/levels">
    The four levels.
  </Card>
</CardGroup>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.