base_url. This gives you access to every model in the catalog through the familiar OpenAI Python interface.
Installation
Usage
Streaming
Using Different Models
Swap themodel parameter to use any provider — no other changes needed:
Use the official OpenAI Python SDK with Lightweight.
base_url. This gives you access to every model in the catalog through the familiar OpenAI Python interface.
model parameter to use any provider — no other changes needed: