You can add as many models as you like. Use any model ID from the catalog. Continue’s provider should be set to "openai" since Lightweight is OpenAI-compatible.
After saving, reload the Continue extension. Your Lightweight models will appear in the model selector dropdown.