Integrate with Predibase¶

Predibase is the fastest way to fine-tune and serve open-source LLMs. It is built on top of open-source LoRAX.

Comet integrates seamlessly with Predibase so that all your fine-tuning runs are logged to Comet.

Enabling the Predibase integration¶

To log all your fine-tuning runs to Comet, you need to:

1. Get you Comet API key from the user menu or your Comet profile page.
2. Navigate to the Predibase app and go to Settings > My Profile. Under "Comet API Token" paste your API key.
3. Click "Save Token" to save your API key.

Each run will now be logged to Comet.

Fine-tuning LLMs with Predibase¶

To learn about how you can fine-tune your Large Language Models with Predibase, please refer to the Predibase documentation or try out one of their example notebooks:

• Lora Land for Customer Support
• Fine tuning Llama 3 for toxic comments classification

Observability for Predibase models¶

For comprehensive observability when serving and using your fine-tuned models from Predibase, including LLM call tracking, cost monitoring, and performance analysis, check out the Opik integration with Predibase.

The Opik integration provides:

• Automatic tracking of LLM calls to Predibase models
• Cost tracking and token usage monitoring
• Support for both base and fine-tuned models
• Integration with LangChain workflows
• Advanced tracing and debugging capabilities