Groq Streaming Support: Enhanced Token Tracking

March 26, 2025

We’re excited to announce support for Groq streaming tokens in Helicone! This update enhances our integration with Groq’s API, providing better token tracking and usage monitoring for streaming responses.

What’s new

• Full support for tracking and monitoring Groq’s streaming token responses
• Accurate tracking of prompt, completion, and total tokens
• Support for both standard and Groq-specific usage reporting formats
• Fallback mechanisms ensure consistent token tracking even with varying response formats

Getting started

To use Groq streaming with Helicone:

1. Configure your Helicone proxy settings for Groq
2. Make streaming requests as usual through the Helicone proxy
3. Monitor your token usage in the Helicone dashboard