The AI Gateway now offers more granular spend data and key request history to help you understand and optimize your LLM usage.

Spend data by key

In the keys list and the key details page, you can see the spend during the current usage period for each key. Use this to understand which keys are most active, and which use cases might benefit from cost optimization.

Request history and spend data by request

In the key details page, you can see all the requests made by the key in the last 7 days, including token usage and cost information.

Coming soon: view the contents of your LLM request and response logs to help with prompt refinement and troubleshooting.