I am currently developing an application using OpenAI, and have created distinct API keys to accommodate varying scenarios. However, I've found that managing the usage of these individual API keys isn't as seamless as I would like. Do you know any tools or frameworks specifically for controlling or monitoring the usage of these different API keys?
Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
1–5 of 5 posts
Re: Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
#2Maybe try https://github.com/langfuse/langfuse
It was recently shared on HN
Re: Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
#3Maybe try https://github.com/langfuse/langfuse It was recently shared on HN
Thanks, will take a look.
Re: Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
#4Langfuse is great ! Also check https://www.nebuly.com/
Re: Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
#5Maybe try https://github.com/langfuse/langfuse It was recently shared on HN
Thanks, will take a look.
Langfuse founder here
Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this.
If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field.
Dm me on Discord[1] if you have more detailed questions.