I wonder if someone has built a nice dashboard tool for this?
In my #contentcrewai use case we are using Perplexity API, Open AI, Anthropic, FAL.AI.
Would be cool to have a nice dashboard that shows all requests, status codes, time, costs, etc.
Could be a cool little project. Currently when there are issue I do what @ben suggests and go into the individual dashboard.
LangFuse would probably offer what you want. I don't recommend using it with flask though. Can't talk about other python frameworks or js because I've never used LangFuse with them
I think Litellm does it
I wonder if someone has built a nice dashboard tool for this?
In my
#contentcrewai use case we are using Perplexity API, Open AI, Anthropic, FAL.AI.
Would be cool to have a nice dashboard that shows all requests, status codes, time, costs, etc.
Could be a cool little project. Currently when there are issue I do what @ben suggests and go into the individual dashboard.
LangFuse would probably offer what you want. I don't recommend using it with flask though. Can't talk about other python frameworks or js because I've never used LangFuse with them
I think Litellm does it