Viewing profile — alextttty

Point is to actually avoid hallucinations, Think I didnt focus on it as much as I wanted. To avoid hallucinations, make sure you use strict prompt when creating the chatbot/api key…

Made action to gen csvs + json Working on the mui data table frontend right now

Indeed!

Amazing! Please dont hesitate to open an issue or a PR Will update our dataset and add it.

Think its just dominating the industry with cheaper access to gpu's probably even subsidised pricing

Thank you!

Exactly, always best to rely on your hardware, we need to collect/add more data from self hosted models on different gpus/clouds to compare

Honestly this is very very fresh, I was tinkering with hosting some models and wanted to optimize costs, tried few inference engines. Just want to collaborate on organizing data. A…

Thank you! yeah great source. Do they track throughput for open source models? and inference engines Thats kind of data I want to find as well

Yeah we want to do exactly this, benchmark and add more data from differnt gpus/cloud providers, will appreciate your help a lot! There are many inference engines which can be test…