Viewing profile — khurdula

We trained diffusion-gemma-asr, an open-source speech recognition model that is 15x faster than Whisper, based on DiffusionGemma and Whisper Small. Instead of generating text one t…

We've open-sourced all code, and test sets. You can find them here: https://interfaze.ai/blog/introducing-structured-output-benc... To validate the choices and configurations, feel…

We've added opus 4.6 and 4.7 to our leaderboard, they perform very closely with sonnet 4.6. Feel free to checkout our updated blog again :D

hey! we've evaluated gpt 5.5 as well along with other frontier models. gemini and gemma models outperform it across all three modalities. Open source models like glm 4.7 still comp…

We've updated our leaderboard having evaluated frontier models gemini 3.1 pro, opus 4.6 & 4.7, glm 5.1, deepseek v4, Kimi K2.6 as well.

We're updating our leaderboard with these model scores, should be out soon :D

We do love Qwen! It can be an easy choice when confused looking at this leaderboard.

Yep, we will be adding it soon as well.

Due to high demand, we're adding it soon!

General hallucinations benchmarks tend to be knowledge specific like GPQA or MMLU but none specifically measure structured output end-to-end which is one of the biggest use case fo…

We saw that structured decoding didn't make a difference in the quality of the output. Check out the paper section "6.3 Structured Decoding Ablation" Paper: https://arxiv.org/pdf/2…

Check out the "The JSON-pass vs Value-Accuracy gap" section in the blog. That was an eye opener. While most models were great at producing JSON schema, they were pretty bad at prod…

Yeah we selected models that are most commonly integrated in developer workflows and being used for structured output. Typically those models tend to be in the low -mid cost range …

When building workflows that rely on LLMs, we commonly use structured output for programmatic use cases like converting an invoice into rows or meeting transcripts into tickets or …

"we hope to open-source future versions of the model." Love to see it. Cheers!

We define determinism as a model behaving predictably, while also producing useful supporting metadata, like confidence scores from specialized DNNs/CNNs, not just text tokens gene…

Most AI products are built around the same idea. Take a giant model. Add a prompt and hope it does the whole job. The AI equivalent of spray-n-pray. That works great for chatbots f…

Bruh, if it were priced at like $2,499 it would make sense, but this is just too much.

Damn, just visiting this site makes me want to reinstall Minecraft haha.

What if I said, we outperform them? Check this out: https://jigsawstack.com/blog/openai-audio-stt-vs-jigsawstack...

Are we supposed to use AMD GPUs for this to work? Or Does it work on any GPU?