Viewing profile — cmdalsanto

Maitai helps LLMs adhere to the expectations given to them. With that said, there are multiple layers to consider when dealing with sensitive data with chatbots, right? First off, …

I understand where you're coming from, let me clarify. I'm surprised at the perseverance of HN users with our game, not nefarious actors in real world. I'm not a leading expert in …

I guess we realized that we were just building a game to showcase the functionality and let people have some fun learning about what we do, but you're right that we should have tre…

Not overstepping, we appreciate the feedback! In real-life, we don't do much guarding around specific phrases that are known ahead of time. It's more monitoring and guarding for ge…

Yeah some of you guys are very good at hacking things. We expected this to get broken eventually, but didn't anticipate how many people would be trying for the bounty, and their pe…

I just posted, but decided I want to keep it secret for a bit. There are still quite a few people trying to get it, and don't want to spoil the fun. I'll post an update with specif…

Good dissection, but no we actually don't use heavy general-purpose models for our evaluations - they're way too inefficient.

Please email us at founders@trymaitai.ai if you have any questions with integration!

The expectations/rules are usually written in the prompt. However, we see that prompts get big and the model has too much to keep track of, which leads to it not following all inst…

The secret phrase has been uncovered and the bounty claimed! Thanks all for trying your hand, and you can continue playing as well if you want, we'll keep the site up.

We don't charge for inference with BYOK requests, but still assess a fee to cover our evaluations/corrections step.

Thank you!

Clever! Not surprised Claude refused to help out.

There's some secret sauce here, but since we intercept each chunk as the LLM pushes them out, we can perform evaluations on them and decide what gets sent back to the client if we …

Yeah that's pretty much how it works. Maitai detected one of our expectations for the LLM was to never reveal the secret phrase, and so it built what we call a Sentinel around that…

It's pretty easy for us to add support for additional models right now, we just see that the vast majority of people are using just a few models: gpt-4o/4o-mini, claude-sonnet-3.5,…

We derive them from your requests as they come in. What we've heard is that most of the time, devs just want the model to do what they told it to do, consistently. That's all in th…

Good feedback, I agree that our pay-as-you-go pricing may not fit everyone's budget. We're working on reducing our costs and simplifying our pricing. Goal is to get this much, much…

Yeah pricing for smaller shops and independent devs is something we're still working on. We'd ideally like for everyone to be able to use Maitai though, so we'll probably release s…

Thanks!

Yep, we support both evaluations and autocorrections for streaming as well.

Hey HN - this is Christian and Ian from Maitai ( https://trymaitai.ai ). We're building an LLM platform that optimizes request routing, autocorrects bad responses, and automaticall…