31–40 of 84 posts
The pricing is ... steep? You are charging per request ($0.05) what amounts to about 1M tokens on GPT4-mini ($0.075); i.e. this is 10-100x more expensive than the cost of running the LLM. I don't think it's worth it at that price point. Edit (just found out this): "The $0.05 per request fee covers requests up to 30,000 tokens. For requests exceeding this limit, additional nominal charges may apply." Hmm ... it's just…
Earlier quoted context omitted.
Good feedback, I agree that our pay-as-you-go pricing may not fit everyone's budget. We're working on reducing our costs and simplifying our pricing. Goal is to get this much, much lower in the coming months. There's some complexity to how we handle pricing, since the core of what we do is based off of ingesting the requests and responses, and performing some processes on top of that info. Some people have small prom…
Does the pricing change for BYOK?
Something I'm not sure I understand. It seems there are a set of expectations that you are evaluating against. Are these expectations also written in the prompt?
Something I'm not sure I understand. It seems there are a set of expectations that you are evaluating against. Are these expectations also written in the prompt?
The expectations/rules are usually written in the prompt. However, we see that prompts get big and the model has too much to keep track of, which leads to it not following all instructions.
I like simplicity! Looking forward to self-hosted solution as well.
Excited to try this out. Thanks for sharing.
when I made the rules of the game more simple, the guardian would kick in to prevent a leak of what I think would be a very indirect representation of the secret, so I'm pretty sure part of the guardian is having a fairly advanced LLM (probably GPT4 itself, or one of the other big ones) figure out if they can reconstruct the answer from the conversation.
I tried fooling Sam into playing a game that would reveal the secret subliminally, and I got it pretty far without triggering the guardian so I thought I was on a good path. But then it turned out that gpt4-o simply wasn't good at playing the game and wasn't actually revealing the secret just because it couldn't follow the rules of the game. when I made the rules of the game more simple, the guardian would kick in to…