Viewing profile — cr4zy

What are you all using instead of Upwork?

For compression and long-running agents, may I suggest https://memtree.dev . We offer a simple API that compresses messages asynchronously for instant responses and small context l…

For code it's actually quite good so far IME. Not quite as good as Gemini 2.5 Pro but much faster. I've integrated it into polychat.co if you want to try it out and compare with ot…

I discuss how the automation wave is already starting with white-collar job openings at a 12 year low in the U.S. I also talk about how we cannot simply count on taxing AI to suppo…

I've added a "Thinking...." which sends server side events to keep the cxn open. Would love to hear if o1 models now work for anyone who they were broken for.

Open WebUI does offer an API, but I have it disabled for PolyChat.

One tradeoff of bringing your own API keys is that as you add more model providers, you get more billing accounts to deal with. Chorus also doesn't have an incentive to efficiently…

So it looks like some folks are getting errors with the non-streaming models, i.e. the o1 models. I think their long running cxns with zero packets may cause some networks to drop …

It's not unlimited free unfortunately. After some free use, we provide monthly usage-tier plans. But there are no rate limits like other providers as you can move up to the next us…

Background chats are new in v5 of Open WebUI, so you can use it too. Overview has been there also, but it's kind hidden in the hamburger menu. The upgrade/logout issue you're facin…

Cool! I should say most of PolyChat is open source at https://github.com/open-webui - just the combo models and payment are closed source right now. Open to arguments on making Pol…

Thanks! I definitely recommend launching quickly and iterating. edit: I should add, I'm making only $30/mo in subs, but I just launched so we'll see!

Hello HN! I was fed up switching between multiple UIs to ask GPT, Claude, etc… the same question and comparing the answers. So I built a way to ask multiple models the same questio…

Wow, this is awesome! Thanks for building. I didn't realize there was a protocol for streaming while rendering, though I noticed sumo.ai doing something similar for audio. Gemini w…

Library makes requests asynchronously across models, so you can spend a lot of $$ quickly if you want XD. But seriously I hope this enables folks to create and run evals (especiall…

Another great session of George and John recording Oh My Love [1] shows what I think of as embracing rough but promising ideas along with balanities like tuning guitars, learning c…

Allocating 20% to safety would not be enough if safety and capability aren't aligned. I.e. without saying Bostrom's orthogonality thesis is mostly wrong. However, I believe they ma…

The nice thing about box breathing is that, unlike pursed lips for example, you can do it without anyone noticing, by quietly breathing through your nose. So if you're in a stressf…