Viewing profile — zacksiri

Yes, I think a proper comprehensive test would be a better judge of the outcome. I may do round 2 given my first batch of models is already outdated.

I’m comparing same / similar settings between models. I can’t use high on one and low on others it’s not a fair test. Not sure why I was downvoted. But seems the downvoter is quick…

I'm not sure about all these benchmarks, I did some very simple tests (I have my own benchmarks https://upmaru.com/llm-tests ) and these models fail, not sure if it's the inference…

Gemini 3.5 flash-lite is more expensive than Gemini 3.1 flash-lite. Every upgrade is getting more expensive.

Been working on this for the last 2 years. There is a video on the site explaining how it works. There is also a production app powered by this engine. Give it a try, I'm happy to …

They want you to buy their hosted service, that's where the convenience is sold. If they give you a one liner script you can paste in or a docker compose that does everything from …

At home we have Netflix, Disney+, Amazon Prime Video, HBO Max, and Apple TV+, but somehow we still end up just scrolling around, giving up, and watching YouTube. There must be over…

I watched this movie recently, and the same thought crossed my mind. I was going to write a blog post about it, but was too afraid to read the responses. I'm glad you did. If I mee…

They cherry pick and choose the parts of her work that fits their agenda, while forgetting the other parts.

This reminds me of the following quote "When you see that in order to produce, you need to obtain permission from men who produce nothing - When you see that money is flowing to th…

Thank you for publishing this. I've been following Paul Graham and his works for a long time. It's refreshing to see everything written down in a document like this. This is the bi…

Do you have similar math for the flash-lite variant of the models? I'd be curious. Based on my testing / benchmark i think it's around the 100-120B mark. With the Pro variant being…

It's a lot more than an LLM, it's backed by database + LLM. Gemini / ChatGPT on it's own believe it or not has hallucinated movies and imdb links. While google can show you results…

Well with JustWatch and other service aggregators you cannot search for movies by themes / use natural language. For example: - "Zombie or post apocalyptic movies released in the l…

Honestly I didn't think it would be possible when I started, my background is Elixir / Phoenix / Backend engineering. But thx to Codex the app turned out to be something I'm quite …

I hope that one day humanity learns that in war there are no winners. We're all just brothers and sisters born on different corners of the planet. We share the same home. I hope th…

It's ok, it's not the best. There are models that do better, I'd use it for some basic tasks but not actual complex tasks like query generation and retrieval.

I tested the model in an agentic workflow. Here is the report: https://upmaru.com/llm-tests/simple-tama-agentic-workflow-q1...

I tested this model in an agentic workflow, it failed at some very basic tasks: https://upmaru.com/llm-tests/simple-tama-agentic-workflow-q1...

Yes, my workflows use caching intensively. It's the only way to keep things fast / economical.

This is going to be a fun one to play with. I've been conducting tests on various models for my agentic workflow. I was just wishing they would make a new flash-lite model, these t…