111–120 of 194 posts
In the third vision bench result, Sol is 100% correct but the expected has 1 error. Seems like an oversight. In the next bench, Sol looks like it’s correct again but the bboxes are rotated 90 degrees for some reason.
Hi! I’m the author of this blog and benchmark. You’re right. I’ll fix it in the ground-truth dataset. Thanks for pointing it out.
In the third vision bench result, Sol is 100% correct but the expected has 1 error. Seems like an oversight. In the next bench, Sol looks like it’s correct again but the bboxes are rotated 90 degrees for some reason.
Seems to be due to the detection area being not fully accurate. Green vs red shows the difference between actual and detected
Do you think we’re getting closer to models that actually understand what they’re seeing, or are they just getting really good at recognizing patterns?
Earlier quoted context omitted.
Yeah I was thinking about giving Luna a go with my PDF data extraction, but I think I‘ll stay on Gemini. It does a very good job.
Gemini is honestly an excellent LLM with many capability strengths. For example, 3.7 Flash is #1 on MMLU Pro and AA’s agentic spreadsheets/docs benchmark, etc. Yes, beating Fable. Agentic coding is only one dimension.
My worry is that this is a zero-sum game and when Gemini catches up on coding, it'll regress to the mean in other areas.
It is funny to me seeing Sol used for what a "traditional" AI model can do already (counting pills). We have vision models for our pharmacy and I could never imagine taking the latency hit to use a Sol in our robotics, it would be likely 25-50x slower.
LLM needs to setup an image classifier to use as a tool call.
Earlier quoted context omitted.
Yeah Gemini 3.5 Flash Lite is really good. Which Chinese models can you recommend?
Hi, I’m the author of this blog. It depends on how strong of a model you need, but in general, Qwen is easily the best among the Chinese models right now. Over the last two weeks, Qwen released two new models. Qwen3.8-Max is totally insane, but it’s only available through the Alibaba Cloud API. I wrote a similar blog covering Qwen3.8-Max: [ https://blog.roboflow.com/qwen3-8-max/ ]( https://blog.roboflow.com/qwen3-8-m…
It is funny to me seeing Sol used for what a "traditional" AI model can do already (counting pills). We have vision models for our pharmacy and I could never imagine taking the latency hit to use a Sol in our robotics, it would be likely 25-50x slower.
Agreed, this like asking a chainsaw to carve a wooden spoon. Impressive it can, but definitely not the right tech to scale. LLM needs to setup an image classifier to use as a tool call.
ChatGPT Pro with GPT 5.6-sol: https://chatgpt.com/share/6a834217-ca8c-83e8-a8e8-45d5b8797b...
The puzzle: https://activityvillage-files.s3.eu-west-2.amazonaws.com/s3f...
