Viewing profile — aliljet

Is there a path to distill this model to do very specific things? Like a RAG strategy for a small (or even large) corpus?

There is a more serious question in here that's not being answered. How effective is the retrieval in finding buried needles in larger and larger haystacks. And there's a correlary…

I'm trying and failing to find value running a potential Qwen 3.8 27b dense model on a 16 core, 128 GB of ram, 2080ti box. Yes, the GPU yells for help, but the problem is that no m…

Honestly, I have a 2080ti that I use to play and I can tell you the math isn't there to upgrade it. It's much easier to just find a 3090/4090/5090 and keep pace with the software a…

I'd be curious about an.option that would allow glm use with a low end GPU like a 2080 ti...

The benchmarks here are confusing at best. Am I reading correctly that this model is essentially as good or better than all frontier models right now?

I was just using infinity parser 2 (flash, to be fair) for pennies self-hosted to run through thousands of pages of documents with remarkable confidence. I decided to use https://h…

I'm curious about this. What models/tools have you been using?

How does this compare with infinty parser 2 which seemed to be running the table on every other OCR tool ( https://huggingface.co/datasets/allenai/olmOCR-bench ). To be fair, there…

This sounds incredible. Have these models effectively solved the problem of trying to use a fast-processing network to predict the world's state ahead? For example, to catch a ball…

The problem here is always the cost-benefit. For $200/mo, you're receiving subsidized best of breed access. There's no model competing for that price anywhere. If a 27B param model…

Is this just one giant marketing plot?

Where can a user reasonably host this in an affordable way to access the local LLM revolution?

I'm really running into this deep at the edges of content creation. Take, for example, a need to general some kind of legal work. The cost of painstakingly checking and rechecking …

Is there a good benchmark tracking hallucinations? The models are all incredibly good now, even the open ones, and my hope is that the rate of hallucinations is something that's fa…

[dead]

This is so cool. I would love to revitalize a generation of great, but perhaps boring older cars with FSD. Just so much work...

[dead]

Why did Spirit die? Was there any last of this that had to do with their abysmal customer service?

What systems are you actively using? And what systems have you tried? It seems like law, generally, may be hitting a tipping point on LLM use...

This is a tough moment. Claude is simultaneously becoming substantially more expensive, substantially less reliable (single 9 of reliability), and substantially less performant. It…

I wonder how this kind of response from Anthropic is actually being read by the community at large. If you consider the rough sentiment of the r/ClaudeCode subreddit against the r/…

Why is this being made public?

How can you reasonably try to get near frontier (even at all tps) on hardware you own? Maybe under 5k in cost?

Mythos is only real when it's actually available. If you're using Opus 4.7 right now, you know how incredibly nerfed the Opus autonomy is in service of perceived safety. I'm not so…