Extract-0: A specialized language model for document information extraction
1–10 of 63 posts
Re: Extract-0: A specialized language model for document information extraction
#2So its a model designed exclusively for a purpose? Then the results should not be that surprising. It's still impressive don't get me wrong.
Re: Extract-0: A specialized language model for document information extraction
#3Anybody have a link to this model?
Can't seem to see it on the arxiv site.
Re: Extract-0: A specialized language model for document information extraction
#4It really seems like all the next big leaps in AI are going to be fine-tuning fit-for-purpose models.
Everything past GPT5 has been ... fine. It's better at chat (sort of, depending on your tone preferenc) and way better at coding/tool use. In our product (plan out a migration with AI), they've gotten worse, because they want to chat or code. I'd have expected the coding knowledge to generalize, but no! Especially Claude really wants to change our code or explain the existing plan to me.
We're getting around it with examples and dynamic prompts, but it's pretty clear that fine-tuning is in our future. I suspect most of the broad-based AI success is going to look like that in the next couple years.
Re: Extract-0: A specialized language model for document information extraction
#5So its a model designed exclusively for a purpose? Then the results should not be that surprising. It's still impressive don't get me wrong.
The results are interesting for showing the efficacy of small, fine-tuned models that can be run locally. AI providers as a business need their do-all models to be better than these if they want long-term revenue through the APIs, right?
Re: Extract-0: A specialized language model for document information extraction
#6Anybody have a link to this model? Can't seem to see it on the arxiv site.
[deleted]
Re: Extract-0: A specialized language model for document information extraction
#7Anybody have a link to this model? Can't seem to see it on the arxiv site.
I see the dataset published by the author - https://huggingface.co/datasets/HenriqueGodoy/extract-0 however the model is not published/public yet!
Re: Extract-0: A specialized language model for document information extraction
#8LLMs are only going to improve by fragmenting them into specialized systems for low parameter high performance results. We’ve reached the point where models will get smaller and more compact
Re: Extract-0: A specialized language model for document information extraction
#9We're seeing the insect-ization of neural nets. Smaller specialists are evolving for their relevant tasks
Re: Extract-0: A specialized language model for document information extraction
#10LLMs are only going to improve by fragmenting them into specialized systems for low parameter high performance results. We’ve reached the point where models will get smaller and more compact
Yes this was my understanding too.
Like I wanted this from a year or two ago to just lets say have a model which lets say is genuinely really really good at sveltekit as an example instead of a model which is good at a lot of different things of sorts yknow
A model for sveltekit, A model for react and for coding general purpose too and preferably we can have a website which can make it easy to find these models/run them, ollama comes to my mind right now but it has really enshittened a little bit from the time when I was thinking about this but so maybe now a little competition on that side wouldn't hurt I suppose.