Lol. The resume includes expert in Mia Khalifa easter egg.
Replace OCR with Vision Language Models
21–30 of 130 posts
Re: Replace OCR with Vision Language Models
#22replaced it with real humans -> nano tech in their brain -> transmit to server getting almost 99% accuracy
Re: Replace OCR with Vision Language Models
#23What's the value-add here? The schemas?
Re: Replace OCR with Vision Language Models
#24What's the characters-per-Wh of an LLM compared to traditional OCR?
A lot worse. But, higher quality OCR will reduce the amount of human post-processing needed, and, in turn will allow us to reduce the number of humans. Since humans are relatively expensive in energy use, this can be expected to save a lot of energy.
> Since humans are relatively expensive in energy use
Are they? I'm seeing figures around 80 watts at rest, and 150 when exercising. The brain itself only uses about 20 watts [1]. That's 1/35 of a single H100's power consumption (700 watts - which doesn't even take into account the energy required to cool the data center, the humans who build and maintain it, ...).
[1]: https://www.humanbrainproject.eu/en/follow-hbp/news/2023/09/...
Re: Replace OCR with Vision Language Models
#25Earlier quoted context omitted.
A lot worse. But, higher quality OCR will reduce the amount of human post-processing needed, and, in turn will allow us to reduce the number of humans. Since humans are relatively expensive in energy use, this can be expected to save a lot of energy.
> Since humans are relatively expensive in energy use Are they? I'm seeing figures around 80 watts at rest, and 150 when exercising. The brain itself only uses about 20 watts [1]. That's 1/35 of a single H100's power consumption (700 watts - which doesn't even take into account the energy required to cool the data center, the humans who build and maintain it, ...). [1]: https://www.humanbrainproject.eu/en/follow-hbp/…
The PUE of humans for that 80 watts is terrible, though. Ridiculous multiples of additional energy needed to convert solar power to a form of a energy that they can use, and even the manufacturing lifecycle and transport of humans to the datacenter is energy inefficient.
Re: Replace OCR with Vision Language Models
#26What's the value-add here? The schemas?
Basically there is no model schema combination. IF you go ahead and prompt a open source model with the schema it doesn't produce the results in the expected format. The main contribution is how to make these model conform to your specific needs and in a structured format.
Re: Replace OCR with Vision Language Models
#27What's the value-add here? The schemas?
We've seen so many different schemas and ways of prompting the VLMs. We're just standardizing it here, and making it dead-simple to try it out across model providers.
Re: Replace OCR with Vision Language Models
#28Wow thanks!
There's a client who had a startup idea that involved analyzing pdfs, I used textract, but it was too cumbersome and unreliable.
Maybe I can reach out to see if he wants to give it anothee go with this!
Re: Replace OCR with Vision Language Models
#29What's the value-add here? The schemas?
Basically there is no model schema combination. IF you go ahead and prompt a open source model with the schema it doesn't produce the results in the expected format. The main contribution is how to make these model conform to your specific needs and in a structured format.
Wait, but we're doing that already, and it works well (Qwen 2.5 VL)? If need be, you can always resort to structured generation to enforce schema conformity?
Re: Replace OCR with Vision Language Models
#30[deleted]