Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Unlimited OCR: One-shot long-horizon parsing

github.com

Post reply on HN
Print view View original

91–100 of 119 posts

Re: Unlimited OCR: One-shot long-horizon parsing

#91

Post by squidbeak »

pbhjpbhj wrote: post #44
nickspacek wrote: post #25

Earlier quoted context omitted.

It's the opposite of shade, unless GP is being sarcastic. "Class act" is normally a compliment, and in the context here it sounds to me like they're congratulating Baidu/the researchers in being transparent about where their ideas came from.

To be fair, I think I see "[real] class act" almost always used sarcastically.

I've never seen it used that way.

Any compliment can be repurposed as sarcasm, but it's obscenely cynical to immediately assume a compliment is sarcastic - instead of just a compliment. And by the way, there's no 'real' in the poster's message.

Re: Unlimited OCR: One-shot long-horizon parsing

#92

Post by MattRogish »

ryanisnan wrote: post #90
MattRogish wrote: post #82

Earlier quoted context omitted.

I do OCR of images, and that's exactly what I do. I take one big image and slice it into many smaller ones, and send those to the LLM. Perfect every time, unlike using the whole image which resulted in hot garbage.

How do you know where to slice an image? What if you slice an image mid-word?

I calculate* the appropriate overlap and the slicer overlaps a certain amount of the previous slice. There is some post-processing assembly required, but it's trivial.

[*] SWAG line height, trial and error to figure out the right amount of overlap given LLM error rates, etc.

Re: Unlimited OCR: One-shot long-horizon parsing

#93

Post by mejutoco »

indiv0 wrote: post #55
peatmoss wrote: post #29

I recently bought a tablet for sheet music, mostly to replace a stack of jazz "Real Books" at jam sessions. And the phone camera scans I made are okay, but fixed in size and have a lot of artifacts. And it would be great to transpose on the fly for e.g. Bb or Eb instruments, but being a scan this is obviously not possible. I got digging into the state of optical music recognition and came away concluding that music i…

> music is basically a greenfield for AI wherever you look AIN'T THAT THE TRUTH. My girlfriend is studying musicology and she has some physical disabilities that make it difficult for her to write things down sometimes. So I try to help her by writing some AI-powered TTS/OCR/etc. apps here and there. It becomes painfully obvious that music was never considered an important part of any AI training dataset, anywhere. T…

> how well Opus 4.8 understands [...] and he'll confidently

I always think of the nun character against AI in Mrs Davis:

> "Don't give it a name. No one calls Facebook Doug. No one calls Twitter Mary Lou. No one calls them anything, because no one uses them anymore. They use it, and it's not a person. It's code. - Mrs Davis

Re: Unlimited OCR: One-shot long-horizon parsing

#94

Post by ryanisnan »

MattRogish wrote: post #92
ryanisnan wrote: post #90

Earlier quoted context omitted.

How do you know where to slice an image? What if you slice an image mid-word?

I calculate* the appropriate overlap and the slicer overlaps a certain amount of the previous slice. There is some post-processing assembly required, but it's trivial. [*] SWAG line height, trial and error to figure out the right amount of overlap given LLM error rates, etc.

Interesting. Do you have a uniform data set? E.g. documents of a specific type that you know consistently have similar formats, or is this training something you need to do per-document?

Re: Unlimited OCR: One-shot long-horizon parsing

#95

Post by pbhjpbhj »

messe wrote: post #68
pbhjpbhj wrote: post #50

Earlier quoted context omitted.

You almost don't want [super-]word level ML (ie word-pair/phrase/sentence/document/corpus level). In transcription, you want near certainty, or you want marking that the word could not be read with certainty - yes, context lets you guess, but you want - for some OCR - to know when it's a guess based on other than the letters in order forming a word. Example, in a census document on familysearch.com the transcriber "c…

> Eire A nitpick, because it's often a dogwhistle: but almost nobody in Ireland calls it that when speaking English. And that's still incorrect in Irish, the correct spelling is Éire.

By saying it's a dogwhistle are you saying that not adding the correct diacritics is considered racist by Irish people? If I change the rest of the sentence to Na Gaeilge will that be better.

Re: Unlimited OCR: One-shot long-horizon parsing

#96

Post by pbhjpbhj »

squidbeak wrote: post #91
pbhjpbhj wrote: post #44

Earlier quoted context omitted.

To be fair, I think I see "[real] class act" almost always used sarcastically.

I've never seen it used that way. Any compliment can be repurposed as sarcasm, but it's obscenely cynical to immediately assume a compliment is sarcastic - instead of just a compliment. And by the way, there's no 'real' in the poster's message.

Yet you responded to my comment in the most cynical way possible. I was excusing the misunderstanding -- I assumed that the parent might only have seen it used cynically as that is a charitable way to interpret the apparent miscommunication and is quite possible. You shit on my comment and then told me doing such things is "cynical". Imagine a pipe before the closing square-bracket if you wish -- the standard editorial convention as I learnt it was that square-bracketed terms may be present or not (in English Language prose).

Cheers.

Re: Unlimited OCR: One-shot long-horizon parsing

#97

Post by mft_ »

mejutoco wrote: post #93
indiv0 wrote: post #55

Earlier quoted context omitted.

> music is basically a greenfield for AI wherever you look AIN'T THAT THE TRUTH. My girlfriend is studying musicology and she has some physical disabilities that make it difficult for her to write things down sometimes. So I try to help her by writing some AI-powered TTS/OCR/etc. apps here and there. It becomes painfully obvious that music was never considered an important part of any AI training dataset, anywhere. T…

> how well Opus 4.8 understands [...] and he'll confidently I always think of the nun character against AI in Mrs Davis: > "Don't give it a name. No one calls Facebook Doug. No one calls Twitter Mary Lou. No one calls them anything, because no one uses them anymore. They use it, and it's not a person. It's code. - Mrs Davis

Eh, humans give names to and/or anthropomorphise lots of things. My partner names all of her cars and bikes; I don't. Isn't it more rational to feel some sort of connection and anthropomorphise a tool with which you can at least have an intelligent conversation, than a simple machine?

Re: Unlimited OCR: One-shot long-horizon parsing

#100

Post by necubi »

peatmoss wrote: post #37
singpolyma3 wrote: post #32

Earlier quoted context omitted.

What about sheet music typesetting formats like https://abcnotation.com/ ?

I forgot to mention ABC. I have seen a few LLMs look at that. There was a model / paper published a couple years back called ChatMusician that built around it. With the caveat that I'm not terribly fluent in ABC, it seems to me that simple things are simple, but hard things seem to be nearly pathological. And (again, maybe a lapse in my understanding) it seems like there may be a fair number of concepts that are impo…

ABC was originally designed for European folk music [0], not church music. The corpora as a result is largely fiddle tunes, particularly Irish (see for example https://thesession.org).

ABC started very simple, because most of the performance information for folk music isn't written down, it's inferred by the player according to the idiom of that particular tradition. As usage of ABC has grown it's gotten more powerful but still falls far short of formats designed for western classical, like MusicXML or Lilypond.

[0] https://abcnotation.com/history

Post reply on HN