Live data from Hacker News

Viewing profile — vikp

vikp

HN member
Joined
Mon, Aug 13, 2012, 1:13 PM UTC
HN karma
1,176
Public activity
209 items

About vikp

I used to teach people, now I teach machines.

Email me at hn@vikas.sh, or check out my work at https://www.vikas.sh.

Recent public activity

  1. comment
    Comment #48774903

    It's an interesting illustration of the state of the AI market that immediately after arguing that AI cannot do anything complex...we have an ad arguing that AI can actually do tho…

  2. comment
    Comment #46332587

    Hey, I'm the founder of Datalab (we released Chandra OCR). I see someone requested it below - happy to help you all get setup. I'm vik@datalab.to

  3. comment
    Comment #46319687

    Yes, we can sign a BAA!

  4. comment
    Comment #46315821

    Hi, I'm a founder of Datalab. I'm not trying to take away from the launch (congrats), just wanted to respond to the specific feedback. I'm glad you found a solution that worked for…

  5. comment
    Comment #44306210

    I assume you're using a PDF, and not the image you shared? You need to set force ocr or format lines to get inline math with a PDF (for images, we just OCR everything anyways, so y…

  6. comment
    Comment #44294953

    Hi, author of marker here - I tried your image, and I don't see the issues you're describing with the newest version of marker (1.7.5). I ran both with no setting specified, and wi…

  7. comment
    Comment #43287027

    Thanks for sharing! I'm training some models now that will hopefully improve this and more :)

  8. comment
    Comment #43287020

    Benchmarking is hard for markdown because of the slight formatting variations between different providers. With HTML, you can use something like TEDS (although there are issues wit…

  9. comment
    Comment #43285912

    I ran a partial benchmark against marker - https://github.com/VikParuchuri/marker . Across 375 samples with LLM as a judge, mistral scores 4.32, and marker 4.41 . Marker can infere…

  10. comment
    Comment #43214140

    I'm a fan of the team of Allen AI and their work. Unfortunately, the benchmarking of olmocr against marker ( https://github.com/VikParuchuri/marker ) is quite flawed. Throughput - …

  11. comment
    Comment #42964025

    Docling is a great project, happy to see more people building in the space. Marker output will be higher quality than docling output across most doc types, especially with the --us…

  12. comment
    Comment #42956619

    Marker ( https://www.github.com/VikParuchuri/marker ) works kind of like this. It uses a layout model to identify blocks and processes each one separately. The internal format is a…

  13. comment
    Comment #42873120

    It's on the list to build - been focusing on quality pretty heavily lately.

  14. comment
    Comment #42872335

    Hey, I'm the author of marker - thanks for sharing. Most of the processing time is model inference right now. I've been retraining some models lately onto new architectures to impr…

  15. comment
    Comment #42576773

    Datalab | NYC | Full-time | Software Engineer and Head of Business Ops | $250k-$350k + 1.5-3% equity | https://www.datalab.to A significant % of useful data is locked away in tough…

  16. comment
    Comment #41204485

    Hi, I'm the author of surya ( https://github.com/VikParuchuri/surya ) - working on improving speed and accuracy now. Happy to collaborate if you have specific page types it's not w…

  17. comment
    Comment #41114991

    Hi, I'm the author of marker - https://github.com/VikParuchuri/marker - from my testing, marker handles almost all the issues you mentioned. The biggest issue (that I'm working on …

  18. comment
    Comment #41114955

    Working on improving tables soon (I'm the author of marker)

  19. comment
    Comment #40370795

    This isn't specifically tuned for tables (more for general pdf to markdown), but it's worked for some people with similar use-cases - https://github.com/VikParuchuri/marker

  20. comment
    Comment #40339360

    For PDF to markdown, I recently released V2 of my tool marker - https://github.com/vikparuchuri/marker

  21. comment
    Comment #40003523

    It should be possible to call a GPL library in a separate process (surya can batch process from the CLI) and avoid GPL - ocrmypdf does this with ghostscript.

  22. comment
    Comment #40003511

    I've benchmarked against google cloud ocr, but the results are on Twitter, not the repo yet - https://twitter.com/VikParuchuri/status/1765440195124691339 . The reason I didn't benc…

  23. comment
    Comment #39970328

    This looks great! You might be interested in surya - https://github.com/VikParuchuri/surya (I'm the author). It does OCR (much more accurate than tesseract), layout analysis, and t…

  24. comment
    Comment #39449744

    I unfortunately haven't had time to benchmark against more than tesseract.

  25. comment
    Comment #39446544

    You may want to try https://github.com/VikParuchuri/surya (I'm the author). I've only benchmarked against tesseract, but it outperforms it by a lot (benchmarks in repo). Happy to d…