Live data from Hacker News

Viewing profile — diptanu

diptanu

HN member
Joined
Wed, Jul 23, 2008, 6:52 AM UTC
HN karma
470
Public activity
98 items

About diptanu

Founder of @tensorlake. In the past I designed and worked on Hashicorp's cluster scheduler Nomad, the Titan cluster scheduler and Mesos at Netflix, and FBLearner at Facebook. Email - diptanu@tensorlake.ai

Recent public activity

  1. story
  2. story
  3. story
  4. story
  5. story
  6. comment
    Comment #47420711

    The tricky part of doing this in production is cloning sandboxes across nodes. You would have to snapshot the resident memory, file system (or a CoW layer on top of the rootfs), mo…

  7. story
  8. comment
    Comment #45840617

    There was an unusual traffic spike around that time, if you try now it should be a lot faster. We were calling up but there was not enough GPU capacity at that time.

  9. comment
    Comment #45839550

    We haven’t tested Chandra yet, because it’s very new. Under the hood Tensorlake is very similar to Marker - it’s a pipeline based OCR API, we do layout detection, Text Recognition …

  10. comment
    Comment #45839504

    It does, we have users in Europe and Asia using it with non English languages. Can you please send me a message at diptanu at tensorlake dot ai, would love to see why it didn’t wor…

  11. comment
    Comment #45839489

    OP mentioned Gemini and not Google’s Vertex OCR API which has very different performance and accuracy characteristics than Gemini

  12. comment
    Comment #45839148

    Hey! I am the founder of Tensorlake. We benchmarked the models that our customers consider using in enterprises or regulated industries where there is a big need for processing doc…

  13. story
  14. story
  15. comment
    Comment #44782112

    We parse PDFs to convert them to text in a linearized fashion. The use case for this would be to use the content for downstream use cases - search engine, structured extraction, et…

  16. comment
    Comment #44782093

    Yeah we don't handle this yet.

  17. comment
    Comment #44782090

    Yes this! We training it on a ton of diverse document images to learn reading order and layouts of documents :)

  18. comment
    Comment #44782088

    There are many cases images are exported as PDFs. Think invoices or financial statements that people send to financial services companies. Using layout understanding and OCR based …

  19. comment
    Comment #44780982

    Disclaimer - Founder of Tensorlake, we built a Document Parsing API for developers. This is exactly the reason why Computer Vision approaches for parsing PDFs works so well in the …

  20. story
  21. story
  22. comment
    Comment #42960441

    We started with using LLMs for parsing at Tensorlake ( https://docs.tensorlake.ai ), tried Qwen, Gemini, OpenAI, pretty much everything under the sun. My thought was we could skip …

  23. comment
    Comment #42916166

    I don’t think what you are describing as heavy is that big of a deal if an external orchestration system is required only for deployment, while the workflow can be developed and te…

  24. comment
    Comment #42386009

    Great points. Besides performance, centralized coordination and distributed dataplane is better for operability of schedulers as well. Some examples - Being able to roll out new fe…

  25. story
    Show HN: rerank-ts – TypeScript Library for Re-Ranking Search Results with LLMs

    Hi HN, we are announcing a TypeScript library for re-ranking search results from vector databases or from full text search indexes. Re-Ranking is a very important step in retrieval…