Viewing profile — prats226

With lot of code being pushed, how are you guys managing PR reviews? - Only review by some other agent - Ask devs to push plans and review those - Review critical code paths yourse…

A good experiment would be to also try giving it access to latency traces so it can identify issues? Wrt coding agents, giving access to observability tools often improve coding/de…

Try https://docstrange.nanonets.com/ once, 10k docs you can use for free. Strong table performance. Do give feedback if any. Powered by bigger model compared to our open source one…

If with LLM's you can deanonymize at scale, on a personal level, you should also be able to figure out what posts are leading to this deanonymization and remove them or modify them…

Instead of markdown -> LLM to get JSON, you can just train a slightly bigger model which you can constrain decode to give JSON rightaway. https://huggingface.co/nanonets/Nanonets-O…

https://nanonets.com/cookbooks/structured-llm-outputs/uncons...

Nice, it would be good idea to develop CFG for this as well so can embed it into all these constrained decoding libraries

One of the authors here, will checkout the diagram link. Every commercial model provider is adding structured outputs so will keep updating the guide.

https://docstrange.nanonets.com/ as well, wrapper on top of 7B version of https://huggingface.co/nanonets/Nanonets-OCR2-3B

Then you can just download finetuned version of same multi-modal foundation model that's trained on documents?

Top 3 models on huggingface are all OCR models. Most automation projects involve documents where you need a model finetuned to understand all elements inside documents and provide …

Would be intersting to see where funding goes to fix these issues. News would heavily impact public opinion and hence political influence and public funding.

Yes, and its not just OCR (Optical Character Recognition), it understands layouts, captures signatures, charts, watermarks etc so way beyond just characters

https://mention.com/en/

Here is link to open source model: https://huggingface.co/nanonets/Nanonets-OCR-s And hosted model: https://docstrange.nanonets.com/

It boils down to information loss in compaction driven by LLM's. Either you could carefully design tools that only give compacted output with high information density so models hav…

Reason I felt like they are closely connected are because for designing tools for lets say coding agents, you have to be thoughful of context engineering. Eg linear MCP is notoriou…

Context engineering is another name people have given to same skill?

You can always put automation for your google home to blast music at full volume at right time. And if you don't wake up from sound of music yourself, your neighbour will knock on …

With google serving AI overviews, now an average search query should cost more? Compute is getting cheaper but also algorithms getting more and more complex, increasing compute?

Read long time ago that even SFT for conversations vs base model for autocomplete reduces intelligence, increases perplexity

> But here’s the important part: LLMs don’t know how to use tools. They don’t have native tool calling support. They just generate text that represents a function call. Its not a c…

This is super interesting to think about in LLM world where lot of software is getting replaced with LLM calls. In terms of output of an LLM, there is no clear promise in the contr…