Viewing profile — dheerkt

based on their past usage of "interleaved tool calling" it means that the tool can be used while the model is thinking. https://aws.amazon.com/blogs/opensource/using-strands-agents…

How is this different from a local Jupyter notebook? Can we not do this with ! or % in a .ipynb? Genuine question. Not familiar with this company or the CLI product.

This is the non-AI version of an AI CEO saying programmers will not exist in 5 years.

I recently wrote a post outlining our method to reduce hallucinations in LLM agents by leveraging a verified semantic cache. The approach pre-populates the cache with verified ques…

yeah converse api supports all models on bedrock, or atleast all the text2text ones

If the user asks such a question, your agent should not invoke the RAG at all, but simply answer from the history. You need to focus on your orchestration step. Search for ReAct ag…

Skeptical that this will be a "good" experience for everyone involved considering how generic AI openers/responses are, but also hopeful that it can reduce friction for some. Excit…

Not an expert by any means but streaming HQ video is pretty expensive (even more so for live content), seems like the only providers that can do so profitably are YouTube and Netfl…

Hmm interesting, didn't realize that data sovereignty requirements were so stringent. Wonder how other cloud providers are doing in this sense considering GPU shortages across the …

Can you not use cross-region inference?

I'm confused, what's expensive about it? It's a serverless pay per token model? Do you mean specifically the Bedrock Knowledgebase/RAG -- that uses serverless OpenSearch which cost…

Study funded by Microsoft, conducted by Microsoft engineers, says Microsoft product makes engineers +X% more productive.

Also shouting out Continue.dev for vscode users. I set it up yesterday, open-source version of Cursor. (not affiliated, I tried to setup Avante but I'm a neovim noob and have skill…

Just set it up 2 days ago. I fully agree with his take. Cursor does a lot to reduce the headache of copy pasting results from ChatGPT/Claude. Makes coding with AI much faster and l…

WITCH is the acronym for Indian tech consulting companies for WiPro, InfoSys, Tata Consultancy Services, C something, H something. They're stereotyped as being cheap and low-qualit…

Do publications to my BigCo employer's engineering blog count towards an O-1 application? Or is it just Research Papers/citations to formal journals that matter? What are some othe…

Moved from NOVA to Union City, NJ. My commute to Midtown is shorter than it would be if I were living in Brooklyn via Port Authority Buses. Rent is cheaper, and don't need to pay c…