I built a language learning tool [1] that uses LLMs to get word definitions in the context of a sentence, among other features I'm planning to release.
I'm using modal.com as the backend for the AI related micro services.
Ask HN: What have you built with LLMs?
251–260 of 349 posts
Re: Ask HN: What have you built with LLMs?
#252I'm building a chatbot (API + frontend) to transcribe natural language questions into SQL query for a Snowflake database.
Re: Ask HN: What have you built with LLMs?
#253My "stack" is just Apple Shortcuts making HTTP POST API calls to OpenAI, which does stuff in MacOS via BetterTouchTool. I trigger each by hotkey or typing a few letter into Spotlight (with Alfred). One transcribes and summarizes whatever youtube URL is highlighted. One does grammar and style correction of whatever is highlighted (and replaces it). One simply replaces the Dictate key with OpenAI Whisper but otherwise…
I have looking for a way to do "push to record audio" (instead of Mac's dictate) for ages, thanks for the push to look at Shortcuts!
Are you using the "Record Audio" action or something else? Ideally the shortcut would stop listening after a pause like the native Dictate feature does it. At a minimum Record Audio seems to require hitting spacebar to stop - not great but not terrible.
Re: Ask HN: What have you built with LLMs?
#254[deleted]
Re: Ask HN: What have you built with LLMs?
#255I have built a webapp for translating srt files: https://www.subsgpt.com GPT-4 excels as a translator, but it often encounters issues with content warnings and formatting errors when translating entire subtitle files via ChatGPT. The solution is straightforward: divide the subtitle file into sections, focusing solely on translating the text and disregarding the timestamps. While it's feasible to have ChatGPT maintain…
This is great, how well does it do with informal/slang Portuguese, Russian or Spanish?
GPT4 is incredible! We watched https://en.wikipedia.org/wiki/The_Boy%27s_Word:_Blood_on_the... which is full of slang and it was perfectly comprehensive. I love how it'd translate informal speech into informal.
Re: Ask HN: What have you built with LLMs?
#256I built a RAG implementation for 35k books/articles/wiki pages/web pages i collected over the years(it took about 6 weeks on 3070ti 100% constant usage). I query it with various steps of data extraction/narrative building/refining etc, over LLMs. Almost daily i figure out new steps to add to the pipeline and honestly, i could not imagine learning about niche topic x from so many perspectives/periods in such a short time(including the original source). I did not yet figure out how to package this, but i spend at least 2h of my free time daily with it. Ideas and feedback is welcome.
Re: Ask HN: What have you built with LLMs?
#257I built a RAG implementation for 35k books/articles/wiki pages/web pages i collected over the years(it took about 6 weeks on 3070ti 100% constant usage). I query it with various steps of data extraction/narrative building/refining etc, over LLMs. Almost daily i figure out new steps to add to the pipeline and honestly, i could not imagine learning about niche topic x from so many perspectives/periods in such a short t…
can you share more about this? when you say "it took about 6 weeks on 3070ti 100% constant usage" is that 6 weeks generating embeddings?
Re: Ask HN: What have you built with LLMs?
#258I built a RAG implementation for 35k books/articles/wiki pages/web pages i collected over the years(it took about 6 weeks on 3070ti 100% constant usage). I query it with various steps of data extraction/narrative building/refining etc, over LLMs. Almost daily i figure out new steps to add to the pipeline and honestly, i could not imagine learning about niche topic x from so many perspectives/periods in such a short t…
I’m also building a RAG app and I’m finding so many different ways to do it.
I’m curious: was there one method that improved the accuracy/relevance of the answers the most?
Also, are you using Langchain, Llamaindex, or something else?
Re: Ask HN: What have you built with LLMs?
#259Earlier quoted context omitted.
Very interesting, have you attempted to backtest to see if the LLM forecasts are accurate?
Thanks for asking! Not yet as I’ve been focusing on building agents that can properly and regularly log predictions. Ideally, I’d like the agents to then participate in prediction markets or “superforecasting” groups to use actual human predictions as baselines.
If your project makes you rich and you need some engineering help, call me ;)
Re: Ask HN: What have you built with LLMs?
#260I used FlowWise[1], LM Studio[2], the llama2[3] model, and Ollama[4] (for embeddings) to create a local-only RAG chatbot so I could chat directly with Tristram Shandy, Gentleman[5]. For the context document I used the text of the novel of the same name, downloaded from Project Gutenberg. Primarily it was a PoC to see if a document based chatbot could work without crossing trust boundaries by calling out to untrusted…
Seriously!? I love the idea, but I perhaps love more that Tristram Shandy was your choice of character to chat with. You have good taste!