Ask HN: What have you built with LLMs?

#1

Post by break_the_bank » Mon, Feb 05, 2024, 5:16 PM UTC

Curious what people have been building with LLMs.

I worked on a chrome extension a few weeks ago that skips sponsorship sections in YouTube videos by reading through the transcript. Also was trying to experiment with an LLM to explain a function call chain across languages (in this case MakeFile, Python, Bash). I've tried running a few telegram bots that are PRE prompted to do certain things like help you with taxes.

What are you building?

What does the stack look like? How do you deploy it?

Re: Ask HN: What have you built with LLMs?

#2

Post by smudge-ai » Mon, Feb 05, 2024, 5:23 PM UTC

Also a Chrome extension [0]! The concept is to use the browser's context menu to run commands on the LLM, so it stays out of your way most of the time but feels like a somewhat native experience.

The stack is: 1. TypeScript/Node/tRPC/Postgres/Redis/OpenAI on the backend 2. SolidJS/Crxjs/tRPC on the front end 3. Astro for the docs/marketing site

And deployment is currently through render.com for the databases and servers, and manually via a zip file to the Chrome webstore for the extension itself.

[0] https://smudge.ai

Re: Ask HN: What have you built with LLMs?

#3

Post by Mr-Frog » Mon, Feb 05, 2024, 6:06 PM UTC

My project team in university built a meme generator that uses GPT and Dall-E to generate image macros using Impact font. It was pretty entertaining.

Re: Ask HN: What have you built with LLMs?

#4

Post by iAkashPaul » Mon, Feb 05, 2024, 6:08 PM UTC

Summarisation for calls, emails. Lots of extraction tasks & closed domain chatbots.

Deployment is usually FastAPI for business logic, Langchain or MS/Guidance library, LLM hosted via. HF-TGI server

Re: Ask HN: What have you built with LLMs?

#5

Post by scastiel » Mon, Feb 05, 2024, 6:16 PM UTC

For my expense sharing app [1], I added receipt scanning [2] in a few minutes and a few lines of code by using GPT 4 with Vision. I am aware that LLMs often are a solution looking for a problem, but there are some situations where a bit of magic is just great :)

It is a Next.js application, calling OpenAI’s API using a plain API route.

[1] https://spliit.app

[2] https://spliit.app/blog/announcing-receipt-scanning-using-ai

Re: Ask HN: What have you built with LLMs?

#6

Post by golergka » Mon, Feb 05, 2024, 6:16 PM UTC

I've built a sales bot that would go over a predefined sales scenario like a real human would, being able to jump between steps and work with any complications real conversation would throw at it. It would appear fully human to whoever converted with it. Unfortunately, it was never deployed in production due to business reasons.

Re: Ask HN: What have you built with LLMs?

#7

Post by fcmgr » Mon, Feb 05, 2024, 6:16 PM UTC

I've created just-tell-me [1] that summarizes youtube videos with ChatGPT. It's built with Deno, uses TypeScript and is deployed with Deno Deploy. It's open source, you can run it from CLI as well [2]

[1] https://just-tell-me.deno.dev/

[2] https://github.com/franekmagiera/just-tell-me

Re: Ask HN: What have you built with LLMs?

#8

Post by elpocko » Mon, Feb 05, 2024, 6:19 PM UTC

Absurd news article generator using local LLMs. I wanted to create a static website from the articles, but ultimately didn't think anyone would give a damn. In the same vein I create a person + CV generator, and a group chat between simulated crazy people.

I made a private Discord bot for me and my friends to talk to, that also generates images using SD 1.5 LCM.

The self-hosted backend uses the ComfyUI Python API directly for images, and the LLM part uses oobabooga's web API.

Re: Ask HN: What have you built with LLMs?

#9

Post by lalaithion » Mon, Feb 05, 2024, 6:22 PM UTC

I wrote a script that takes in my credit card statement line by line and categorized the transactions into a custom set of categories that I cared about as well as generating a human readable description of the transaction.

Re: Ask HN: What have you built with LLMs?

#10

Post by ChikkaChiChi » Mon, Feb 05, 2024, 6:22 PM UTC

Built a tool to summarize certification and licensing costs associated with jobs that require State credentialing.