Ask HN: Has Anyone Trained a personal LLM using their personal notes?

Post by LethoETH » Thu, Apr 04, 2024, 1:16 PM UTC

Erazal wrote: post #50

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

wow - really cool. I'm actually the founder of an AI Meeting Bot company - and we're thinking of open-sourcing so you could run exactly this set-up locally with perfect diarization / recording while also maintaining privacy [1]. I'm currently creating code examples, and just finished the "chat with each session". Would love to know how you implemented it. [1] https://aimeetingbot.com

Post by tqwhite » Thu, Apr 04, 2024, 2:08 PM UTC

fullautomation wrote: post #17

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

This is really interesting, are your comfortable with OpenAI having your personal details in this case?

Post by appstorelottery » Thu, Apr 04, 2024, 2:48 PM UTC

NKosmatos wrote: post #61

appstorelottery wrote: post #42

I've been disciplined (perhaps obsessive at times) with keeping a daily diary for many years and I was interested in being able to query my diary locally via AI. I found a solution that works surprisingly well using GPT4ALL. I found GPT4ALL ( https://gpt4all.io ) to have a nice-enough GUI, and it runs reasonably quickly on my M1 MacBook Air with 8Gb of ram, and it can be setup to be a completely local solution - not…

Nice one, I'm going to give it a try. When you say Sbert you mean the GPT4All LocalDocs plugin?

Post by appstorelottery » Thu, Apr 04, 2024, 2:53 PM UTC

resource_waste wrote: post #47

appstorelottery wrote: post #42

I've been disciplined (perhaps obsessive at times) with keeping a daily diary for many years and I was interested in being able to query my diary locally via AI. I found a solution that works surprisingly well using GPT4ALL. I found GPT4ALL ( https://gpt4all.io ) to have a nice-enough GUI, and it runs reasonably quickly on my M1 MacBook Air with 8Gb of ram, and it can be setup to be a completely local solution - not…

This might seem impressive because of the subjectiveness. I also imagine, you arent mentioning the times it was completely incorrect because you used a negative in the sentence. This is regular embeddings + LLM. At the end of the day, you are basically just adding a preprompt to a search. Not to mention, the Mistral models are barely useful for logic. I'm not really sure what you are getting out of it. I'm wondering…

Post by ethbr1 » Thu, Apr 04, 2024, 3:52 PM UTC

serial_dev wrote: post #45

mewpmewp2 wrote: post #41

Earlier quoted context omitted.

Another possibility is to use "op", although it can feel a bit forumish.

I used OP, though, I didn't want to use "OP" every time I am referencing this person, I thought it would sound strange OP OP OP... Anyway, I'm glad this thread turned into a "how you can avoid being called a misogynist in throwaway comment on HN". I guess from now on, I filter through my comments through Gemini to make sure my English is immaculate and that native English speakers don't castigate me for a small mista…