Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Has Anyone Trained a personal LLM using their personal notes?

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 77 posts

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#11

Post by KMnO4 »

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens:

- The audio is preprocessed (chunked) and sent to Whisper to generate a transcript

- The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information

- The next meeting’s date/time is added to my calendar

- A chatbot is created that allows me to chat with each session, including playing the role as the therapist and continuing the conversation (with the entire context of what I actually talked about)

It’s been exceedingly helpful to be able to review all my therapy sessions this way.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#12

Post by kid64 »

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

I hope you're the patient in this scenario, otherwise this is an egregious HIPAA violation.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#13

Post by rhcom2 »

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

I'm sincerely happy you're finding value in this and it's a very impressive workflow. The idea of sending my therapy sessions to OpenAI sounds terrifying though.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#14

Post by jondwillis »

I started fine-tuning GPT-3.5 on a decently large corpus of my text messages and emails, and it pretty much generated schizophrenic output. I don’t think I did a very good job of curating the text that ended up fine-tuning, and I want to try again.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#16

Post by jondwillis »

CSMastermind wrote: post #15

It sounds like you want RAG instead of training or even fine tuning a model. Have you looked into the OpenAI APIs? They make it relatively easy to do assuming you have some limited programming knowledge.

Are you referring to the "Assistants" API?

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#17

Post by fullautomation »

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

This is really interesting, are your comfortable with OpenAI having your personal details in this case?

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#18

Post by psychopomp »

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

I’d love to replicate your workflow. Any luck with speaker diarization using whisper? I’ve tried WhisperX several but it didn’t work.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#19

Post by xyst »

KMnO4 wrote: post #11

Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens: - The audio is preprocessed (chunked) and sent to Whisper to generate a transcript - The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information - The next meeting’s da…

[flagged]
Post reply on HN