Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Has Anyone Trained a personal LLM using their personal notes?

news.ycombinator.com

Post reply on HN
Print view View original

71–77 of 77 posts

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#71

Post by bredren »

bshaughn wrote: post #69
bredren wrote: post #36

Has anyone seen or used something that can train on a complete imessage history? Presumably, I have more than enough messages from me along with responses from others to chat with a version of myself that bears an incredible likeness to how I speak and think. In some cases, I'd expect to be able to chat with an LLM of a given contact to see how they'd respond to various questions as well.

I've implemented a POC on exactly this and am working on something more sophisticated right now. Can I reach out to discuss more?

Yes, I'd gladly trial something like this.

It must run locally / require no network requests. I can run on an M2 w 24GB or M3 with 36GB.

My email is in my profile here.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#72

Post by CSMastermind »

jondwillis wrote: post #16
CSMastermind wrote: post #15

It sounds like you want RAG instead of training or even fine tuning a model. Have you looked into the OpenAI APIs? They make it relatively easy to do assuming you have some limited programming knowledge.

Are you referring to the "Assistants" API?

I was not, that's relatively new, though if I'm not mistaken it might make the process easier.

I mean calling the embeddings API and then having software locally that finds and appends documents to your queries.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#73

Post by yyytolys »

dumbmrblah wrote: post #8

I’ve tried several different systems, nothing really stands out. That being said, I’m trying to document as much as my life in anticipation of such programs existing in the near future. I’m not going overboard, but for example, I wouldn’t really keep a personal diary, but now I try to jot down something every day, write down my thought processes on things, what actions were done and why. I’m looking forward to a day…

This idea is also what I am thinking about. At present, I am also trying to do applied research in this aspect. If it can achieve substantial help, it will be very meaningful.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#74

Post by woodpanel »

pb060 wrote: post #26

Gianluca Nicoletti, an Italian journalist, writer and radio speaker, is training a LLM with all writings as a support for his autistic child for when he won’t be here anymore. The software will speak with his voice. https://www.lospessore.com/13/07/2023/una-chatbot-per-contin...

Very interesting.

Since presumably "all writings" refers to all his writings during his lifetime, I'd hope it can account for those times in his life at which he changend his mind on certain topics?

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#75

Post by pb060 »

woodpanel wrote: post #74
pb060 wrote: post #26

Gianluca Nicoletti, an Italian journalist, writer and radio speaker, is training a LLM with all writings as a support for his autistic child for when he won’t be here anymore. The software will speak with his voice. https://www.lospessore.com/13/07/2023/una-chatbot-per-contin...

Very interesting. Since presumably "all writings" refers to all his writings during his lifetime, I'd hope it can account for those times in his life at which he changend his mind on certain topics?

Yes I guess that “all writings” (sorry I meant all of his writings - not an English native) means everything he wrote and also his speeches, taking into account the times when he changed his mind. Knowing how meticulous he is I would be surprised if this wasn’t the case. Worth considering that he was recently diagnosed a mild form of autism himself.

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#76

Post by sabaimran »

Brajeshwar wrote: post #20

Neither mine nor endorsing, and I haven't played besides the initial installation but Khoj has an open source offering for this. Check it out https://khoj.dev

Hi! Founder of Khoj, happy to add more context.

Khoj will allow you to plug in your Obsidian vault or any plaintext files on your machine or Notion workspace. After you share the relevant data, it creates embeddings and uses it for RAG, so you get appropriately contextual responses with your LLM.

This is the best place to start for self-hosting: https://docs.khoj.dev/get-started/setup

Re: Ask HN: Has Anyone Trained a personal LLM using their personal notes?

#77

Post by davidgu »

LethoETH wrote: post #62
Erazal wrote: post #50

Earlier quoted context omitted.

wow - really cool. I'm actually the founder of an AI Meeting Bot company - and we're thinking of open-sourcing so you could run exactly this set-up locally with perfect diarization / recording while also maintaining privacy [1]. I'm currently creating code examples, and just finished the "chat with each session". Would love to know how you implemented it. [1] https://aimeetingbot.com

[dead]

I'm obviously biased as the founder, but check out https://recall.ai/ for a meeting bot API.

We serve over 300 companies, process millions of hours of recording a year, and are officially partnered with Zoom.

Post reply on HN