Live data from Hacker News

I used GPT to build a search tool for my second brain note-taking system

reasonabledeviations.com

31–40 of 103 posts

Re: I used GPT to build a search tool for my second brain note-taking system

#31
One of my biggest dreams is a self-hosted AI that always listens through my phone and automatically takes notes, puts events in my calendar, set reminders, and template journal entries. A true personal assistant to keep my increasingly-complex life in order.

I'd love a system where I can just point a search engine at my brain. I tried really hard for a while, but I just didn't have the discipline or memory to exhaustively document everything.

An AI that can do this kind of thing in the background would be an absolute godsend for ADHD and ASD people.

Re: I used GPT to build a search tool for my second brain note-taking system

#32
I’d love to have a ChatGPT that was also trained on all of the pages from my “second brain,” Roam Research.

Imagine, I could ask it questions about myself, my friends, and my business. It would in many ways know me better than me from reading all my journal entries.

How many years are we away from something like this?

Re: I used GPT to build a search tool for my second brain note-taking system

#33

One of my biggest dreams is a self-hosted AI that always listens through my phone and automatically takes notes, puts events in my calendar, set reminders, and template journal entries. A true personal assistant to keep my increasingly-complex life in order. I'd love a system where I can just point a search engine at my brain. I tried really hard for a while, but I just didn't have the discipline or memory to exhaust…

MS is very close to this. they have chatGPT listening to meetings and taking notes then adding tasks to attendee calendars...

Re: I used GPT to build a search tool for my second brain note-taking system

#34

These "augmented intelligence" applications are so exciting to me. I'm not as interested in autonomous artificial intelligence. Computers are tools to make my life easier, not meant to lead their own lives! There's a big up-front cost of building a notes database for this application, but it illustrates the point nicely: encode a bunch of data ("memories"), and use an AI like GPT to retrieve information ("remembering…

In chess we had a tiny window of a few years when humans could use the help of computers to play the world's best chess. By 2000, computers were far better than humans and the gap has increased. Chess players are now entertainers, like all us humans are destined to spend our time doing.

While reductive, isn't that true in many professional sports though? I have a wide variety of tools I can use to travel 100m faster than Usain Bolt, but its incredible to watch him do it on his own.

Re: I used GPT to build a search tool for my second brain note-taking system

#35

One of my biggest dreams is a self-hosted AI that always listens through my phone and automatically takes notes, puts events in my calendar, set reminders, and template journal entries. A true personal assistant to keep my increasingly-complex life in order. I'd love a system where I can just point a search engine at my brain. I tried really hard for a while, but I just didn't have the discipline or memory to exhaust…

MS is very close to this. they have chatGPT listening to meetings and taking notes then adding tasks to attendee calendars...

Would be useful if it can insert notes like “no agenda planned” and “this meeting could have been an email”

Re: I used GPT to build a search tool for my second brain note-taking system

#36
post #32

I’d love to have a ChatGPT that was also trained on all of the pages from my “second brain,” Roam Research. Imagine, I could ask it questions about myself, my friends, and my business. It would in many ways know me better than me from reading all my journal entries. How many years are we away from something like this?

Zero. I’ve done this with google drive and GPT-3 (thus quite limited in prompt length). The biggest hurdle for your requirements is the nonexistent public API for ChatGPT and Roam Research.

Re: I used GPT to build a search tool for my second brain note-taking system

#37
post #7

I wonder whether your individually trained chat bot will be allowed to assert the Fifth Amendment right against self-incrimination to stop it from talking when the police interview it. And if it's allowed, do you or it decide whether whether to assert it? What if the two of you disagree? Similar questions for civil trials, divorce proceedings, child custody....

Think about what kinds of data an AI assistant would store about you vs what your phone stores. Your phone is already more or less an extension of your brain, and whether or not you can be forced to unlock and surrender it for inspection is already a contentious topic. IANAL, but phone privacy would probably set the precedent for AI assistant privacy. Always keep your phone encrypted and be aware what your local laws…

All this advice isn't worth much when people will install any app that'll give a dollar discount on their favorite shop/restaurant.

Re: I used GPT to build a search tool for my second brain note-taking system

#38

I've been thinking of using GPT or similar LLMs to extract flashcards to use with my spaced repetition project ( https://github.com/trane-project/trane/ ). As in you give it a book and it creates the flashcards for you and the dependencies between the lessons. I played around with chatgpt and it worked pretty well. I have a lot of other things in my plate to get around first (including starting a math curriculum) but…

I've seen a number of projects around using GPT to generate curriculum and also flashcards in the past three months, I think this is one of the most popular ones: https://autolearnify.com

It's a very good idea in theory but takes almost as much work to verify that the flashcards and curriculum that it generates is accurate and not a hallucinogenic nightmare.

The biggest danger is that the target audience are not experts in the desired subject domain, so they have no way of sanity checking the generated curriculum.

Re: I used GPT to build a search tool for my second brain note-taking system

#39
post #32

I’d love to have a ChatGPT that was also trained on all of the pages from my “second brain,” Roam Research. Imagine, I could ask it questions about myself, my friends, and my business. It would in many ways know me better than me from reading all my journal entries. How many years are we away from something like this?

Zero. I’ve done this with google drive and GPT-3 (thus quite limited in prompt length). The biggest hurdle for your requirements is the nonexistent public API for ChatGPT and Roam Research.

Obsidian is just plain text. Only a matter of time before ChatGPT is accessible via API (there are some libraries that have reverse engineered the API; I put ChatGPT in VSCode when it first came out). Until then, GPT3 has an API.

Re: I used GPT to build a search tool for my second brain note-taking system

#40
post #12
post #8

This is fascinating. Can I train it on 5 years of stream of consciousness morning brain dumps and then say "write blah as me"? Before I do that, I'd love to know if training data becomes part of the global knowledge base available to everyone..

This is not a fine-tuning example. It's an embedding search example. You use the embeddings to search for relevant knowledgebase chunks and then include them in the prompt. Which goes to the original model, not a model that you have trained more. This is popular because it's much much easier to do effectively than fine tuning and the OpenAI model is very capable of integrating kb snippets into a response. What I have…

Would you be able to do something similar with non-text data (eg. tabular data)? For example, could you give it a bunch of excel files and ask it do give you the total units sold for an e-commerce site?
Post reply on HN