Live data from Hacker News

Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

eugeneyan.com

21–30 of 72 posts

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#21
So what is the sample size at which this can be useful. A notes vault doesn't seem large enough.

Obsidian/Logseq are already great for thinking by way of their "show a random note" feature. Usually pulling up unfinished thoughts from past days will give me an idea for extending it.

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#22
post #8
post #6

Earlier quoted context omitted.

This will sound harsh, but I won’t sugarcoat it: OpenAI isn’t a charity.

But at this point it should be (maybe not OpenAI but some other organization). OpenAI is close to becoming a necessity and a human right just like education so it should be 100% free and accessible at some point. EDIT: I meant AI, not specifically OpenAI.

>OpenAI is close to becoming a necessity

I disagree. What gives you the idea that any software is a necessity? We've (modern humans) been around for 200,000+ years and software (and LLMs for less than a tenth of the time that software has been around) has existed for ~0.04% of that time.

Oxygen (in its molecular, 02 form) is a necessity. Water is a necessity. Nutrition of some sort is a necessity.

Pretty much everything else is a nice-to-have (with some things like money and shelter being important, but as we see from the poverty and homelessness around the world, definitely not a necessity).

I'd posit that LLMs are helpful and sometimes even useful. But necessary? I think not.

I'd note that I'm not dismissing LLMs, nor am I trying to dump on you. But the idea that any software is necessary is ridiculous on its face.

cf. https://www.merriam-webster.com/dictionary/necessary

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#23
Um... can someone explain what this actually does?

In the video the user chooses the 'Copilot: Draft' action, and wow, it generates code...

...but, the 'draft' action [1] calls `/get_chunks` and then runs 'queryLLM' [2] which then just invokes 'https://api.openai.com/v1/chat/completions' directly.

So, generating text this way is 100% not interesting or relevant.

What's interesting here is how it's building the prompt to send to the openai-api.

So... can anyone shed some light on what the actual code [3] in get_chunks() does, and why you would... hm... I guess, do a lookup and pass the results to the openai api, instead of just the raw text?

The repo says: "You write a section header and the copilot retrieves relevant notes & docs to draft that section for you.", and you can see in the linked post [4], this is basically what the OP is trying to implement here; you write 'I want X', and the plugin (a bit like copilot) does a lookup of related documents, crafts a meta-prompt and passes the prompt to the openai api.

...but, it doesn't seem to do that. It seems to ignore your actual prompt, lookup related documents by embedding similarity... and then... pass those documents in as the prompt?

I'm pretty confused as to why you would want that.

It basically requires that you write your prompt separately before hand, so you can invoke it magically with a one-line prompt later. Did I misunderstand how this works?

[1] - https://github.com/eugeneyan/obsidian-copilot/blob/bdabdc422...

[2] - https://github.com/eugeneyan/obsidian-copilot/blob/bdabdc422...

[3] - https://github.com/eugeneyan/obsidian-copilot/blob/main/src/...

[4] - https://eugeneyan.com/writing/llm-experiments/#shortcomings-...

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#24
post #16
post #11

Earlier quoted context omitted.

I say this calmly, it's wild for you because you're probably part of the privileged group of people who can sustain themselves with a steady job and has no problem paying for it.

Like having access to HN via some form of Internet access? Envy doesn't create rights for oneself nor does it impute privilege to others, and people who read and write on the internet about privilege seem blinkered, to me, about how they'd sound to someone who walks two miles for water polluted by the mining of rare earth elements.

> Envy doesn't create rights for oneself nor does it impute privilege to other

I'm saving this for posterity!

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#25
post #8
post #6

Earlier quoted context omitted.

This will sound harsh, but I won’t sugarcoat it: OpenAI isn’t a charity.

But at this point it should be (maybe not OpenAI but some other organization). OpenAI is close to becoming a necessity and a human right just like education so it should be 100% free and accessible at some point. EDIT: I meant AI, not specifically OpenAI.

Not OpenAI. But AI in principle? Perhaps.

This would have to be solved by actual nonprofits, though.

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#27
post #19
post #9

Earlier quoted context omitted.

"OpenAI is close to becoming a necessity and a human right" is the wildest claim I have heard yet about AI. (Though it's possible that maybe someday I will agree with this).

and some still say that AI isn't being overhyped.

“It’s my human right to delegate my thinking to a higher power” works for religions and cults so why not machine learning?

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#28
post #8
post #6

Earlier quoted context omitted.

This will sound harsh, but I won’t sugarcoat it: OpenAI isn’t a charity.

But at this point it should be (maybe not OpenAI but some other organization). OpenAI is close to becoming a necessity and a human right just like education so it should be 100% free and accessible at some point. EDIT: I meant AI, not specifically OpenAI.

The right to AI is different than the right to free hosted inference.

Anyone can download a model and use it completely offline, or hosted on your own server. And there's a lot of effort to make these models work on devices that don't have much computing power (even phones [0]), which increases access even more.

Since this is the world we currently live in, what are you suggesting should change?

[0] https://mlc.ai/mlc-llm/

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#29

Another option is to use llama-index and index the Obsidian vault. I use a gradio based web interface to query my Obsidian vault via GPT-3.5. It's pretty awesome.

Does your data stay local by doing this?

Mostly but it does upload some of the vectorized data to insert into the prompt for context. When you do a query llama-index tries to discover content related to your prompt and injects it for context so its not entirely local.

Re: Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

#30

I love obsidian but the first plugin I tried (and paid for) led to subtle data loss and resulted in many hours of checking and merging a month of backups. Not going to risk that again.

Wow, that's awful -- and an extreme outlier. Most plugins are free. And given under the hood Obsidian notes are just markdown files on the local filesystem, backups can be managed by git or TimeMachine or rsync or whatever else you might use on other directories. That's not to discredit your experience, just speaking up for the sake of others who might be unduly scared off.
Post reply on HN