Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anki and GPT-3

andrewjudson.com

Post reply on HN
Print view View original

41–50 of 80 posts

Re: Anki and GPT-3

#41

Post by qumpis »

DecayingOrganic wrote: post #21
Version467 wrote: post #10

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

Could you elaborate on the definition of 'low utility'? Is it only in the context of memorization (retaining), or in the context of general understsnding?

Can't see how summarizing isn't a preprocessing step for learning in general. Spaced repetition is a natural next step. I don't see how they compete

Re: Anki and GPT-3

#42

Post by siva7 »

Version467 wrote: post #10

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Anyone who has heavily used Anki will know that loading some deck with complex content that you haven't learned beforehand won't lead to any satisfying results because cards in spaced repetition lack 1) meaningful pedagogic order for learning content and 2) meaningful context for the big picture. Anki is meant for not forgetting, not much more.

Re: Anki and GPT-3

#43

Post by cominous »

duwip wrote: post #27

Silly question, but how does one get an Anki API Key? I've installed anki-connect and can't quite figure out where to get the key...

You can setup one in the anki-connect configuration - or just put in a dummy value that is ignored in case you dont have an Key set.

You might still get 403 error, change the allowed origins to "*" in anki-connect.

Re: Anki and GPT-3

#44

Post by smallerfish »

Just a side note on Anki - it sounds cool, but how is it possible that there are zero screenshots on the product page? Furthermore, it has a super busy (/intimidating-to-non-techies) download section, and the only real descriptive text is on the linked docs/help site, which is so dense that it is completely overwhelming to anybody who is still in "convince me" mode.

The project would probably have 10x the number of users in 6 months if they learned how to do product marketing.

https://apps.ankiweb.net/

Re: Anki and GPT-3

#45

Post by motoboi »

DecayingOrganic wrote: post #21
Version467 wrote: post #10

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

Yeah. But hey! You can only recall what you learned in the first place, right?

Re: Anki and GPT-3

#46

Post by motoboi »

smallerfish wrote: post #44

Just a side note on Anki - it sounds cool, but how is it possible that there are zero screenshots on the product page? Furthermore, it has a super busy (/intimidating-to-non-techies) download section, and the only real descriptive text is on the linked docs/help site, which is so dense that it is completely overwhelming to anybody who is still in "convince me" mode. The project would probably have 10x the number of u…

Anki has been around for a decade, almost two.

Several comercial competitors came and went over the years.

I suppose it tells you something about the learning tools market.

Re: Anki and GPT-3

#48

Post by unhammer »

smallerfish wrote: post #44

Just a side note on Anki - it sounds cool, but how is it possible that there are zero screenshots on the product page? Furthermore, it has a super busy (/intimidating-to-non-techies) download section, and the only real descriptive text is on the linked docs/help site, which is so dense that it is completely overwhelming to anybody who is still in "convince me" mode. The project would probably have 10x the number of u…

Noo don't you'll flood the sync servers and then they'll have to put in ads and tracking and annoying animated birds to keep it all running

Re: Anki and GPT-3

#49

Post by james-revisoai »

Really cool to see! I totally agree that GPT models will revolutionise education, and a few thousand students are using a tool I've launched in that space that runs on PDFs and Youtube videos.

It's specifically optimised LLMs to align with the Anki Minimum Information Principle, here's a 15 second GIF of StudyWand.com - https://studywand.com/images/splash/getStudyingGIF.gif

... showed it on r/GetStudying a few days back mentioning Anki MIP!: https://www.reddit.com/r/GetStudying/comments/10lg4ci/automa...

... it has >98% recall on psychology (compare to between 70-95% recall depending on the subject for the SOTA AIs). We achieve this through quoted filtering - 80%+ of questions are quoted to specific slides or time stamps in YouTube videos.

Would love to chat with you Tomte.

Re: Anki and GPT-3

#50

Post by IanCal »

coffeeri wrote: post #40
IanCal wrote: post #25

Earlier quoted context omitted.

At 2 cents per 1000 tokens (~750 words), unless you're doing it a lot that should be quite manageable? That's ~$13 for 1000 cards of 500 words (prompt + card + tags). The smaller models are cheaper still and might perform well enough.

I guess you are generally right. My prompts are lengthy, since I let GPT-3 handle the full html syntax of both sides, mathjax and so forth. I found the ada model to be not sufficient, but have not tried the other two models, I will try those! There is room for improvement on my side. From a budget-conscious student's perspective, this amounts to roughly $20 per semester in my case, just for the tags. Despite this, I…

That's totally fair, I should be more conscious about different positions (and not get stuck in "as someone with a stable income..." thinking) and you're right these things can build. Curie as a model should cost 1/10th of Davinci - also the recent models are all better I think so if you've not tried them since the GPT-3.5 release it might be worth trying the smaller ones again. If you could get that to $2/semester it's a lot more palatable, as long as the quality isn't too bad. Maybe there's a flow where you can identify low performing cards/subsets so you can do 90% in Curie and 10% in Davinci.

I think my expectation of this kind of service (on demand huge network) is fixed monthly fees, call us for pricing, etc. It's cool that it's approachable as a student. It'll be very interesting as costs for these things drop and/or performance improves at the same price points.

Post reply on HN