Live data from Hacker News

Anki and GPT-3

andrewjudson.com

31–40 of 80 posts

Re: Anki and GPT-3

#31

Very cool! I've experimented with a similar thing for trivia questions based on Wikipedia articles. I'm also trying to reference the part of the text where the question was generated from, so the user can verify if it was correct or learn more about it in context. https://trivai.app/ I currently require a sign up to generate questions, but the latest questions can be seen at https://trivai.app/latest-questions

This looks awesome, great example on how to use GPT-3 for fun and learning

Re: Anki and GPT-3

#32

Earlier quoted context omitted.

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

According to some people (Justin Sung on YouTube is where I heard it, probably, so no idea if credible) you can influence the forgetting-curve and make Anki more effective by having more context, putting knowledge into relationships with other knowledge, etc. It's a multiplier on raw/rote space repetition.

Really depends on how you’re defining context, since to me there’s concepts like memory chains/ladders, which simply fit sequential memories into a visualization — then there are applications contexts, which actually mirror reality of future use.

Great example of this is topic of memory sports [1], which do use techniques that work, but are likely less useful for actual remembering real world complex information.

[1] https://wikipedia.org/wiki/Memory_sport

Re: Anki and GPT-3

#33

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

Note taking with SRS may be greater than the sum of the parts.

Re: Anki and GPT-3

#34

Earlier quoted context omitted.

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

According to some people (Justin Sung on YouTube is where I heard it, probably, so no idea if credible) you can influence the forgetting-curve and make Anki more effective by having more context, putting knowledge into relationships with other knowledge, etc. It's a multiplier on raw/rote space repetition.

I have found that by adding simple etymologies I can improve my recall of Latin names for plants. The etymology connects an otherwise totally new word to existing word-concepts.

Re: Anki and GPT-3

#35

Very cool! I've experimented with a similar thing for trivia questions based on Wikipedia articles. I'm also trying to reference the part of the text where the question was generated from, so the user can verify if it was correct or learn more about it in context. https://trivai.app/ I currently require a sign up to generate questions, but the latest questions can be seen at https://trivai.app/latest-questions

> What is the belief in the existence of an afterlife called?

Answer: ancestor worship.

Then the explanation talks about the other three options, but does not reference afterlife.

I wonder what went wrong?

Re: Anki and GPT-3

#36

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Yeah, I had some success with generating conjugation tables for irregular verbs in Portuguese, but that's just rote memorisation. I still had to clean them up, but the entire process was quicker than typing manually or web scraping.

Re: Anki and GPT-3

#37

As a daily Anki user, I am highly skeptical of this idea. The careful creation of new cards is one of the key parts in learning the material. It promotes a critical thinking step where you have to distill the material down into small but important pieces and (if you want to do it well) forces you to evaluate if you have actually understood what you wrote down. I suspect that forgoing this step will not lead to unders…

Anki's key benefits stem from its utilization of two highly supported and extensively researched pedagogical strategies: (1) retrieval practice and (2) spaced repetition. In contrast, the practice of note-taking, which essentially entails summarizing information in one's own words, has been found to have 'low utility' in academic literature. [0] [0]: https://sci-hub.ru/https://pubmed.ncbi.nlm.nih.gov/26173288/

Depends on the note-taking strategy. From the same paper you cited, section 8.4 Practice testing - Issues for implementation, pages 34-35:

> Another merit of practice testing is that it can be implemented with minimal training. Students can engage in recall-based self-testing in a relatively straightforward fashion. For example, students can self-test via cued recall by creating flashcards (free and low-cost flashcard software is also readily available) or by using the Cornell note-taking system (which involves leaving a blank column when taking notes in class and entering key terms or questions in it shortly after taking notes to use for self-testing when reviewing notes at a later time; for more details, see Pauk & Ross, 2010).

Further explanation: https://lsc.cornell.edu/notes.html#post-1037

The Cornell note-taking system combines moderate and high learning techniques: elaborative interrogation, self-explanation, practice testing, and distributed practice.

If you think about it, creating Anki cards is note-taking in a specific format. Of course you can skip it and use a set prepared by someone else. It would be interesting to test: is creating your own flashcards better for studying than using ready-made ones?

Re: Anki and GPT-3

#38
post #35

Very cool! I've experimented with a similar thing for trivia questions based on Wikipedia articles. I'm also trying to reference the part of the text where the question was generated from, so the user can verify if it was correct or learn more about it in context. https://trivai.app/ I currently require a sign up to generate questions, but the latest questions can be seen at https://trivai.app/latest-questions

> What is the belief in the existence of an afterlife called? Answer: ancestor worship. Then the explanation talks about the other three options, but does not reference afterlife. I wonder what went wrong?

Me too! I’ve been experimenting with the prompt to try to make it provide better references and questions.

Logged in users can upvote and downvote questions so the next step will be to try to fine tune the model on good questions.

Re: Anki and GPT-3

#39
post #17

From my experience, automatically generated flashcards are often disappointing. Recently I've been experimenting with the use of GitHub copilot for accelerating cards creation and I can wholeheartedly recommend this approach, I've noticed at least 2x speed up in the process without sacrificing cards quality

[dead]

Re: Anki and GPT-3

#40
post #25

Earlier quoted context omitted.

This statement is accurate for testing and experimentation purposes. Additionally, the $18 starting credit provided by OpenAI is a nice bonus. I created a small Anki plugin that tags cards based on their content using the Text-Davinci-003 model. However, the cost quickly becomes prohibitive when a large number of tokens/ Anki cards need to be processed. To be fair that plugin is not working great, since tags should b…

At 2 cents per 1000 tokens (~750 words), unless you're doing it a lot that should be quite manageable? That's ~$13 for 1000 cards of 500 words (prompt + card + tags). The smaller models are cheaper still and might perform well enough.

I guess you are generally right. My prompts are lengthy, since I let GPT-3 handle the full html syntax of both sides, mathjax and so forth. I found the ada model to be not sufficient, but have not tried the other two models, I will try those! There is room for improvement on my side.

From a budget-conscious student's perspective, this amounts to roughly $20 per semester in my case, just for the tags. Despite this, I am still fascinated by the automation possibilities offered by GPT-3.

Post reply on HN