Just take a look at how poorly the bot does for Spanish: https://news.ycombinator.com/item?id=35155577
Garbage in, garbage out? Those examples are nonsense and I'm saying that as native speaker.
Duolingo Max, a learning experience powered by GPT-4
61–70 of 250 posts
Re: Duolingo Max, a learning experience powered by GPT-4
#62I deleted Duolingo years ago when it felt like I knew everything it had to teach me, but was still far from fluent in the language. I assume it's gotten better, and would consider trying this new feature.
Re: Duolingo Max, a learning experience powered by GPT-4
#63Earlier quoted context omitted.
My girlfriend is Spanish. I don’t think her family would be impressed if I were to pronounce “gracias” as “grassy ass” xD
I swear some people seem to say “grathios” in Spain but it seems to vary so much…
Re: Duolingo Max, a learning experience powered by GPT-4
#64Earlier quoted context omitted.
Irresponsible to give this to learners
My girlfriend is Spanish. I don’t think her family would be impressed if I were to pronounce “gracias” as “grassy ass” xD
Re: Duolingo Max, a learning experience powered by GPT-4
#65Re: Duolingo Max, a learning experience powered by GPT-4
#66Re: Duolingo Max, a learning experience powered by GPT-4
#67This is interesting because my impression is that LLMs perform poorly on non-english languages[1]. This is likely 'just' a corpus size problem - but it's not like that is going to be fixed any time soon. That said, at least in language instruction there's a lot of meta material that will be helpful. I wonder how Duolingo is detecting when GPT-4 is hallucinating. [1] https://twitter.com/asmelashteka/status/16309662332…
Re: Duolingo Max, a learning experience powered by GPT-4
#68Re: Duolingo Max, a learning experience powered by GPT-4
#69This is interesting because my impression is that LLMs perform poorly on non-english languages[1]. This is likely 'just' a corpus size problem - but it's not like that is going to be fixed any time soon. That said, at least in language instruction there's a lot of meta material that will be helpful. I wonder how Duolingo is detecting when GPT-4 is hallucinating. [1] https://twitter.com/asmelashteka/status/16309662332…
Re: Duolingo Max, a learning experience powered by GPT-4
#70This is interesting because my impression is that LLMs perform poorly on non-english languages[1]. This is likely 'just' a corpus size problem - but it's not like that is going to be fixed any time soon. That said, at least in language instruction there's a lot of meta material that will be helpful. I wonder how Duolingo is detecting when GPT-4 is hallucinating. [1] https://twitter.com/asmelashteka/status/16309662332…
LLM outputs in Standard Chinese are fluent and coherent but the grammar style and choice of words are clearly non-native. I think the source training material just isn't as comprehensive as English, and contemporary Chinese Internet is packed full of latin abbreviations and obscure homophones/wordplay due to its evolution under severe censorship.
Arabic is safe from automation due to its limited exposure to the open web and extreme variability of dialects, and Icelandic will remain obscure due to sample size and the fact that they mostly speak English online.