Live data from Hacker News

Show HN: I built an AI language teacher to get you speaking

gliglish.com

61–70 of 112 posts

Re: Show HN: I built an AI language teacher to get you speaking

#61
post #7

This is outstanding. And the limitations of its speech recognition are actually a feature - it forces me to really concentrate on pronunciation. Now do Mandarin and take my money please :)

Thank you . A friend's been asking for Mandarin for a while, time to deliver on my promise to add it! Will try to get it ready within 24 hours of posting this.

> And the limitations of its speech recognition are actually a feature - it forces me to really concentrate on pronunciation

I appreciate the positive comment! People complaining about the limitations of speech recognition make a valid point, but there's an ELEPHANT IN THE ROOM of language education that I feel needs to be addressed:

Language classes ignore speaking for the most part. Speaking time is ultra-limited. Phonetics are introduced super late (or never). And text is used as a form of baby-sitting to the detriment of listening (which is really –literally– backwards because the natural order of picking up a language is as follows: 1. listening 2. speaking 3. reading 4. writing.)

There's a cost to it: most people develop a fear of speaking and a confusing accent.

We can see the current limits with speech recognition and say that it and the products that use it are no good. But this feels like throwing the baby with the bathwater.

Or, we can seize it as an opportunity to improve one's accent. (Spent thousands of bucks on accent training, this is much cheaper! )

(I do plan to improve speech recognition as tech matures (fast), but there's an opportunity for improving one's accent here that would be too bad to miss.)

Re: Show HN: I built an AI language teacher to get you speaking

#62
post #46

Earlier quoted context omitted.

Thank you! I actually got that reaction from a few users , this is always nice to hear though. It's far from perfect though. I'll try my best!

It suddenly switched from German to French in my transcription, and then the teacher switched too. A bug to look into I guess https://gliglish.com/convo/b4104729-35c2-4c97-a887-9bae730ca...

Thank you for the report.

Multilingual speech recognition is proving both a curse and a blessing. I will:

1. Turn it off by default 2. Ask people for their native and target language so as to detect when things go wrong. In which case, I'd give a second shot at transcribing and, if nothing comes out of it, just ask you to repeat nicely. (As it happens in real conversations.)

Re: Show HN: I built an AI language teacher to get you speaking

#63
post #8

Super cool and I love that people are putting effort in this space, in 1-3 years language teachers might be a thing of the past. I just tried this out (have tried some others as well) but currently the voice to text is just too finicky. My Spanish pronunciation is quite good, not great, but often the input just got completely messed up beyond recognition.

Thanks. Is it better with multilingual speech recognition turned off? If you give me the convo uuid I can have a look, too.

Hopefully language teachers won't be gone, but it definitely will change the industry. It's a bit like the music industry maybe? People don't buy CDs, but they go to concerts. Language teachers for their part might have better students, eager to talk and for human contact.

Re: Show HN: I built an AI language teacher to get you speaking

#64
post #31

I spoke "Mi Chiamo Chris" and it heard "Mi Kiamo Chris", then proceeded to tell me to spell it with a 'C' not a 'K'.. ok then.

Thank you for the feedback.

How do you feel about your accent? Did you try with multilingual speech recognition off?

Re: Show HN: I built an AI language teacher to get you speaking

#65
post #3

This is really cool. I like it. I think a few simple things would be: -- a toggle to ensure that what you get back is automatically translated to english, and the translation is easier to read. In fact, making sure you can always see translations right away would help, even for suggestions. -- Much simpler conversations to begin with, my Spanish is basically non-existent from when I took it in school, and the teacher…

@gorpomon and @jjkeddo199 Great talking points! I thought about this a lot, but still don't have a good answer: how easy should it be to translate?

- If you make it too easy, like jjkeddo199 pointed out you don't learn. e.g. it's much more useful to watch a movie and understand say 60-70% of it than to have your work cutout for you and understand everything with subtitles.

- But this also depends on the current level you're at… And getting the difficulty just right is what gets people to feel good, learn and be "in the zone" (FLOW)! Such a good feeling!

- It's more beneficial to use THE FEW WORDS ONE KNOWS than to spread oneself too thin, seeing too many words and reading too much translated text. Time spent 100% in the language is super valuable. Story time: when I first lived in Hungary I talked like a 2-year old, but became fluent (in the sense of fast, no need to think) on ultra-limited topics in two months. This created a solid basis I was later able to build on. It's a method that works.

- At times, only translations will make a meaning crystal clear.

But I may also be at a bit of a disconnect. I learn languages by just pushing through, but not everyone has the same learning style (my wife is much more organized and does just as well.)

Sorry if this turned into a ramble…

Anyway… Would love to know what people's experience and feelings are with the whole shebang of translation.

Re: Show HN: I built an AI language teacher to get you speaking

#66
post #3

This is really cool. I like it. I think a few simple things would be: -- a toggle to ensure that what you get back is automatically translated to english, and the translation is easier to read. In fact, making sure you can always see translations right away would help, even for suggestions. -- Much simpler conversations to begin with, my Spanish is basically non-existent from when I took it in school, and the teacher…

Getting English translation is a good idea, but it should be "hold down 5 seconds" to reveal -- Allowing it to be shown instantly might actually slow language learning. Users should be allowed to struggle a few seconds first (struggle === learning) before translating. Alternatively, it might be nice to be able to translate only individual words. If I understood 60% , inferred 35%, and was clueless about 5% of a forei…

Hey, thanks! :)

Will add Japanese and Chinese momentarily.

Which variation of Arabic would you want to learn?

You make a good point. I might need to hire a salesperson or do a business deal for this.

Re: Show HN: I built an AI language teacher to get you speaking

#67

Greetings! I really like your idea. I have been building a similar open source/non-commercial tool. I am essentially trying to build a solution to get me ready for a standardized Korean language exam. The format and UX of Giglish are extremely good, but I think there are a few places where you need to fine tune your prompts, at least for Korean language learning. I also wish there was a drill mode that is less open e…

Hey! Thanks for the feedback!

> I think there are a few places where you need to fine tune your prompts, at least for Korean language learning

Can you expand on this one, please?

> I also wish there was a drill mode that is less open ended

I have something similar to a drill mode in my previous product (to learn English) and people use it 1-3 hours a day. Want to incorporate it into Gliglish, just didn't get around to it yet but you make me realize I shouldn't wait!

Is your project KoalaSRS?

Re: Show HN: I built an AI language teacher to get you speaking

#68
post #25

What are you using for the speech-to-text? One thing that I really liked about Whisper was that I could mix english and Spanish and it would just work.. like "what does "una palabra española" mean?" and it would just work. Doesn't seem to work with this though.

It's Whisper as well and should behave the exact same way. Are you in the same setting (mic, ambient noise)?

Re: Show HN: I built an AI language teacher to get you speaking

#69

Very cool. I've been trying to learn Spanish off and on for years, and this was super easy to try. Love the fact that you can use it without even signing up. I wonder if you could look into partnering with some existing language tools? I might also look into telling schools about it directly, to help speed up the word of mouth.

Thank you! Feels good to hear. Tried to keep it simple, how I like to use sites, not pesky.

Gotta look into language schools, you're right… Someone suggested doing a deal with the Canadian government because everything is bilingual there.

Big life decisions of working on the product vs. working to promote it. Balance is hard

Re: Show HN: I built an AI language teacher to get you speaking

#70

Is there a way to disable or hide the suggested responses? I've been a Duolingo French learner for 11months and I'm adept at reading French aloud or at least well enough to have it recognized by speech to text. However, my response synthesis skill is severely under-developed - I have a difficult time choosing how to respond when spoken to. I can see the suggested responses being useful to someone practicing their pro…

Thank you! I've had a few people request an option to disable suggestions but you're the first to present the use case, which is super useful to me!

I'll add an option to minimize them.

> is text-to-speech on the roadmap?

You mean an option to hide the text, right? Because there's already text-to-speech (with the teacher responding out loud, unless maybe if your phone is on silent.)

Will definitely implement this. People requested it on my previous product and I'm a fool for not having implemented it yet. Text shouldn't get in the way of listening.

> I purposefully got sloppy a few times and Portuguese and Arabic were generated from my speech

I'll add a layer of checks to get rid of this for good :)

Post reply on HN