Hearing Heartbeat in Audio and Video: A Deep Learning Project
1–10 of 14 posts
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#2Just curious on why your username is shown in green on HN homepage?
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#3Just curious on why your username is shown in green on HN homepage?
new user
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#4What is the accuracy of detecting?
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#5Just curious on why your username is shown in green on HN homepage?
New users don't make the front page very often, which is maybe not something to be proud of. You'll see more at https://news.ycombinator.com/newest, and https://news.ycombinator.com/noobstories if you want the motherlode. It looks like one has to be logged in to see green usernames, which I'd forgotten.
In the current case we saw CaHoop's earlier submission of this project, which got killed by an overzealous spam filter, and invited him to repost it.
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#6What is the accuracy of detecting?
From the video they have on youtube, Arnold has over 200bpm and the kid at the end has a 0bpm. That's a pretty useless territory.
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#7The idea is from Eulerian video magnification
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#8What a cool project! I'm working with UCSF cardiology on various projects involving Apple Watch's heart rate sensor, and here are a few applications you might consider for your technology:
1. Atrial fibrillation (you mentioned arrhythmias—this is probably the highest-impact heart arrhythmia since it causes about a quarter of strokes and is frequently undiagnosed)
2. Sleep apnea (if you can also measure oxygen saturation)
3. Heart rate variability for stress reduction or mindfulness.
4. Tracking tachycardias from Adderall usage.
5. Heart failure exacerbations (probably if paired with a scale)
6. (Perhaps) other arrhythmias like supraventricular tachycardia or atrial flutter.
7. Irritable bowel syndrome. Believe it or not, IBS is connected to heart rate variability via the action of the vagus nerve.
There are also all sorts of non-medical, but fun, applications you could pursue. For example, rating which scenes in Game of Thrones get your heart pumping the most:
http://blogs.wsj.com/digits/2015/08/13/what-game-of-thrones-...Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#9What is the accuracy of detecting?
From the video they have on youtube, Arnold has over 200bpm and the kid at the end has a 0bpm. That's a pretty useless territory.
That video was just a mock of our product. If you would like to see the results of the performance of the models, have a look at the slides we made for the project (at the bottom of the post). The best performance we got was about 0.7 r.
Re: Hearing Heartbeat in Audio and Video: A Deep Learning Project
#10That's nice. It doesn't work well enough to be useful yet, but has promise. If this can be made to work, it will be a feature in video chat apps.