31–40 of 84 posts
People complain that the magic of programming has been lost because all we do is stitch together APIs. They're oversimplying the work done, those people are cynical, this is amazing.
I'm really hoping somebody comes along and puts this in a format that I can attach to my head inconspicuously.
Google Glass has already been rejected by the public; I imagine anything more inconspicuous would arouse even deeper suspicion.
>Matching faces to voices relies on simple co-occurence heuristic, and will not work in certain scenarios (e.g. if the whole conversation between two people is recorded from a single angle) This seems like the really hard part. maybe if there was a way to find the time lips moves for a face. or guess gender and age of both face and voice.. or If the audio is a stereo mix, using relative position
There's this that can differentiate speakers https://github.com/CorentinJ/Real-Time-Voice-Cloning
Earlier quoted context omitted.
Yes it's not the best way to translate, and for some languages it won't make much sense since the word order is different, as in English to Japanese translation. To say nothing of all the myriad nuances of language like context changing word meaning and colloquial meanings of words. In the game Cyberpunk, when doing the inline translations between english and japanese it is actually swapping fully translated sentence…
I really enjoy that aspect of the visuals because it's like a tiny reflection of the kernel of cyberpunk (the genre, not the game). Here you have a technology that would work in a way totally different to the way people assume... But someone put the effort into making it look like it does something else because the skeuomorphic expectations of the human makes that inaccurate representation feel more correct. That gap…
Has our idea of the human/technology interface shifted far enough that the idea of information technology implants will seem a sensible optimization of day to day life? Will skuemorphisms change over time? Maybe the symbol for a neural implant phone call will look like a smartphone (I think it does in Cyberpunk 2077 but I can't recall)
We are also trying to do something similar[0], but still a lot of work remaining. Idea is to allow real time processing of any video using just a CPU. [0] https://www.youtube.com/watch?v=E7UPj9blnWc
Earlier quoted context omitted.
I really enjoy that aspect of the visuals because it's like a tiny reflection of the kernel of cyberpunk (the genre, not the game). Here you have a technology that would work in a way totally different to the way people assume... But someone put the effort into making it look like it does something else because the skeuomorphic expectations of the human makes that inaccurate representation feel more correct. That gap…
Absolutely, and I am perhaps morbidly excited to see what this next generation of technologists come up with, as they have never lived in a world without tech dominating day to day life. Has our idea of the human/technology interface shifted far enough that the idea of information technology implants will seem a sensible optimization of day to day life? Will skuemorphisms change over time? Maybe the symbol for a neur…
I do wonder if they’ll be more amenable to the 2035 version of Google Glass though.
How easy is it to translate word by word like that? I was under the impression that generally it is hard because different languages have different word orders. Is it not necessary to have the whole sentence before starting? (Or maybe Polish is just conveniently similar to English in word order?)
It's sweeping each sentence at a fixed number of milliseconds per character, set so that both languages finish simultaneously. Look at when "Donald Tusk" appears during the first line. Much sooner in English than in Polish, and both are happening before he actually says the name.
The example from the game is doing entire sentences too.
I want to jump in, badly. How would one go about picking up the skills needed to create stuff like this? As pragmatically, concretely and efficiently as possible without getting sidetracked in overly theoretical distractions?
I’m a fullstack engineer and have an MS in CS and pretty good math chops, but I sadly only took 1 machine learning course in all of my formal education.
How do I get into this (gpt-3, chatgpt are also on my mind)? Please, any books, moocs, etc
People complain that the magic of programming has been lost because all we do is stitch together APIs. They're oversimplying the work done, those people are cynical, this is amazing.
I think part of the magic is still lost, as we used to be very open source and free centric. These days it's all based on paid API calls.