Viewing profile — TheEzEzz

> The "top researchers" in AI are Chinese. And I am skeptical that they even remotely have the philosophical or political alignment you are attempting to project on to them. I assu…

The problem with censorship isn't that it degrades performance. The problem is that if the censorship is unilaterally dictated by a government then it becomes a tool for suppressio…

I wrote my own dynamic keyboard layout to optimize typing speed while procrastinating on my dissertation. 15 years later I'm still using it. My dissertation not so much. Procrastin…

I could easily see this going the other way. Life long single people develop strong social networks that they keep investing in into old age. Married (and with children especially!…

You're basically taking the model "off policy" when you bias the decoder, which can definitely make weird things happen.

LeCun is very simply wrong in his argument here. His proof requires that all decoded tokens are conditionally independent, or at least that the chance of a wrong next token is inde…

For example with facial recognition, see this outcome with Rite Aid being banned from using it after a "warning shot" https://techcrunch.com/2023/12/20/rite-aid-facial-recognitio..…

Super cool. When I think about accelerating teams while maintaining quality/culture, I think about the adage "if you want someone to do something, make it easy." Maintaining great …

Good question. Perhaps depends on the type of warning shot. Plenty of media has an anti-tech bend and will publicize warning shots if they see them -- and they do this already with…

I agree -- the risks are bigger, the rewards larger, the variance much higher, and the theories much less mature. But what's striking to me as the biggest difference is the seeming…

A good analogy for AI risk. We'd never visited the Moon before, or any other celestial object. The risk analysis was not "we've never seen life from a foreign celestial object caus…

Supernova are powerful enough that even a star in a different solar system going nova can kill you, if it's a "nearby" system. But I believe there aren't any stars close enough tha…

Super cool, curious to see where you take this! I did some work on GPGPU for agent simulations for an RTS years ago ( https://www.youtube.com/watch?v=P4fKJIrv0J8 ). Doing things li…

I watched this yesterday and got the feeling something big was happening. At one point he says "This is actually a very inconvenient time for me [to be here]." At the end of the se…

I'm sympathetic to your take on how overly grandiose the language is, but I also think you're being too harsh here. The idea that the universe is discrete/computational is a fine i…

My advice is always to jump in and start building! My background is math originally, so I had some of the tools in my tool box, but I'm mostly self-taught in computer science and m…

We're design the stack to be fairly flexible. It's Python/Pytorch under the hood, with the ability to plug and play various off the shelf models. For ASR we support GCP/AssemblyAI/…

Since this is getting a bit of interest, here's one more demo of this https://youtu.be/cvKUa5JpRp4 This demo shows even lower latency, plus the ability to handle very large menus w…

Thanks! It's a lot of fun building with these new models and recent AI approaches.

Lots of work around speculative decoding, optimizing across the ASR->LLM->TTS interfaces, fine-tuning smaller models while maintaining accuracy (lots of investment here), good old …

Good question. Off the shelf TTS systems tend to enunciate every phoneme more like a radio talk show host rather than a regular person, which I find a bit off putting. I've been pl…

100% Python but with a good deal of multiprocessing, speculative decoding, etc. As we move to production we can probably shave another 100ms off by moving over to a compiled system…

It's trained to ignore everything else. That way background conversations are ignored as well (like your kids talking in the back of the car while you order).

Definitely depends on the application, agreed. The more open ended the application the more dependent it is on larger LLMs (and other systems) that don't easily fit on edge. At the…

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo Total end-to-end latency …