compute in memory
Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
41–50 of 177 posts
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#42We've all pretty much forgotten about AR/VR But Apple's going to be launching their headset next month
It seems rather controversial within Apple itself: https://www.macrumors.com/2023/03/26/apple-employees-concern...
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#43One of the questions I've been asking is we've basically had physical servers -> VM -> cloud -> container orchestration on about a decade long cadence. So what's next--especially considering you can argue a lot of the low-level architectural things haven't really changed during that period. But, then, perhaps architectural details don't matter a lot at this point relative to things like AI/ML. Even WASM is mostly in…
Physical servers (or devices) are next, obviously! IT is cyclical.
Speaking of cyclical IT, my estimate is going “forward” to the terminal/mainframe-esque concept of simple and cheap “terminals” aka laptops that you use to log into a much beefier “mainframe” aka cloud workstation.
I’m at a FAANGMULA and I’ve been using a cloud workstation from my cheap laptop as my daily driver for months now. The VM is so much higher-spec’d than what they would have bought me for a desktop. Just don’t look at the price if you plan to run it 24/7…
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#44Earlier quoted context omitted.
What is new in display panels?
Extreme panel curvature, new panel sizes, software baked into the display, technologies like quantum dot reaching near-oled quality at a fraction of the price.
With rapid progress in AR/VR, traditional display tech improvements are like horse technology advances in 1900.
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#45Earlier quoted context omitted.
Are WebGPU "libraries" at a point where instead of being recommended Python + PyTorch for neural network training (then exporting the model to ONNX and turning around and loading it and using it)? If not, how far? I've had trouble understanding why the PyTorch "GPU" (CUDA, MPS, etc.) code can't convert to WASM + WebGPU. Something has to be missing/it has to be a huge effort, but in theory you're supposed to be able t…
Yes, it's definitely lagging the CUDA ecosystem. I did a write-up a few weeks back on the various approaches people are taking to do inference in the browser (WASM, WebGL, WebGPU): https://digest.browsertech.com/archive/browsertech-digest-th... Matt Rickard also had a short write-up recently: https://matt-rickard.com/implementing-llms-in-the-browser My take is that we probably won't see much training done on WebGPU,…
> But for inference and run-time computations, it could be very interesting to take a model trained with CUDA/PyTorch and export it (maybe with Apache TVM or tensorflow.js) into WebGPU that can run on end-user devices.
In its current state, can you train on PyTorch, export to ONNX, load ONNX in JavaScript/WASM, then use it for WebGPU inference?
I'm not trying to sound obsessed/married to ONNX, I just though it was "the standard". Curious to learn alternatives/what people are doing now but I fear even talking about what might being done is discussing "bleeding edge".
Edit: A quick Google shows yes https://onnxruntime.ai/docs/tutorials/web/
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#46One of the questions I've been asking is we've basically had physical servers -> VM -> cloud -> container orchestration on about a decade long cadence. So what's next--especially considering you can argue a lot of the low-level architectural things haven't really changed during that period. But, then, perhaps architectural details don't matter a lot at this point relative to things like AI/ML. Even WASM is mostly in…
Physical servers (or devices) are next, obviously! IT is cyclical.
They already are: with these on-prem versions of the common public clouds.
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#47Mars Sample Return going through PDR.
Intrinsic AI making a product announcement in two weeks.
Deepmind collaborating with Robotis implementing deep RL on the robocup humanoids to play soccer at the next level.
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#48Micro-LED, maybe. Apple is working on using it on the Apple Watch, and if that pans out, likely on larger devices.
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#49Something I'm personally excited about: colour e-ink displays. There are a few decent colour e-ink tablets on the market already, for surprisingly low prices ($400-500). So far the colour reproduction and refresh rate is still somewhat suboptimal, but development appears to be progressing rapidly. I predict that in a few years there will be little reason to get a conventional tablet over an e-ink one, at least for th…
> There are a few decent colour e-ink tablets on the market already, for surprisingly low prices ($400-500).
Which ones are you referring to? Are they complete and ready to ship products? Or is that a DIY project / kickstarter?
Re: Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
#50Commodity RISCV chips. Some of these have just entered mass production, such as the CH32V003 (10 cents each in 1k quantities).
https://github.com/cnlohr/ch32v003fun
Fully open source stack!
Grab the below eval board and peck around: https://www.aliexpress.com/item/1005005269690018.html
Also see here for awesome writeup on the BL602 chip using the Nuttx RTOS: https://lupyuen.github.io/articles/nuttx