Viewing profile — filterfiber

> still run on a device like the iPhone, which weights about 170g [1]? The human brain is 8 times heavier. Why are you comparing the weight? I'm sorry but this is a bizarre compari…

In their second sentence they have the most honest response I've seen so far at least: " averaged across 4 diverse customer tasks, fine-tunes based on our new model are _slightly_ …

Their timezone has been wrong in the tzdb for at least 10 years apparently https://mm.icann.org/pipermail/tz/2023-December/033339.html

Does anyone know if mmWave could differentiate between my cat and I?

Does anyone know where I should look if I want to detect specific sounds? Like a smoke alarm, food bowl dispenser (its very distinct), cat meowing, 3d printer collision, that sort …

Fun monetization strategy for federated apps - federate with your own instance dedicated to ads. But more seriously what is the monetization strategy for federated apps? Up front p…

Does anyone have any input on how this compares outside of benchmarks? They don't appear to have any info on how they made it.

> Realistically, even with Turbo+LCM, you're still going to 4+ steps (often 8+), with CFG, for reasonable one-generation quality anywhere close to the images people generated at 50…

> since you have stocks of the billion dollar message I have no idea what you mean by this? Are you saying I'm defending apple somehow? Because my point is nearly every phone/lapto…

I don't know why the title even mentions the flipper. The attack can be done from any device that can send crafted BLE packets including laptops/android phones, etc. Apple just fix…

Better title: "Apple fixes BLE DOS attack". I'm tired of media acting like the flipper is some kind of "super special hacking tool", it is very literally getting it banned in some …

I mean, if you need a human in the loop to verify the image quality then you HAVE to pre-compute the images. > 100 images/s is likey too much volume You can always generate less

I was just using that as a reference. Stable diffusion will run well with almost any relatively modern gpu. You don't have to use a 4090, you'll still get double digit performance …

> I found this claiming an A100 can generate 1 image/s. The article you linked is over a year old. Needless to say there have been a LOT of optimizations in the last year. Back the…

> But that's not the point, obviously. If you want to say the zero2-w is what's making it then sure. > Besides, a 4090 costs more than a car. They only cost ~0.70USD for 1 hr. In f…

This project is a fun POC but it's not very practical for that type of application. A 4090 can generate over 100 images a second with turbo+lcm and a few techniques, you can make 2…

> which means even fewer people finetuning those models. Finetunes rarely led to "Top 5 performance" for the small ones. Previously the top 10+ were all 70B, with maybe a few 30B i…

I know the hugging face leaderboard isn't wildly accurate. But the top models right now are almost all under 70B. Most are 7B, and the top is 10B. If the benchmarks are even remote…

The current bottleneck for most current hardware is RAM capacity than memory bandwidth and last is FLOPS/TOPS. The coral has 8 MB of SRAM which uh, won't fit the 2GB+ that nearly a…

AFAIK there's no public sdk for it, only a single third party game is in development and it's by the developers of garry's mod (one of the biggest third party source "1" games). I'…

I don't understand why they're comparing the parameter sizes to lines of code. AFAIK you can just increase the layer parameters of a 1B model to whatever you want? Like, the differ…

FWIW - I need to remeasure but - IIRC my system with a 4090 only uses ~500w (maybe up to 600w) during inference of LLMs, the LLMs have a lot harder time saturating the compute comp…

So this specific model ships with a default config of 2 experts per token. So you need roughly two loaded in memory per token. Roughly the speed and memory of a 13B per token. Only…

> in as little as 16GB of RAM with room to spare. I don't think that's the case, for full speed you still need (5B*8)/2+2~fewB overhead. I think the experts chosen per-token? That …

> Previous State-of-the-Art: [...] The number of parameters in the LSTM layers of these models vary from 2 million to 151 million. > We present model architectures in which a MoE w…