Viewing profile — pulse7

Hasn't Docker always been just a thin layer of duct tape over existing solutions?

You cannot wear out an SSD through AI inference alone. LLM weights are only read from the SSD, and read operations do not contribute to SSD wear. SSD wear is primarily caused by wr…

Those are routers - not general purpose computers.

On the absolute limit of ethics? This is simply not ethical anymore...

The same here! Merged several repos into monorepo are retained full history!

Most probably not optimized yet for this model...

With electron-beam lithography you can build transistors with gate lengths down to 1 to 3 nanometers.

exactly: high demand!

NVidia Spark is much slower (low memory bandwidth)!

Can you please share you llama.cpp server parameters to turn on modern LLM sampling stack? Docs [1] say that the top_n_sigma is already in the default sampler list: "(default: pena…

This https://en.wikipedia.org/wiki/Elon_Musk%27s_Tesla_Roadster ?

I'm sorry your dad didn't respect your IT work...

So it's similar to "Andy and Bill's Law" [1]: "What Intel giveth, Microsoft taketh away". If Windows would stay the same (and not grow) it would be much faster on newer CPUs... [1]…

It looks like the president - which was a businessman - will make a huge damage to American IT businesses. And IT stocks dominate the S&P 500, comprising roughly 1/3 of the index's…

Source?

Maybe they can stack LLM parameters in 200 layers like 3D NAND flash and make the chip very small ...

IBM was founded in 1911 and it survived many things...

...and there would be dozen equally capable open-weight models which could be run locally at almost no cost... poor AI investors in this case..

Nvidia is the ultimate beneficiary of the money invested (due to expensive GPUs). If Nvidia loses these good customers, it will have less revenue. So it prefers to slowly buy it's …

GGUF when?

I'm very happy that "AGI office workers" will use Microsoft products - so I don't have to do it anymore... But: they will not pay a dime for the licenses...

You can put camera in transparent Faraday cage. With camera and gyro one can do basic positioning...

"Then java did it too." Java had green threads in 1.0. They were removed. Then Java added virtual threads.

The difference between LLM and a very junior programmer: junior programmer will learn and change, LLM won't change! The more instructions you put in the prompt, the more will be fo…