Live data from Hacker News

QuIP#: 2-bit Quantization for LLMs

cornell-relaxml.github.io

61–62 of 62 posts

Re: QuIP#: 2-bit Quantization for LLMs

#61
post #60

Earlier quoted context omitted.

But the physical space?

3840 × 2160 Total number of pixels = 8,294,400 log2(8,294,400) ≈ 23 (each additional bit doubles the number of unique addresses that can be represented) so 24 bits are the minimum required to locate a point in 2-d space at the resolution of "4k". when you add in color, 60 bits per pixel. 19 bits for 640x480.

Is it possible to think of something as a quarter bit with rgba

Re: QuIP#: 2-bit Quantization for LLMs

#62
post #60

Earlier quoted context omitted.

3840 × 2160 Total number of pixels = 8,294,400 log2(8,294,400) ≈ 23 (each additional bit doubles the number of unique addresses that can be represented) so 24 bits are the minimum required to locate a point in 2-d space at the resolution of "4k". when you add in color, 60 bits per pixel. 19 bits for 640x480.

Is it possible to think of something as a quarter bit with rgba

Can you explain what you mean?
Post reply on HN