Viewing profile — macwhisperer

I feel like all the ppl complaining itt don't even run open weight models.. wahh billionaire bad is true, but you are missing the forrest for the trees.. they are literally bending…

[dead]

yeah you realize you can turn reasoning off on the newer the models right? also try my version of Gemma-12b https://huggingface.co/macwhisperer/Gemma4-12B-SuperDense or try my qwen…

its a simple moon tracker lol...

Basically, he proved that *information is power.* If you don't know which way to go (the subgradient), you're gonna be calculating forever!

also for those with only 16gb-- try this model https://huggingface.co/macwhisperer/Gemma4-12B-SuperDense its exceptional!

hi guys... I run specialized quants on my 24gb air.. (I specialize in 3-bit quants that punch above their weight).. try out my version of 3.6-27b I think you be impressed https://h…

qwen3 1.7b- q4_k_m is your best best for that size

literally ask cloud ai like the free gemini or chatgpt.. they could make you an expert on the subject overnight..

I code with like a slew of 20+ custom baked models of all sizes, in various fully custom multi-model harnesses that use different bindings... the harnesses themselves are just as i…

ai is like the first technology with a conversational service manual inside it.. you should be foaming at the mouth to use claude or codex to make a custom harness, just for your o…

super inspiring! thanks for sharing!

retro-inspired fully custom, swiss army knife style notepad -- https://convert.neocities.org

check out a custom 4-bit quant I made today https://huggingface.co/macwhisperer/Gemma4-12B-SuperDense should run perfect for 12-16gb with maybe 10-20k context seems intelligent eno…

the HITL (human in the loop) is basically the single point...AI is a mirror.. it only "exists" when you talk to it.. much like your reflection in the mirror is only there when you'…

this is cool thanks for making it!

cool! what stack are you using for the multiplayer?

can't we just freaking share things? ai models are a crystallization of human effort (available for free on huggingface).. why not use it? AI is like the UBI of intelligence, stop …

this is really cool congrats!

good, the point is that now you have free mental bandwidth to use on building something that truly interests you using AI to help actualize your goal. build something cool for your…

[dead]

at this point I trust software companies less and less.. being able to build the stack and create bespoke solutions with llms's is incredible.. idk why people get mad about vibe-co…

I run the latest 20b-30b models on a MacBook Air... running inference with an MoE (25 tps) for like 2 hours is like 10% battery.. (look me up on huggingface to download my models) …

ai is exciting because it shows us what really matters...

can you add in the other quants like IQ3_M? also my personal simple rule of thumb for local ai sizing is: max model size (GB) = ram (GB) / 1.65