Viewing profile — carterschonwald

im building my own harness and inference tool chain for much of these reasons. theres so much to do that makes a big difference for users. hoping to get things into shape for early…

ummm, there is no substantive censorship with deep seek aside from first oarty hosting by deepseek for cya. trust me, and the suppression on deepseek hosted deepseek is pretty thin…

exactly. you certainly know more about the brain than i :)

thx for the kind response! at the very least i have tools that let me easily hit better perf for fancy dense memory layouts, and the same tooling lets me experiment with frankly wi…

i definitely will be doing some drop of some faster attention kernels in the next few weeks. like i can do all sorts of memory layout of tensors/matrices etc tricks that if you don…

amusingly ive been working on ultra sparse llm inference/ training/ model design because nature loaths a dense graph/matrix and cause i think it shoukd be possible. i actually stoo…

i think the line is: expressing that you reputationally certify its correct and its worth the time

this mirrors my approx experience.

i've had trouble finding any anecdotes or data about how to actually set/explore logit sampler settings

5.6 sol is pretty good, its definitely very very well tuned, i'm not quite sure which of the others i should use near term, but theyre doing great work

this so true. its really hard to make sure a model isnt going off the rails if i dont see full cot. the fact that oai and anthropic models hide it now has made them less reliable. …

its a wrapper around mlx, so thats gonna be the portability bottleneck

not sure about that, but im actively working on designing ultra sparse models that i want to have perform competitively with stuff 100-10_000 times larger. ehich does yield similar…

one of the most hilarious examples of how the current wh admins false protectionism, in my mind, is the crucible steel bankruptcy in jan/feb 2025. its a technological tragedy becau…

ive had doom loops on release day with opus 4.6. quantization aint the culprit ;)

even before the llm era sites would flag me as a bot for opening 15 links to read later. its fucking infuriating now

this is pretty cool. i think part of the root cause is current rlhf post training design around confidence and optics rather than cooperative transparent honesty. though its kinda …

This paper points at an idea, but its really only legible if you have a more developed version of the idea already. I really should write more

i literally had a co2 sensor for my engineering team last fall cause the space was so poorly ventilated. just measuring it continuously radically changed how everyone approached us…

good. Of course the precise language of the ruling matters, but good.

so the most notoriously patent oriented tech firm is buying this up. lol ;) good for the founders. also explains why my resume got dropped on the floor as a desk reject :p

.... i thought this was more widely known, granted i did write up a pretty wacky doc explaining way more fun experiments than these, and i have a fix that even prevents role collap…

https://github.com/cartazio/oh-punkin-pi/blob/main/scripts/b... use that to install assuming you have whatevers needed to set up. ive a much fancier next gen thing i hope to make a…

“sit with” is way over used lately

“worth sitting with ” is in the way to overused scale :(