Viewing profile — dunb

Why use --fit on on an M4? My understanding was that given the unified memory, you should push all layers to the GPU with --n-gpu-layers all. Setting --flash-attn on and --no-mmap …

3.6 is the release version for Qwen. This model is a mixture of experts (MoE), so while the total model size is big (35 billion parameters), each forward pass only activates a port…

What is it lacking in your eyes that makes it not true? I find fish’s vi mode more ergonomically complete for things like editing multi-line commands

Are you running with all the --fit options and it’s not working correctly? You could try looking at how many layers are being attempted to offload and manually adjust from there. W…

I'm not sure if it's working right for me on Orion Version 1.0.3 (142), WebKit 624.1.2.19.2. I type my word, hit "Enter," and I still get the hint to press "Enter." It would also p…

Others have already told you the name of the project, but if you happen to be on Arch, I have a PKGBUILD written for PlantStudio. I haven't published it to the AUR since I don't ne…

This isn't rsync, but you can integrate a-Shell[0] with iOS Shortcuts. You would need to make the syncing happen in the script instead of in the background though. I use a Python s…

Location: Alabama, USA Remote: Yes — hybrid and office roles okay Willing to relocate: Yes Technologies: Python, Tensorflow, PyTorch, scikit-learn, OpenCV, seaborn, MLflow, R, LaTe…

I follow a similar but more terse pattern. I prepend them all with a comma, and I have yet to find any collisions. If you're using bash (and I assume posix sh as well), the comma c…

What's the benefit of the container over installing as a tool with uv? It seems like extra work to get it up and running with a GPU, and if you're using a Mac, the container slows …

Is this a real bug? I recently got a MacOS device for the first time, and I have been frustrated that I couldn't get my custom service to work. Just like you, the script writes to …