Viewing profile — pickettd

Reddit and GitHub are littered with people launching new projects and appear to be way more feature-rich than new tool/app launches from previous years. I think it is a lot harder …

Was the on-device local LLM stack that you tried llama.cpp or something like MLC? I've seen better performance with MLC than llama.cpp in the past - but it has been probably at a l…

I also want to add on that I really appreciate the benchmarks. When I was working with RAG llama.cpp through RN early last year I had pretty acceptable tok/sec results up through 7…

I get what you mean about wanting a visual app to experience yourself and be able to point others too. I recently followed this MLX tutorial for making a small model act well for h…

Looks like MLX quants are released: - 4bit: https://huggingface.co/mlx-community/QwQ-32B-4bit - 6bit: https://huggingface.co/mlx-community/QwQ-32B-6bit

Depends on what benchmarks/reports you trust I guess (and how much hardware you have for local models either in-person or in-cloud). https://aider.chat/docs/leaderboards/ has Deeps…

My gut feeling is that there may be optimization you can do for faster performance (but I could be wrong since I don't know your setup or requirements). In general on a 4090 runnin…

I love the idea of openrouter. I hadn't realized until recently though that you don't necessarily know what quantization a certain provider is running. And of course context size c…

I experimented with both Exo and llama.cpp in RPC-server mode this week. Using an M3 Max and an M1 Ultra in Exo specifically I was able to get around 13 tok/s on DeepSeek 2.5 236B …

The Android apk for MLC is updated frequently with recent models built-in. And a Samsung S24+ can comfortably run 7-8B models at reasonable speeds (10ish tokens/sec). https://llm.m…

As an additional data point - I've read Anathem multiple times and have loved it every time but I read The Book of the New Sun series and really disliked it (though to be fair, I o…

The CapOne 2% business card is called Spark Cash and doesn't have the redemption restrictions that you're describing (I think you may be thinking of their Venture card or another p…

I got a LG G3 (3GB RAM model) earlier this year and it meets those requirements. I've really enjoyed using it so far.

Or somewhere with great solar power potential. For example Kihei on Maui - you can power a whole house with central air and still have enough energy to charge up an EV just with ro…

There is a "Dragon Box" on Amazon that sells for $270ish and appears to be a lower-powered Android Kodi box. I imagine that a second generation Pi could perform just as well.

My first generation Pi was significantly slower at Kodi (things like menu traversal, library updates, API consumption, etc) than a second generation Pi (I tried a friend's). So I w…

As ixnu mentioned - I use the Moonlight Android app ( http://moonlight-stream.com/ ) paired with Geforce Experience running on my Windows box (Geforce GTX 750 Ti video card) for St…

I picked up a $50 Nexus Player (Android TV OS) last month for this purpose. It replaced a first generation Raspberry Pi B that was actually pretty decent as a Kodi box (I used the …

I'm part of a 7-person team at Startup Weekend Maui, an event where we are tasked with starting a business in 54 hours. We really need help with our market research. http://www.tak…

I think there are certain stores that routinely report itemised info. I just posted this link in another comment thread but check out the https://www.visa.com/supplierlocator/ sear…

Yeah, I saw that section on Wikipedia also. But I believe I've found a link indicating that level 3 is being used for consumer purchases in at least some individual stores. If you …

My understanding is that there are three levels of credit card processing (1, 2, and 3 - corresponding to different amounts of information transmitted about the transaction). I've …

So far I've been able to get by in Windows (for my projects at least) if I use Cygwin for interacting with paths that are longer than MAX_PATH. For example - if a project has node_…

Are any of the positions open to US-based remote candidates? Thanks!

I have a full-time, remote, software development job that I started while travelling. It is doable. You may find that it is hard to be motivated to do work when you'd rather be out…