Viewing profile — htsh

curious, how does one configure something like this for AWS Lambda? Appreciate it. I am assuming it is a bunch of manual work.

Is it safe to assume they will come down in 2027?

i much prefer svelte but the rest of the world does not

yes! especially b/c i want to process a lot of email and directories full of old, personal documents

are we sure the RAM market will stop being insane in a year or two or could this be the new norm?

thanks! came in here to ask this. we can do much better with a cheap model on openrouter (glm 4.7, kimi, etc.) than anything that I can run on my lowly 3090 :)

I have been doing this with claude code and openai codex and/or cline. One of the three takes the first pass (usually claude code, sometimes codex), then I will have cline / gemini…

curious, why the 30b MoE over the 32b dense for local coding? I do not know much about the benchmarks but the two coding ones look similar.

A lot of us have ryzen / nvidia combos... hopefully, soon, though.

assuming you want to run entirely in GPU, with 12gb vram, your sweet spot is likely the distill 14b qwen at a 4bit quant. so just run: ollama run deepseek-r1:14b generally, if the …

As a longtime user of nodemailer, thank you. I am gonna check out emailengine for future work.

Dreambooth was kinda great? That said, I agree that I wish there were more done post-research towards products with some of this stuff.

Yes, offloading some layers to the GPU and VRAM should still help. And 11gb isn't bad. If you're on linux or wsl2, I would run oobabooga with --verbose. Load a GGUF, start with a s…

openrouter, fireworks, together. we use openrouter but have had some inconsistency with speed. i hear fireworks is faster, swapping it out soon.

Can one enter their own opeanai URL and api-key? (so we can use openai-compatible things like openrouter or lm-studio)?

That is what the RAG system does. The PDF is chunked and thrown into a vector store. And then when prompted, only the relevant bits are retrieved and stuffed into the context and s…

Cool! Any plans for Svelte?

supabase just added their $599 tier for their soc2/hippa compliant product. really appreciated that.

This subreddit remained open. Unfortunately, however, the oobabooga one went closed for a while and lost a lot of momentum. It is also back, however. Are there good lemmy spaces fo…

I know how that works. And my point was not that they should or will be replaced, but rather that they are no less expendable than developers (not very much). But the decisions the…

Having just left a large enterprise, it certainly feels like executive jobs are replaceable soonest with the AI tech available to us now. Not sure why those of us that live in code…