Viewing profile — lloyd-christmas

I read another post oddly similar earlier today that has more explicit data on that authors codebase: https://codepointer.substack.com/p/cutting-llm-token-costs-w... TLDR; ~3-4% sa…

Not the person you asked, but I have a 9700 which has the same VRAM, and running Q6 on it with unquantized kv gives me 50k context. Putting -ctv q8_0 ups that to 70k. I normally ru…

I run qwen 27B:Q4 @ 130k context at 50 t/s on a single R9700, and have a 7900XT that runs mellum 12B:Q8 as its subagent. R9700s do really well at low wattage and underclocking as w…

I thought the same thing when I started using locals, but the reality is that - for a given context depth - the token generation speed doesn't change whether it's 128 or 8000, it j…

I suspect this is it. I'm 40, and the only tech person in my social circle. Many of my friends were all excited about using it for things like basic webdev and home networking. One…

Or write your own custom one with the library that backs it: https://github.com/FluidInference/FluidAudio I did that so that I could record my own inputs and finetune parakeet to m…

When I worked remote, I found I worked more hours than the days I went into the office and spent 40 minutes each day commuting. It's a lot harder to walk away from work when it is …

For me, I still have no idea what the visual of a venn diagram is trying to tell me within the context of SQL. Just having a visual that I can't even understand does nothing to ben…

Employee Resource Group, I assume.

> the sheer amount of screen real-estate and convenience is really unparalleled. Personally, that's my exact complaint. I miss smart phones I could operate with one hand without st…

A few scattered thoughts: Much of this article seems to only apply under the assumption that people didn't have hobbies prior to being a working adult. Most people I know have hobb…

Congrats, that's 3 years in jail†. Enjoy your time! †I am not a lawyer. This is not legal advice.

I'm not sure of any precedent, but the disclaimer isn't just a "don't hold me to it" liability insurance. There are certain certifications required related to various types of prod…

> How many right-of-center professors did you have? Nearly all of them, having majored in Economics.

It's part of the Trump Effect: https://i.imgur.com/17PHH1d.png

> so as you can imagine, a birth certificate isn't enough. it wasn't even enough for me to get a job in a sanctuary city. I had to show a passport. I can't imagine this at all. I'v…

Except if the significant other is part of the business. Family businesses tend to not care much for (or are oblivious to) employees' outside lives, since their work/life is alread…

> seems pretty common to me. > From my experience > the general population. I've already qualified my comment, and both of us were discussing personal experiences. If you'd prefer …

From my experience, this is incredibly uncommon in the northeast. I only know one couple like that in NY, and she has a large enough trust fund that neither one of them really need…

Not OP, but I worked in finance as an trader for more than half a decade. I make more per hour once I switched to software development in NYC. I think people have a strange view of…

It's not a distinct page for me, but instead an accordion section. I had to go to: https://www.facebook.com/ads/preferences And then open Your Information > Your Categories . I ass…

I'm curious what you'd be looking for in time spent. It seems to me that it's just a true or false. I personally did it intermittently while I was gaming on my other monitor. If an…

That's the beauty of having a completely unique Firstname Lastname. The downside is that my entire life is easily accessible on the interwebs. My high school baseball scores from 1…

> Percentages can be deceiving. 51% off what base? Was it 100 people in 1994 and now it is 151? Maybe I'm just too close to the source (my father is an oncologist), but I thought i…