Viewing profile — kkielhofner

I've used it for hybrid search and it works quite well. Overall I'm really happy to see Typesense mentioned here. A lot of the smaller scale RAG projects, etc you see around would …

> I'm an engineering manager How are you involved in the hiring process? > Our engineers are fucking morons. And this guy was the dumbest of the bunch. Very indicative of a toxic c…

They will. - It's a cornerstone of their brand. - R2 users are at least paying for something (storage). - Their network is massively overbuilt to be able to absorb DDoS attacks. - …

ICC, IPP, QAT, etc are definitely an edge. In AI world they have OpenVINO, Intel Neural Compressor, and a slew of other implementations that typically offer dramatic performance im…

> The US voting machines are just waiting to be hacked, just a matter of when, not if. The US election system is very distributed and fragmented - there is virtually no standardiza…

> Do you mind sharing why you chose SPLADE-esque sparse embeddings? I can provide what I can provide publicly. The first thing we ever do is develop benchmarks given the uniqueness…

> word Wood dominated the embedding values, but these were supposed to go into 2 different categories When faced with a similar challenge we developed a custom tokenizer, pretraine…

> we don't want to hurt performance on other real-world tasks just to do well on MTEB Nice! Fortunately MTEB lets you sort by model parameter size because using 7B parameter LLMs f…

LLMs have nearly completely sucked the oxygen out of the room when it comes to machine learning or "AI". I'm shocked at the number of startups, etc you see trying to do RAG, etc th…

My startup (Atomic Canyon) developed embedding models for the nuclear energy space[0]. Let's just say that if you think off-the-shelf embedding models are going to work well with t…

> they're not a complete replacement for simpler methods like BM25 There are embedding approaches that balance "semantic understanding" with BM25-ish. They're still pretty obscure …

Jensen has said for years that 30% of their R&D spend is on software. Needless to say as they continue to crush it financially this number continues to completely race past AMD. Tu…

Shouldn't be much of a surprise, this made news back in 2018 when the same was realized with soldiers and secret military bases: https://www.theguardian.com/world/2018/jan/28/fitne…

For reference seven trillion dollars is 25% of US GDP. Yeah, that's um, wild.

Living in a climate (Wisconsin) that has extreme highs and lows my understanding is this is typically intended to smooth-out a gas bill (as one example) moving from $10/mo in the s…

As one example take a peek at /r/LocalLLaMA[0] (I suspect you know). These people are snapping up anything and everything they can get their hands on at a reasonable price. To your…

> If you get wasted on anything, or do anything silly, or act weird, someone will pull out a phone and video you. Anecdotally this seems to be the key impact. With social media alm…

> That so many people working in software don’t have deep hardware expertise or are not familiar with data centers plays to that hand. I like to remind myself that AWS is 20 years …

TTL isn't universally respected. Consider the following path: Your machine -> Local router -> Configured upstream DNS Server (ISP/CF/Quad8/etc) -> ? -> Authoritative DNS Server Any…

> Dell/EMC says "Hey, here is drive replacement." We do it, 2 hours later, the volume is knocked offline. Apparently, there was mismatch between backplane version, drive version an…

> Also, anyone in this industry long enough has been around for "Oh, we will just replace that broken piece of hardware" that ended up "WHY IS EVERYTHING ON FIRE?" because versions…

> They negotiate network and power contracts at a scale that exceeds any typical Fortune 500 company. ..and then mark it up. AWS overall has 38% operating margin[0]. Depending on y…

> With a part time person you will see downtime when a machine fails If a hardware failure causes downtime you're doing it wrong. Additionally, big cloud scaring people from hardwa…

It’s a joke from a famous moment in HN history: https://news.ycombinator.com/item?id=9224

> what model can i run on 1TB With 1TB of RAM you can run nearly anything available (405B essentially being the largest ATM). Llama 405B in FP8 precision fits in H100x8 which is 64…