Viewing profile — rdli

I couldn't find a client of any sort for WeatherNext, so I had Claude write a simple one: https://github.com/richarddli/weatherodds .

One thing that wasn't obvious in the post: it's usage (token) based pricing, not including in your existing Claude subscriptions.

[dead]

Cybersecurity/AI seed startup | Founding AI Engineer | Bay Area | Full-time We're seed-staged, 3 people, building an AI for cybersecurity, looking for a founding AI engineer who wa…

I get that but just not entirely obvious how you do that for the Notion AI.

Securing LLMs is just structurally different. The attack space is "the entirety of the human written language" which is effectively infinite. Wrapping your head around this is some…

Nothing super-fancy. We have a common GitHub repo in our org for skills, and everyone checks out the repo into their preferred setup locally. (To clarify, I meant that some enginee…

This is great. At my startup, we have a mix of Codex/CC users so having a common set of skills we can all use for building is exciting. It’s also interesting to see how instead of …

Polar Sky | Bay Area | Full-time | Founding AI Engineer Generative AI is rewriting how organizations use data, and breaking traditional security models in the process. We’re a team…

Polar Sky | Founding AI Lead | Bay Area/Seattle | Hybrid/Onsite | Full-time We're a well-funded, pre-seed cybersecurity startup focused on data security. I'm looking for a founding…

Polar Sky | Founding AI Lead | Bay Area/Seattle | Hybrid/Onsite | Full-time We're a well-funded, pre-seed cybersecurity startup focused on data security. I'm looking for a founding…

Seems that OpenAI is acquiring Io for $6.4B in an all-equity deal.

I would think that that the NVidia Dynamo SDK (pipelines) is a big difference as well ( https://github.com/ai-dynamo/dynamo/tree/main/deploy/sdk/doc... ), or am I missing something…

In this analogy, Dynamo is most definitely not like Django. It includes inference aware routing, KV caching, etc. -- all the stuff you would need to run a modern SOTA inference sta…

This is really interesting. For SOTA inference systems, I've seen two general approaches: * The "stack-centric" approach such as vLLM production stack, AIBrix, etc. These set up an…

The blog post was a little unclear, so my summary was: - They used QwQ to generate training data (with some cleanup using GPT-4o-mini) - The training data was then used to FT Qwen2…

I took a brief look (~5 minutes). My $0.02 is that it's not clear what problem you're trying to solve. I get what some of the features do (e.g., templated prompts) but it would be …