Viewing profile — JoshMandel

I identify with this perfectly. (I mean, was able to get by in physics but it never crystallized into intuition for me the way math and CS do.)

Same. Sometimes even repeated nudges don't help. The underlying 3.0 Pro model is great to talk and ideate with, but its inability to deliver within the Gemini CLI harness is ... al…

I think that it's basically fair and I often write simple agents using exactly the technique that you describe. I typically provide a TypeScript interface for the available tools a…

But to be clear, mdoc already accounts for this through its selective disclosure protocol, without the need for a zero knowledge proof technology. When you share an mdoc you are re…

Last week I tried Google's Jules coding agent and saw it requested broad GitHub OAuth permissions --essentially "full access to everything your account can do." When you authorize …

Fair enough! I'll document my progress at https://github.com/jmandel/advent-of-claude/tree/main , though I may not keep up.

My personal challenge last year was to solve everything on my mobile phone, using LLMs (mostly ChatGPT4 with code interpreter; I didn't paste in the problems, but rather described …

I find "higher level" format issues to be of greater concern. These are issues like: is the recipe structured in a way that makes the prep/process flow clear, makes it obvious when…

There's so much good stuff here, and I agree it's an important message for you to get across. I think trying to convey these ideas through a quantitative benchmark result (particul…

I appreciate the response! I can't understand your methods without example prompts or code, so it's hard for me to interpret the data in figure 6. It will be important to document …

>LLMD-8B achieves state of the art responses on PubMedQA over all models Hang on -- while this is a cool result, beating a limited number of models that you chose to include in you…

Server-Sent Events (SSE) with standard gzip compression could be a simpler solution -- or maybe I'm missing something about the websocket + zstd approach. SSE Benefits: Standard HT…

I'm surprised this does so well in benchmarks, given the intuition I'm getting about its behavior from quick testing. I gave it a medium-complexity design problem: Design the types…

We used essentially this technique in the SMART Health Cards specification for vaccine and lab result QRs. https://spec.smarthealth.cards/#encoding-qrs It's well supported by scann…

I'm very pleased this UX includes "can edit any previous conversation turn" functionality, making conversations a tree rather than a list. For me this is one of the highest-impact …

I wish the native ChatGPT app on Android had all the functionality of the web app. I dearly miss the ability to navigate conversations as a tree, going back and editing any prior t…

My experience putting together https://chat.openai.com/g/g-bdnABvG92-reci-pop (transcribes recipes as succinct bullet lists, suitable for scrolling during meal prep) was that the A…

Yes -- the distinction with "function calling" is that you have to play a game of telephone where you describe your target schema in JSON Schema (only, apparently, for OpenAI to tu…

FWIW, I've seen stronger performance from gpt-4-1106-preview when I use `response_format: { type: "json_object" },` (providing a target typescript interface in context), vs the "to…

ChatGPT 4 can not only play, it can design and implement a commitment scheme to make the game more interesting (...as long as you don't peek at the code interpreter output -- that'…

> So... we're actually worse off Careful about inferring causality here. What kind of active person suddenly stops being active? You presumably don't want to be that kind of person…

I just learned about Mackay's lectures on YouTube and am working through the same. Outstanding teacher. I was so sad to see he died shortly after the course was recorded. He has a …

I have read both of these but I did not notice any in-context examples, meaning prompts fed to the model showing it how to call a function and response to a user query, rather than…

Interesting to see this plugin-adjacent functionality landing in the chat API. It seems like there is no way to provide in context examples of calling functions, since they are now…

I find GPT very helpful for trying to understand the rationale behind decisions from a bit outside my field. These are cases that probably don't take any great insight for a practi…