Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How to leverage Claude's capabilities with interactive visualization

github.com

Post reply on HN
Print view View original

31–36 of 36 posts

Re: How to leverage Claude's capabilities with interactive visualization

#31

Post by zurfer »

fblp wrote: post #30
zurfer wrote: post #8

Well done. We are building something similar [1] and found that generating UIs (mostly charts) on the fly works surprisingly well in most cases, but can be a bit frustrating if you know exactly what you want and just can't prompt it (as a user) to do that because of some edge case. While this is a cool demo that shows what LLMs can do I am a bit surprised how polished and advanced it looks (even PDF upload) for a qui…

Are there any other services out there like getdot.ai that help do analysis?

There are a bunch that I put into this list: https://github.com/Snowboard-Software/awesome-ai-analytics ( probably missing a similar amount since many people try)

I would be curious to understand why you are looking for an alternative?

Re: How to leverage Claude's capabilities with interactive visualization

#32

Post by fragmede »

Larrikin wrote: post #23
fragmede wrote: post #13

Earlier quoted context omitted.

Opportunity cost. Anthropic's deal is in training Claude and whatever they choose to call their next model, not whatever weird little niche you're going after. I might not go after programming, but, say, a dnd character backstory generator would be a wrapper that's probably not interesting enough for them to build themselves to compete with yours. Or maybe it is, but your DND character backstory generator also doesn'…

But is there any reason to use them besides a demo to investors while you actually build the business on llama? Why build a business with a permanent subscription that's the entire core to your business?

because for this hypothetical niche, Claude is better than llama. now whether or not that's actually true, I don't know, but while it would be nice to sell shovels in a gold rush, not everyone has the privilege of being able to do that. In this metaphor, some people only know how to mine for gold, and pivoting to selling shoves is an entirely different skillset that the miner doesn't posess.

Re: How to leverage Claude's capabilities with interactive visualization

#33

Post by SparkyMcUnicorn »

cj wrote: post #20
SparkyMcUnicorn wrote: post #6

Earlier quoted context omitted.

Anthropic and OpenAI let you define a JSON schema to adhere to for tool calling. Here's the part you're looking for: https://github.com/anthropics/anthropic-quickstarts/blob/mai...

For some reason, the guarantee in the format of the response doesn't seem sufficient in preventing backwards incompatible changes that may happen to models. Yes, the response might be in a standard format. But a well formed response can still be bad/broken. Another way to think about it, is it can "pass QA" one day, and "fail QA" the next day even if the API response is identically formatted/structured.

This is why OpenAI and Anthropic provide date versioned models.

gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.

Re: How to leverage Claude's capabilities with interactive visualization

#34

Post by cj »

SparkyMcUnicorn wrote: post #33
cj wrote: post #20

Earlier quoted context omitted.

For some reason, the guarantee in the format of the response doesn't seem sufficient in preventing backwards incompatible changes that may happen to models. Yes, the response might be in a standard format. But a well formed response can still be bad/broken. Another way to think about it, is it can "pass QA" one day, and "fail QA" the next day even if the API response is identically formatted/structured.

This is why OpenAI and Anthropic provide date versioned models. gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.

i have a feeling those dates are an illusion of sorts.

I get the feeling they frequently deploy hot patches for edge cases. I hate to call them edge cases because they are actually “real cases” - things like adjusting system prompts so one day it might happy answer “Fill in the blank: F _ _ _ you”.

To truly freeze a model, you would need to freeze its weights, freeze its system prompts (no one sees those), and avoid any and all action that might impact its output. Perhaps would even need the default temperature to be 0 so it’s truly a deterministic API, with the option to add in some temperature to the responses.

Until then, I consider those “versions” but only reference the model weights and not the abstractions around the model

Re: How to leverage Claude's capabilities with interactive visualization

#35

Post by felixvolny »

SparkyMcUnicorn wrote: post #33
cj wrote: post #20

Earlier quoted context omitted.

For some reason, the guarantee in the format of the response doesn't seem sufficient in preventing backwards incompatible changes that may happen to models. Yes, the response might be in a standard format. But a well formed response can still be bad/broken. Another way to think about it, is it can "pass QA" one day, and "fail QA" the next day even if the API response is identically formatted/structured.

This is why OpenAI and Anthropic provide date versioned models. gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.

Tangent, but it seems like such a tough engineering challenge to keep all these models around and available at an instant

Re: How to leverage Claude's capabilities with interactive visualization

#36

Post by rerdavies »

Kind of fun. I recently used Claude to generate scripts for Gnu Plot, with only slightly less convenience than this. It's kind of spooky what you can ask claude to do. e.g. "Rotate the x-ais labels by 90%; use "Arial Black" for the title, and "Roboto" for the rest of the fonts". Etc.
Post reply on HN