Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Olmo 3: Charting a path through the model flow to lead open-source AI

allenai.org

Post reply on HN
Print view View original

91–100 of 135 posts

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#91

Post by alach11 »

nickreese wrote: post #85

I'm just now moving my main workflows off openai over to local models and I'm starting to find that these smaller models main failure mode is that they will accept edgecases with the goal of being helpful. Especially in extraction tasks. This appears as inventing data or rationalizing around clear roadblocks. My biggest hack so far is giving them an out named "edge_case" and telling them it is REALLY helpful if they…

Just curious - are you using Open WebUI or Librechat as a local frontend or are all your workflows just calling the models directly without UI?

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#92

Post by marvinalone »

pardizeri wrote: post #30

Loaded olmo-3-7b-think in LM Studio 0.3.31 I asked: What language were you trained in? Is there a language you prefer for asking questions?" The thinking part: Okay, I need to make this statement true: "all the good guys win" is part of a puzzle. Okay? Return to work. Clever Hans was one of the most famous paradoxes that has ever been posed about the hard problem of consciousness, and your task is to argue for the ex…

Hmm. We think there is something wrong with the LM Studio integration. Thinking traces can be whacky, but not like this. We're looking into it.

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#93

Post by marvinalone »

RagnarD wrote: post #38

Fired it up on LM Studio using my RTX 6000 Pro Max-Q. I'm wondering why it thinks that it was developed by OpenAI. I may be missing it but I don't see any mention that AllenAI is starting with an open OpenAI model. > Tell me about yourself allenai/olmo-3-32b-think Thought for 6.33 seconds I'm an AI language model developed by OpenAI, designed to assist with a wide range of tasks such as answering questions, generatin…

We think there is something you with LM Studio's version of Olmo. We're investigating. Sorry about this.

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#94

Post by taylorb-ai2 »

krzysiek wrote: post #75
dotancohen wrote: post #12

Earlier quoted context omitted.

In the 35 minute since you've posted, maybe the interface has changed. Upon scrolling to the bottom of the answer I got a popup asking "Curious about how this response matches the model's training data? Click this to dig deeper." Clicking it did nothing. When I check the top of the answer I see a speech bubble icon and a downarrow icon. Clicking either opens the thought process. This is on Firefox running on Android.

It didn't change for me (Also on Firefox/Android). I meant at the top of the screen in the menu section. An icon that resembles a piece of paper. On desktop it explicitly says "Show Olmo Trace" and both "piece of paper" icons work.

Hi, I'm one of the devs on the Ai2 Playground! That's an unfortunate consequence of a compromise we had to make for technical reasons. You need to click the "Show OlmoTrace" button below a response to see span highlights. The first time you click it will take a few seconds, but it'll show highlights after it loads! The paper button at the top opens the popup that contains documents for the message you selected by clicking the "Show OlmoTrace" button.

Appreciate you posting about the issues you're having with it! It was difficult to figure out how to show this well and we'll be taking your experience into account.

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#96

Post by logicchains »

Oras wrote: post #95

I got excited by reading the article about releasing the training data, went to their HF account to look at the data (dolma3) and first rows? Text scraped from porn websites! https://huggingface.co/datasets/allenai/dolma3

Erotic fiction is one of the main use cases of such models.

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#97

Post by refulgentis »

embedding-shape wrote: post #63
refulgentis wrote: post #57

Earlier quoted context omitted.

Agreed, in the limit, RAM go up. As billg knows, 128KB definitely wasn't enough for everyone :)

I'm already thinking 96GB might not be enough, and I've only had this GPU for 6 months or so :|

Hehe me too…went all out on a MBP in 2022, did it again in April. Only upgrade I didn’t bother with was topping out at 128 GB of RAM instead of 64. Then, GPT-OSS 120B comes out and quickly makes me very sad I can’t use it locally

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#98

Post by turnsout »

lionkor wrote: post #65
turnsout wrote: post #61

Earlier quoted context omitted.

I agree transparency is great. But making the response inspectable and adjustable is a huge UI/UX challenge. It's good to see people take a stab at it. I hope there's a lot more iteration in this area, because there's still a long way to go.

If I give you tens of billions of dollars, like, wired to your personal bank account, do you think you could figure it out given a decade or two?

Yes! I think that would do it. But is anyone out there is committing tens of billions of dollars to traceable AI?

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#99

Post by turnsout »

comp_raccoon wrote: post #82
turnsout wrote: post #59

I used the Ai2 Playground and Olmo 3 32GB Think, and asked it to recommend a language for a green-field web app based on a list of criteria. It gave me a very good and well-reasoned answer (Go, with Rust as a backup), formatted like a high-quality ChatGPT or Claude response. I then had it show the "OlmoTrace" for its response, which seems like it finds exact matches for text strings in its training data that end up i…

Olmo author here! Your are absolutely spot on on > It was impossible for me to actually fact-check any of the claims in the response based on the matched training data. this is true! the point of OlmoTrace is to show that even the smallest phrases generated by a langue model are a product of its training data. It’s not verification; a search system doing post hoc checks would be much more effective

Thanks for the reply! Olmo is fascinating, and beyond the traceability aspect, I really appreciate that you all are releasing true open source models complete with data, training code and weights.

I was too dismissive in my comment—even if it's going to be a longer journey, the first step is still tremendously valuable. Thank you!

Re: Olmo 3: Charting a path through the model flow to lead open-source AI

#100

Post by zapataband2 »

mentalgear wrote: post #29

This is how the future of "AI" has to look like: Fully-traceable inferences steps, that can be inspected & adjusted if needed. Without this, I don't see how we (the general population) can maintain any control - or even understanding - of these larger and more opaque becoming LLM-based long-inference "AI" systems. Without transparency, Big Tech, autocrats and eventually the "AI" itself (whether "self-aware" or not) w…

[dead]
Post reply on HN