Live data from Hacker News

Learning to Reason with LLMs

openai.com

701–710 of 1001 posts

Re: Learning to Reason with LLMs

#701

Student here. Can someone give me one reason why I should continue in software engineering that isn't denial and hopium?

To fix the robots^W^W^Wbuild these things.

I've been around for multiple decades. Nothing this interesting has happened since at least 1981, when I first got my hands on a TRS-80. I dropped out of college to work on games, but these days I would drop out of college to work on ML.

Re: Learning to Reason with LLMs

#702

Why so much hate? They're doing their best. This is the state of progress in the field so far. The best minds are racing to innovate. The benchmarks are impressive nonetheless. Give them a break. At the end of the day, they built the chatbot who's saving your ass each day ever since.

Haven't used ChatGPT* in over 6 months, not saving my ass at all.

I bet you've still used other models that were inspired by GPT.

Re: Learning to Reason with LLMs

#703
I have a question. The video demos for this all mention that the o1 model is taking it's time to think through the problem before answering. How does this functionally differ from - say - GPT-4 running it's algorithm, waiting five seconds and then revealing the output? That part is not clear to me.

Re: Learning to Reason with LLMs

#704

Student here. Can someone give me one reason why I should continue in software engineering that isn't denial and hopium?

The calculator didn’t eliminate math majors. Excel and accounting software didn’t eliminate accountants and CPAs. These are all just tools. I spend very little of my overall time at work actually coding. It’s a nice treat when I get a day where that’s all I do. From my limited work with Copilot so far, the user still needs to know what they’re doing. I have 0 faith a product owner, without a coding background, can us…

The calculator didn’t eliminate math majors.

We're not dealing with calculators here, are we?

Re: Learning to Reason with LLMs

#705
post #96

2018 - gpt1 2019 - gpt2 2020 - gpt3 2022 - gpt3.5 2023 - gpt4 2023 - gpt4-turbo 2024 - gpt-4o 2024 - o1 Did OpenAI hire Google's product marketing team in recent years?

1998 - Half-Life

1999 - Half-Life: Opposing Force

2001 - Half-Life: Blue Shift

2001 - Half-Life: Decay

2004 - Half-Life: Source

2004 - Half-Life 2

2004 - Half-Life 2: Deathmatch

2005 - Half-Life 2: Lost Coast

2006 - Half-Life Deathmatch: Source

2006 - Half-Life 2: Episode One

2007 - Half-Life 2: Episode Two

2020 - Half-Life: Alyx

Re: Learning to Reason with LLMs

#706

This is incredible. In April I used the standard GPT-4 model via ChatGPT to help me reverse engineer the binary bluetooth protocol used by my kitchen fan to integrate it into Home Assistant. It was helpful in a rubber duck way, but could not determine the pattern used to transmit the remaining runtime of the fan in a certain mode. Initial prompt here [0] I pasted the same prompt into o1-preview and o1-mini and both c…

Wow, that is impressive! How were you able to use o1-preview? I pay for ChatGPT, but on chatgpt.com in the model selector I only see 4o, 4o-mini, and 4. Is o1 in that list for you, or is it somewhere else?

it's in my MacOS app, but not in the browser fir the same account

Re: Learning to Reason with LLMs

#707
post #87

Reading through the Chain of Thought for the provided Cipher example (go to the example, click "Show Chain of Thought") is kind of crazy...it literally spells out every thinking step that someone would go through mentally in their head to figure out the cipher (even useless ones like "Hmm"!). It really seems like slowing down and writing down the logic it's using and reasoning over that makes it better at logic, simi…

which makes it even funnier when the Chain is just... wrong https://x.com/colin_fraser/status/1834336440819614036

Re: Learning to Reason with LLMs

#708
post #566

This is incredible. In April I used the standard GPT-4 model via ChatGPT to help me reverse engineer the binary bluetooth protocol used by my kitchen fan to integrate it into Home Assistant. It was helpful in a rubber duck way, but could not determine the pattern used to transmit the remaining runtime of the fan in a certain mode. Initial prompt here [0] I pasted the same prompt into o1-preview and o1-mini and both c…

> Asking the models to determine if my code is equivalent to what they reverse engineered resulted in a nuanced and thorough examination, and eventual conclusion that it is equivalent. Did you actually implement to see if it works out of the box ? Also if you are a free users or accepted that your chats should be used for training then maybe o1 is was just trained on your previous chat and so now knows how to reason…

That's not how LLM training works.

Re: Learning to Reason with LLMs

#709

I had trouble in the past to make any model give me accurate unix epochs for specific dates. I just went to GPT-4o (via DDG) and asked three questions: 1. Please give me the unix epoch for September 1, 2020 at 1:00 GMT. > 1598913600 2. Please give me the unix epoch for September 1, 2020 at 1:00 GMT. Before reaching the conclusion of the answer, please output the entire chain of thought, your reasoning, and the maths…

When I give it that same prompt, it writes a python program and then executes it to find the answer: https://chatgpt.com/share/66e35a15-602c-8011-a2cb-0a83be35b8...

Re: Learning to Reason with LLMs

#710

Some practical notes from digging around in their documentation: In order to get access to this, you need to be on their tier 5 level, which requires $1,000 total paid and 30+ days since first successful payment. Pricing is $15.00 / 1M input tokens and $60.00 / 1M output tokens. Context window is 128k token, max output is 32,768 tokens. There is also a mini version with double the maximum output tokens (65,536 tokens…

Unless this is specifically relating to API access, I don’t think it’s correct. I’ve been paying for ChatGPT via the App Store IAP for around a year or less, and I’ve already got both o1-preview and o1-mini available in-app.

Yes, I was referring to API access specifically. Nothing in the blog post or the documentation mentions access to these new models on ChatGPT, and even as a paid user I’m not seeing them on there (Edit: I am seeing it now in the app). But looks like a bunch of other people in this discussion do have it on ChatGPT, so that’s exciting to hear.
Post reply on HN