Live data from Hacker News

Frontier AI has broken the open CTF format

kabir.au

481–490 of 502 posts

Re: Frontier AI has broken the open CTF format

#481

Earlier quoted context omitted.

> except Khan Academy But that's not using "computers" as a computer but as a video player. When evaluating whether computers are "good for learning", I don't think we should include using a computer as a video player, a book, or even flash cards. It should be things a computers uniquely offer which a books, paper, videos and a physical reference library cannot. Based on the results of deploying hundreds of millions…

I think videos are a unique thing computers offer. Books I understand. You have them digital or not. But a video ? Without a computer, there is no video. You were present for the initial lecture or you weren't and that's it.

> Without a computer, there is no video.

There's nothing about video that uniquely requires computers. Maybe you meant "streaming video"?

I realize you're probably under 30 and don't remember "ye olden times" but nearly 90% of U.S. homes and every school had an analog VCR long before they had a computer. Widespread consumer video formats included VHS, DVD, Blu-Ray, Laserdisc, etc. I still buy some movies I care about on UHD discs and watch them in a dedicated Blu-ray/UHD player. Even the 'smart' TVs and streaming sticks most people watch streaming channels like Netflix on aren't functionally computers (no meaningful user accessible local storage, input like keyboard/mouse, CLI or windowing GUI).

Personally, I learned an enormous amount from video before I ever touched a computer. In elementary school we learned from 16mm films almost weekly and watched space launches and Carl Sagan's Cosmos series on TV (it was rebroadcast in the mornings specifically for schools). My junior high had a television in every classroom and some classes were planned around shows on PBS, NASA channel, C-SPAN and BBC. In the late 80s there was thousands of hours of educational video programming sent via direct broadcast satellite to 18-inch dishes at schools. In the 90s every grade and subject had hundreds of interactive video DVDs in large notebooks (four discs to a page in plastic sleeves) and multiple DVD players per classroom.

The peak installed base of VCRs in the U.S. was in 1999. Streaming video wasn't common in consumer households until well into the 2000s, YouTube didn't even exist until 2005 and most people had never heard of it until 2007. In 2010 Netflix mailed DVDs in envelopes to 25M homes every week. They didn't even offer a streaming plan until 2011.

As someone who's spent most of my adult life thinking about video technology, with patents ranging from analog days to the streaming tech you use today, computers have been extremely disappointing in terms of enabling any unique "learning from video" features that are computer-specific. In the 90s we realized that computers could make digitized video random access letting us sequence it non-linearly to make it interactive in response to user input. We knew that computer-enabled interactivity, responsiveness and real-time adaptation to learner progress would be incredible for improving video education. Yet the vast majority video content available online today is still linear in form. Even video that's specifically educational is no more interactive or user responsive than a 90s DVD disc.

Sadly, only two things have really changed about consumer video in the last 30 years: quantity and distribution. There's much more video content and it's remotely accessible on-demand instead of being limited by broadcast channels and storage media. But that's far more about communication technologies like broadband than computer technologies. For a few years YouTube even had authoring features like interactive menus and conditional branching but removed them because it didn't increase ad revenue. There are a few dedicated video authoring platforms for education which can apply uniquely 'computer things' to video like dynamic scripting, conditional branching, viewer annotation and timecode-linked threaded Q&A. Unfortunately, such content is rarely found outside high-end corporate training and some university courses. But there are so many other ways we could combine the strengths of advanced wikis with interactive video. Today, the most the public sees is just an HTML link from a wiki to a video clip. Almost none of the learning features computing could uniquely bring to video are widely available to learners. Since ~90% of everyone already had access to linear video playback before they had access to a computer and most online video today is still primarily linear, in my opinion, there's still virtually no uniquely 'computer-enabled video' involved in learning. Computers haven't enabled much that's new in video - just much more, much cheaper and more convenient forms of what we could already do without a computer.

Re: Frontier AI has broken the open CTF format

#482

Earlier quoted context omitted.

I wrote the "function to reverse a string" in a job interview once. Then the interviewer reminded me that strrev() had been part of the standard C library since K&R. I'd been programming in C(++) for ~15 years by then and had never had the occasion to reverse a string. I still wonder whether that makes it a good job interview question, or a terrible one. Some of both probably.

It’s a good one, if you can still write functionally and same algorithmic complexity then it should not matter if you know strrev or not.

Except that an extremely complex algorithm involving large data tables is required for Unicode or other modern text encodings.

Re: Frontier AI has broken the open CTF format

#483

Earlier quoted context omitted.

There's no need to put your data on the call stack.

Great. Please explain how the size of a call stack frame is determined and how exceeding the base allocation is handled on the particular platform you're proposing to recurse upon.

I feel like you have not responded to my comment.

Re: Frontier AI has broken the open CTF format

#484

Earlier quoted context omitted.

strrev is not a standard C function. I actually don't think my computer even has it (it's a Mac).

Well I don't feel so bad for not having known it then. Thanks!

Yeah I didn’t know about it until you mentioned it either

Re: Frontier AI has broken the open CTF format

#485

Earlier quoted context omitted.

This page has 5 abbreviations that are not spelled out before you even get to the body of the article.

You meant 5 acronyms, and each are links, which contains their abbreviations. So they do follow the guideline.

An acronym is an abbreviation, and they specifically do not spell out the very first acronym on the page the first time they use it.

Re: Frontier AI has broken the open CTF format

#486

AI-generated phishing is the scariest development in cybersecurity right now. Click rates on AI-written phishing emails are 54% compared to 12% for traditional attacks. Automated real-time detection is the only scalable answer at this point

Click rate is higher because AI removes the broken English and generic scams. But detection is not the only answer.

Most phishing comes from a small set of hosting providers that ignore reports. The real fix is making abuse reports actionable. Fix that, and you cripple the economics of phishing. AI detection is reactive; killing the source is proactive.

Re: Frontier AI has broken the open CTF format

#487
post #272
post #213

Earlier quoted context omitted.

> computers do not help human education in the slightest I had no access to anyone who could teach me calculus as a kid except Khan Academy, so I think this is a gross exaggeration. But I agree in the end, that all my "real" learning did come from pen-and-paper practice, not watching videos.

The reality is that a human will learn, given any materials including LLMs, but only if they truly desire to learn. We've had MOOCs, gigantic libraries, all full of free information. You can obtain a PhD level understanding in any technical field of your choice today just by consistently going to the library and consistently applying yourself. It's not unlike going to the gym, and we see how many people do that regul…

> The reality is that a human will learn, given any materials including LLMs, but only if they truly desire to learn. We've had MOOCs, gigantic libraries, all full of free information. You can obtain a PhD level understanding in any technical field of your choice today just by consistently going to the library and consistently applying yourself.

Not true. In every field there is guild knowledge that a person can't acquire from a library. In technical disciplines PhD-level knowledge requires experience in collaboration, research, and frequently lab work, which is impossible to acquire without access to a lab -- or just direct experience with research methods, whatever those may be. Reading papers and absorbing information aren't enough. PhD-level knowledge comes from the process of writing and doing original work.

> The reality is that a human will learn, given any materials including LLMs, but only if they truly desire to learn.

Also not true. We require kids to go to school partly because exposure to the environment and work inculcates skills regardless of whether kids want to do the work -- and regardless of whether they want to learn.

LLMs are damaging to students partly because they provide an escape hatch from that work and thereby prevent kids from acquiring skills.

Think of it this way: most people who want to be healthy and eat a healthy diet still find easy junk food tempting. What they want does not change the temptation, because the body and brain gravitate towards easy, cheap fulfillment of basic drives.

People facing challenging tasks, similarly, are tempted to take measures that reduce the amount of effort they require. The availability of tools that reduce the required effort also help shape a person's understanding of the value of the challenge and the work: "why should I do this hard task when I have a tool that can do it for me?" You and I know the answer to this question when we're discussing something like writing an essay or solving a problem in a math or programming class. Students frequently don't. They are by definition ignorant. Children, moreover, lack maturity. Their brains are less capable of resisting the easy path than an adult's. That's partly why parenting is important: parents provide boundaries and limits that kids need but won't and can't provide for themselves.

Sometimes people, especially kids, really do need to be dragged, kicking and screaming, through something in order to receive the benefits it offers. Being dragged through it sometimes convinces a person of its value and benefits. In a kid's case, there's a decent chance that the experience will improve executive function, shape expectations in a healthy way, inculcate grit, and become appreciation -- or at least habit.

I would not have written essays on my own as a student in secondary school. My English teachers had to provide that structure for me and impose the demand. But LLMs make it much more difficult to impose the demands, and kids are ill protected against the temptations of the cognitive equivalent of junk food, but an order of magnitude worse and more damaging.

Re: Frontier AI has broken the open CTF format

#488

Earlier quoted context omitted.

I think videos are a unique thing computers offer. Books I understand. You have them digital or not. But a video ? Without a computer, there is no video. You were present for the initial lecture or you weren't and that's it.

> Without a computer, there is no video. There's nothing about video that uniquely requires computers. Maybe you meant "streaming video"? I realize you're probably under 30 and don't remember "ye olden times" but nearly 90% of U.S. homes and every school had an analog VCR long before they had a computer. Widespread consumer video formats included VHS, DVD, Blu-Ray, Laserdisc, etc. I still buy some movies I care about…

As a broadcast technology architect I agree with you a whole lot on the broader technology statements.

But as a former lecturer, I also think the promise of interactivity is dependent less on the tools than on the people. Authoring interactive learning materials is difficult and while that interactivity is engaging, it's not necessarily great at getting a density of information out there.

The Socratic method is great, but that level of interactivity presumes in advance that you know what questions the student will be asking, otherwise it's just a dumb gate. Branching stories for interactivity are highly labour intensive. I suppose if you use AI you could generate a massive number of videos to cover branching learning, but that's going to still be an intensive operation, especially if you're supervising that.

Re: Frontier AI has broken the open CTF format

#489
post #458

Earlier quoted context omitted.

I think videos are a unique thing computers offer. Books I understand. You have them digital or not. But a video ? Without a computer, there is no video. You were present for the initial lecture or you weren't and that's it.

There were videos* before computers. *Not really, but you could film stuff and display it.

Film is a chemical medium for storage of images.

Video is an electronic process for capturing images and displaying them.

Before digital video there was analogue video, and analogue video was perfectly possible without digital sampling, or computers. Heck, video pre-dates silicon chips and used to be done with CRTs and valves.

Re: Frontier AI has broken the open CTF format

#490

Earlier quoted context omitted.

I first did fizz buzz about 10 years ago fresh out of college. Now, after 10 years in full stack and fully vibe coding, I forgot basic python syntax. An interview like yours would have false positives if you are checking for syntax because well, its like looking up spelling, I just ask the AI for the syntax inline.

> I forgot basic python syntax If you cannot write "basic syntax" for any language then you are not a programmer, and certainly not a software engineer? This is not a value judgement, it's ok (probably good tbh) to not be a programmer. But you are wasting everyone's time by interviewing for a programming position in this case.

Not true. I can clearly program, have been programming and remembered syntax for about 10 years, and during that 10 years saw the rise and application of tools like IDE and AI improving and accelerating the experience.

As I have been using the AI natural language-as-an-interface coding tools I have gone into the IDE to actually write code a lot less. I read more; and reading is not the same skill as writing. I couldn't remember the syntax as much and by what I mean is some of the simple things like in python to iterate over an object is it an iteritems() or is there a dot between or things like that, and can I do a for index, key in array, and do I need to do like array() to do that. And this is because I always did used to code between languages and alternate fast between javascript, typescript and python and earlier in my career I used to have to remember this (because googling coudl take too long), over time and now I can easily have autocomplete and even AI llm tell me, so I don't remember or waste my energy remembering what the exact syntax is. In my head it's just "I know I need to loop through this, do it in the language Python wants to hear" and why would I bother remembering? so naturally I've forgotten the simple things.

I could clearly, definitely do the programming position, the only ones wasting time IMO are the ones checking if I can remember verbatim things like "spelling" when we all live in a day and age of spellcheck and tools. No one wastes time trying to remember for all words because it's silly. Or maybe encyclopedias and trivia games are the better analogy, sure it's a party trick, but how does it help you do the job better? it arguably does not, and the ones who have not learned to adapt their interviews to the tools are the ones wasting time.

Post reply on HN