Viewing profile — bashfulpup

Other guy said it right. These work and are fine but you lose the legacy stuff. If you know your limits and where the eventual system will end up it's great and probably better. If…

Eh, can you really though? Let's be real if OAI is losing money on a 200$ subscription with hyper advanced effeciency methods are you really going to save money? You should also en…

This space is honestly a mess. I did an in depth survey around 1.5 yrs ago and my eventual conclusion was just to build with airflow. You either get simplicity with the caveate tha…

Very typical SV argument that R&D is "complex" and everything else is "simple". Would it blow your mind if I told you 10yrs ago that we'd have AI that can do math/code better than …

Anything we humans deem private in nature from other humans.

The entire reason bots are so agressive is because they are cheap to run. If a GPU was required per scrape then >90% simply couldn't afford it at scale.

We degrade, and I think we are far more valuable than one model.

Also possible and a fair point. My point is that it's a "tiny" solution that we can scale. I could revise that by saying a kid with a whiteboard. It's an einstein×10 moment so who …

He's right but at the same time wrong. Current AI methods are essentially scaled up methods that we learned decades ago. These long horizon (agi) problems have been there since the…

Long explanation. Simple terms, you can't use a fixed box to solve an unbounded problem space. If your problem fits within the box it works, if it doesn't, you need CL. I tried to …

In context learning, learning via training. Both are things we barely understand the mechanism of. RAG is a basically a perfect example to understand the limits of in context learn…

Continual Learning, it's a barrier that's been there from the very start and we've never had a solution to it. There are no solutions even at the small scale. We fundamentally don'…

That implies learning. Solve continual learning and you have agi. Wouldn't it amaze you if you learned 10 years ago that we would have AI that could do math and code better than 99…

Clear your history often. My youtube is actually incredible, massive variety and useful topics. I clear it about once every 2 weeks or month depending on how many of the same topic…

Long horizon problems are a completely unsolved problem in AI. See the GAIA benchmark. While this surely will be beat soon enough, the point is that we do exponentially longer hori…

Pythia is stupidly easy to use. Then hookup a simple test harness. - this is like a grand total of 3 commands - git pull, install, point and run a model

I love this, do tell the direction to be nudged in. I wish to experience this new level of understanding.

There is little to no research that shows modern AI can perform even the most simple long-running task without training data on that exact problem. To my knowledge, there is no cur…

Again, that's why I said it is challenging. I regularly do fine tuning on a model with fine results and little damage to the base functionality. It is possible, but it's too comple…

This is true if you don't know what you're doing, so it is good advice for the vast majority. Fine tuning is just training. You can completely change the model if you want make lea…

A CL agent is next generation AI. When CL is properly implemented in an LLM agent format, most of these systems vanish.

Already a big thing. See the constellation architecture used here: https://arxiv.org/html/2403.13313v1

I looked at the website and have no idea how Arc is supposed to be AGI. Can someone explain?

The biggest issue the author does not seem aware of is how much compute is required for this. This article is the equivalent of saying that a monkey given time will write Shakespea…