Teaching My AI to Sleep: Continual Learning with Llama 3 on a Mac Mini

Looks like a great application of the Titans and Miras paper published by Google research a year ago. You seem to be facing a problem of what to learn during 'sleep'. The paper has a great opinion on determining exactly that mathematically. This gives me an idea too