Viewing profile — deazy

[dead]

Sharing my fictional work, with the world. This game has players from every country on earth and their top players, question is who is really wining the game and who is sure to los…

I was exploring this conceptual architecture for neural networks (transformers/attention) based long-context models, its conceptual but grounded in sound existing research and arch…

Basically this is what I think it is, Shared context that can act as independent shards of (mini) contexts, i.e Sub-global attention blocks or "sub-context experts" that can operat…

Gemini's Long Context MoE Architecture (Hypothesized): Sharing how I think (hypothesis) Gemini models achieve their 1-10 Million long context window. With details to clues to suppo…

Great adjacent read. Open Problems in Cooperative AI From Centre for the Governance of AI, Future of Humanity Institute, University of Oxford, DeepMind, University of Waterloo http…

Casual Peer Review: Conceptual leap – could be considered a spark of genius or at least high creativity. Framework serves more as a philosophical guideline or a set of desired emer…

What is the most effective way to make people (humans) come together as a whole and achieve a common goal or defeat a common enemy or solve a common problem. Forging the Collective…

I was hoping for a response, but no one bothered. I had noted the following when I made that comment and will just wrap up from my end so this could be used by others for reference…

Looking at the diceDB code base, I have few questions regarding its design, I'm asking this to understand the project's goals and design rationale. Anyone feel free to help me unde…

In case its not clear its a blueprint to build the thing not the implementation for the actual thing. For example, to see how it works or if it works, you can directly use the post…

Sharing this, hoping someone finds this useful, also would like to hear what others think about this approach. This gist outlines a two-phase approach to generating production-read…