Archival Disc exists, they just don't support bare discs or readers. You have to buy a full Sony ODA Gen 2 system and...
reads the linked comment
notices my own reply
...oh. Nevermind.
So, I'm going to go out on a limb here and say that all of the new formats are not "forthcoming" because of basically two problems that happened at roughly the same time:
- Newer optical media formats became too expensive to implement in consumer devices
- Optical media is inherently user-hostile, almost as much as tape
Ok, first claim first. Back when Blu-Ray first came out, drives were hideously expensive; to the point where the PS3 was basically eating SONY alive because the drive itself cost as much to make as the whole console sold for. Apple outright said they'd never ship a Blu-Ray drive in a Mac because it was too expensive and the patent licensing was a nightmare. Even today Blu-Ray drives are still more than twice as expensive as DVD drives.
But, of course, this isn't the only hurdle, but it did dramatically slow Blu-Ray adoption. The spat between HD-DVD and Blu-Ray almost certainly didn't help either. All of that ultimately meant that people weren't buying Blu-Ray players and putting them in their living rooms; which meant that it didn't make sense to have one in your PC either.
The dirty secret of optical media is that it's remarkably user-hostile as a consumer storage medium. Discs want to be written from beginning to end, and preferably all-at-once with a single table of contents. This makes it very difficult to actually provide a drag-and-drop utility for getting files onto a disc. You can do this, but in most cases this is a hack involving multi-session filesystems that relies on readers knowing how to stitch together the sessions. This is why Windows had that entirely unhelpful "What do you want to do with this disc" dialog for optical media. If you try to use a Blu-Ray disc like a flash drive you will be extremely disappointed in it.
In the days of CDs and DVDs this didn't matter. The consumer benefit was that the discs you were making could go straight into a CD player or DVD player that you already had; the fact that you had to jump through some hoops to do it didn't matter. And if you bought CDs or DVDs you can play them on your computer, too. But far fewer people owned Blu-Ray players, and if they did the player probably also took USB drives. So there would be no reason to ever burn a disc to get a movie onto a player, and getting data onto them was enough of a pain in people's arses that they'd just use USB drives instead.
So with all that taken together, nobody is bothering to scale optical discs for consumers because there really isn't a market for them as a data storage medium anymore. The things that discs still do well - i.e. selling you prerecorded movies - also just so happens to still be fine with topping out at 100GB/disc, even for 4K video. Some games are starting to push beyond what a BD-XL can hold, but those games also are "live service" games that update way too frequently for "getting all the assets on the disc" to make any sense. All the supra-Blu-Ray optical data storage formats are all targeted towards the archival market because it's something that optical just accidentally does very well.