I'm not sure I understand the distinction you're drawing between UX/UI and graphic design. To me it seems obvious that the concept of a "design system" has been around for a while and has been applied universally in many sub-fields of design.

It doesn't seem super relevant whether or not there is a CSS/JS framework to support a design system — that seems more like an implementation detail.