No, it’s really doing OK for what it is. A Xeon Bronze 3104 is a 6C6T 1.7 GHz Skylake that gets a 88W tdp and a J5005 is a 2.8 GHz 4C4T Goldmont running in 15W. That is 10.7 core-cycle-units for the Skylake and 11.2 core-cycle-units for the atom. The Skylake is not really all that far ahead - maybe 50% ahead on average in this suite, so the J5005 is running about 2/3 of Skylake IPC. I assume c-ray is probably using AVX there? And the J5005 still does fine.
There is obviously a dearth of actual practical benchmarks of real tasks apart from STH and a few others, but if you look at Passmark or other generic benchmarks, like I said, it’s certainly faster than core2quad enthusiast desktop, which is completely reasonable and even impressive given its power budget. Actually in Passmark it’s even faster than a full Nehalem Core i7 with SMT, it actually works out just a bit under a Sandy Bridge i5 of similar clock - so I was a bit conservative there. And Passmark corroborates my “3104 is about 50% faster” guesstimate.
(UserBenchmark’s actual measurements - not the speed rating - is likely more accurate than Passmark but I know I’ll get my head bitten off for it!)
https://www.servethehome.com/intel-pentium-silver-j5005-benc...
https://www.cpubenchmark.net/compare/Intel-Pentium-Silver-J5...
(Do remember that Intel progress through that era wasn’t really as bad as people say… I’ve seen people say “5% a generation” and the only generation close to that low was Broadwell. Skylake is a ton faster than Sandy Bridge clock for clock, and J5005 still does fall a bit below Sandy Bridge. There’s your two generations of progress since Goldmont - Atom went from below Sandy Bridge to matching Skylake during the Tremont/Gracemont generations.)