Earlier quoted context omitted.
I hate the Cuda monopoly in machine learning right now. I hope some of the mature libraries (TF, Pytorch) start officially supporting AMD GPUs. Nvidia is looting customers that want to use GPUs for Machine Learning on the cloud (like AWS, GCP)
Nvidia is cashing in their investments for software and integration. It's AMD's job to make machine learning work in their GPU's. If they don't believe in it and spend the necessary time and effort, nobody else will. Radeon Open Compute Platform (ROCm) has existed for years but apparently it's not good enough. ps. Tensorflow has ROCm backend support. https://hub.docker.com/r/rocm/tensorflow/ but is MI25 competitive?…
AMD Discloses Initial Zen 2 Details
101–110 of 207 posts
Re: AMD Discloses Initial Zen 2 Details
#102Re: AMD Discloses Initial Zen 2 Details
#103Earlier quoted context omitted.
Well AMD has gone wider - to 5 or 6 wide depending on how you count it in Ryzen. Intel hasn't really been able to make any changes to make any major uarch changes in years, since they've been stuck on Skylake (and all the various Skylake++ variants that followed which were Skylake in name only). In Skylake, most of the effort seemed focused on bringing AVX-512 to bear, and outside of that the basic design is largely…
Skylake also got rid of the ring core architecture, and went to the grid. That was a pretty drastic change, and very different from their previous generations.
Re: AMD Discloses Initial Zen 2 Details
#104Earlier quoted context omitted.
I hate the Cuda monopoly in machine learning right now. I hope some of the mature libraries (TF, Pytorch) start officially supporting AMD GPUs. Nvidia is looting customers that want to use GPUs for Machine Learning on the cloud (like AWS, GCP)
Isn't ROCm a viable alternative?
Both are being actively worked on, and I expect to see this gap shrink in the next few months to a year.
Re: AMD Discloses Initial Zen 2 Details
#105"Oh the places you'll go" :-) Assuming this chip doesn't trip all over itself moving things around, it will be an astonishing amount of computer power in a reasonably sized package. This is for me, the only reason to work at an internet giant; because they will build a tricked out motherboard with two sockets and up to 8TB of RAM and with say a petabyte of attached non-volatile storage available, field solvers, CFD a…
> exact numerical solutions Isn't that an oxymoron? Numerical solutions always involve some sort of rounding errors because of limited floating-point precision, so they cannot be exact.
It is far more apt to bring up most "interesting" solutions do not have an exact closed-form expression.
Re: AMD Discloses Initial Zen 2 Details
#106Earlier quoted context omitted.
The KAFFITY in the GROUP_AFFINITY struct is a bitmap ULONG, so 64 bits on 64 bit archs, and 32 bits on 32 bit archs.
Yes but that means every group is 64 CPUs. Notice you can set affinity for any group (16-bit index).
Re: AMD Discloses Initial Zen 2 Details
#107Earlier quoted context omitted.
Windows can use more than 64 hardware threads, but a single process kinda can't.
It can but you have to take care too change process affinity groups every time you want to work with threads in another group as a group is limited to 64 virtual cores. It complicates thread pool implementation significantly.
Re: AMD Discloses Initial Zen 2 Details
#108Earlier quoted context omitted.
Yes but that means every group is 64 CPUs. Notice you can set affinity for any group (16-bit index).
But AFAIK, if I have 128 logical cores, I can't say "schedule this thread on any of the 128 cores because you as the scheduler should know better than me". You have to manually manage the two thread groups each of 64 cores because new threads are round robin assigned to the two groups on thread creation and aren't migrated as circumstances change.
Re: AMD Discloses Initial Zen 2 Details
#109I hope AMD has something on their video chip line-up against nVidia as well. I'm curious if they knew nVidia was working on ray-tracing and plan to implement the same API or if they have some other tech they have up their sleeve they've been working on vendors with. I hate how nVidia has such a monopoly on the video chip market. Who knows, maybe Intel will finally get back into the gamer 3D market and we might finall…
The technology is a lot more interesting in professional 3D modelling where light baking and rendering can be done much faster.
Re: AMD Discloses Initial Zen 2 Details
#110Earlier quoted context omitted.
This seems like a familiar issue I've run into with workstations I've used in the past running Xeons. Not sure how NTOSKRNL handles scheduling of parallel tasks. I'd venture a guess and say it's hybrid (M:N threads), where multiple userland application threads are mapped to some "virtual processor" in kernelmode. That leads to priority inversion between the userland and kernelmode threads, which could explain why Win…
As far as I know Win NT threads are 1:1. Not even sure how it would work or even make any sense to have N:M handled by the kernel. N:M is usually a mainly a userspace thing. And Windows is even less likely to use that kind of convolution, because IIRC it can call back from kernel to userspace (that design I would not recommend, btw, but oh well). You have fibers, of course, but that's a different thing. Windows does…
Correct, I meant that the benchmarking program itself probably used that implementation. Not the Win NT kernel’s implementation of OS threads.