Viewing profile — pcmoritz

You are right, it is fixed now!

Thanks, fixed!

We are excited about the Tinker API, it exposes the primitives forward_backward, optim_step, sample and checkpoints of an LLM as a REST API, which can be used to implement pretty m…

If you are interested in learning more about this, there is also a recent PyData talk: https://rise.cs.berkeley.edu/blog/modin-talk-at-pydata-nyc-2...

One of the authors here! We are glad you like it! The project is indeed driven by the authors listed on the paper and also the knowledge and experience that was accumulated in the …

There are two considerations here. (1) Python single threaded performance: Here, most of the libraries we are using are implemented in C++ (like numpy, TensorFlow, Cython to speed …

For Ray, the main use case at the moment is parallel/distributing machine learning algorithms, people have been using it for parallelizing MC(MC) style applications, doing hyperpar…

Author here. For CapnProto see the answer to the other comment above. Concerning dill, we have been using it for serializing function and classes (and then switched to cloudpickle …

Author here. From our perspective, CapnProto has similar characteristics as Flatbuffers and the reasons to prefer Arrow over it are the same: We would need to develop a mapping fro…