Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

PyTorch Monarch

pytorch.org

Post reply on HN
Print view View original

41–45 of 45 posts

Re: PyTorch Monarch

#41

Post by pstoll »

gaogao wrote: post #17
chandureddyvari wrote: post #16

Interesting - this seems to target a different layer than services like Tinker ( https://thinkingmachines.ai/blog/announcing-tinker/ ). Monarch provides the infrastructure primitives while Tinker is a managed finetuning service. Could someone build something like Tinker on top of Monarch?

Yup, there's stuff like https://pytorch.org/blog/introducing-torchforge/ on top of it now

“Service Adverbs - like ‘route’ and ‘fanout’”

Grammarians are going to be big angry here. Ain’t an adverb in sight.

Re: PyTorch Monarch

#42

Post by bullfightonmars »

dhrt12327 wrote: post #18
pjmlp wrote: post #2

Apparently PyTorch oxidation has started. > Monarch is split into a Python-based frontend, and a backend implemented in Rust. Other than that, looks like a quite interesting project.

Multiple sources say that it is an experimental framework around PyTorch, not a replacement. People will still get to enjoy a circular graph using std::shared_ptr with memory leaks. It's a pity they don't do a complete rewrite with a functional language as the driver.

You might be looking for elixir/nx and axon

https://github.com/elixir-nx/axon

Re: PyTorch Monarch

#43

Post by cwp »

valzam wrote: post #4

I assume this is similar to Ray?

The code example is very similar to Ray.

Monarch:

  class Example(Actor):
     @endpoint
     def say_hello(self, txt):
         return f"hello {txt}"

  procs = this_host().spawn_procs({"gpus": 8})
  actors = procs.spawn("actors", Example)
  hello_future = actors.say_hello.call("world")
  hello_future.get()
Ray:

  @ray.remote(num_gpus=1)
  class Example:
      def say_hello(self, txt):
          return f"hello {txt}"

  actors = [Example.remote() for _ in range(8)]
  hello_object_refs = [a.say_hello.remote("world") for a in actors]
  ray.get(hello_object_refs)
Post reply on HN