Live data from Hacker News

Tensorflow 2.0 Beta 0

github.com

21–30 of 44 posts

Re: Tensorflow 2.0 Beta 0

#21

Any news on Swift for Tensorflow? I’m skeptical of how much practical benefit it will provide but still willing to take a look at it. There doesn’t seem to be any mention of it here.

From what I understand this is mostly because they hired the Swift guy.

I understand the benefits compared to Python (although I would have preferred Go or Kotlin). But what happens when the guy eventually moves on in a year or two?

Re: Tensorflow 2.0 Beta 0

#24

Any news on Swift for Tensorflow? I’m skeptical of how much practical benefit it will provide but still willing to take a look at it. There doesn’t seem to be any mention of it here.

From what I understand this is mostly because they hired the Swift guy. I understand the benefits compared to Python (although I would have preferred Go or Kotlin). But what happens when the guy eventually moves on in a year or two?

Google's making a big investment in Swift, so if Chris left and they were interested in continuing to support it they shouldn't have a problem.

I've gone to Swift on the Server conferences hosted/sponsored by Google, their (non-TF) Swift teams are building some cool Swift tools, etc.

Re: Tensorflow 2.0 Beta 0

#25
post #14
post #11

Earlier quoted context omitted.

Keras is a high level API that can use multiple backends. So it makes sense for them to remain separated.

I haven't used TF much lately, but the last time I looked at TF2 it felt like they are making it harder to build low level api models.

I doubt it, it's more likely that they are creating higher level abstractions atop the lower level ones and are advertising/documenting the higher level ones

Re: Tensorflow 2.0 Beta 0

#26

Maybe I'll give TF another try, but right now I'm really liking PyTorch. With TensorFlow I always felt like my models were buried deep in the machine and it was very hard to inspect and change them, and if I wanted to do something non-standard (which for me is most of the time) it was difficult even with Keras. With PyTorch though, I connect things however how I want, write whatever training logic I want, and I feel…

TF's deprecation velocity was way too high for my taste. Things we wrote would stop working randomly with their updates. I feel very similar to you about the models being "buried too deep" in their (ever-changing) machine. I much preferred how easy it was to hack Caffe V1 (once you got past the funky names, etc). These days, I really like mxnet. Torch was a disaster, but Pytorch is much better. It's not bad in produc…

Test

Re: Tensorflow 2.0 Beta 0

#27

Maybe I'll give TF another try, but right now I'm really liking PyTorch. With TensorFlow I always felt like my models were buried deep in the machine and it was very hard to inspect and change them, and if I wanted to do something non-standard (which for me is most of the time) it was difficult even with Keras. With PyTorch though, I connect things however how I want, write whatever training logic I want, and I feel…

Can't explain it but for some reason Tensorflow never felt "right" to me, even work keras. Pytorch on the other hand feels so much more natural...

Maybe I'm not up to speed with the latest PyTorch, but to me Keras feels much more natural. In Keras if you want to define a deep learning network, then you just do that, you specify the first layer, the second layer, etc, then you calibrate over some test and validation samples, using a certain flavor of gradient descent, for a given loss function. In PyTorch, you have to define a class, with a constructor, some method called "forward", I don't know, maybe if I follow an example to the end I get the hang of it. My problem is that I don't want to write object oriented programming, I want to do machine learning. Keras doesn't force me to know what a class it, or what it means to inherit from nn.Module, or that a constructor in python needs to contain 'self' as a variable. PyTorch, at least the exmples I saw online want me to do just that, and that's a turnoff.

On the other hand, in Keras I can't (easily) change the architecture of a learner after I defined it. I can't prune some nodes and split others, maybe that's easy in PyTorch. If that's the case, I'll take a second look. Until then, when I have some time, I'm really tempted to invest some time in MXNet, as the book "Dive into Deep Learning" appears to be quite good.

Re: Tensorflow 2.0 Beta 0

#28

Earlier quoted context omitted.

Can't explain it but for some reason Tensorflow never felt "right" to me, even work keras. Pytorch on the other hand feels so much more natural...

Maybe I'm not up to speed with the latest PyTorch, but to me Keras feels much more natural. In Keras if you want to define a deep learning network, then you just do that, you specify the first layer, the second layer, etc, then you calibrate over some test and validation samples, using a certain flavor of gradient descent, for a given loss function. In PyTorch, you have to define a class, with a constructor, some met…

in Keras I can't (easily) change the architecture of a learner after I defined it

I'm not sure what you mean here, because only PT lets you change architecture after you define it, while TF/Keras uses a static precompiled graph. Now that's changing with eager mode, but that used to be the main advantage of PT.

Re: Tensorflow 2.0 Beta 0

#29

Nice to see the project moving along, I'm just getting started with the basics for a way finding application and will probably start off with version 2 then. Hopefully by the time stable comes around I'll be near production ready as well. A bit off-topic, but does TF or pyTorch work nicely with AMD GPUs? I'd rather not have to deal with Nvidia's blob drivers if at all possible.

does TF or pyTorch work nicely with AMD GPUs?

No.

Re: Tensorflow 2.0 Beta 0

#30

Maybe I'll give TF another try, but right now I'm really liking PyTorch. With TensorFlow I always felt like my models were buried deep in the machine and it was very hard to inspect and change them, and if I wanted to do something non-standard (which for me is most of the time) it was difficult even with Keras. With PyTorch though, I connect things however how I want, write whatever training logic I want, and I feel…

TF's deprecation velocity was way too high for my taste. Things we wrote would stop working randomly with their updates. I feel very similar to you about the models being "buried too deep" in their (ever-changing) machine. I much preferred how easy it was to hack Caffe V1 (once you got past the funky names, etc). These days, I really like mxnet. Torch was a disaster, but Pytorch is much better. It's not bad in produc…

I am curious, what do you like about mxnet?
Post reply on HN