Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Curated, Pre-trained ML Models for Transfer Learning

modeldepot.io

Post reply on HN
Print view View original

11–20 of 30 posts

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#11

Post by minimaxir »

Two of my projects, textgenrnn (https://github.com/minimaxir/textgenrnn) and reactionrnn (https://github.com/minimaxir/reactionrnn) are among the pretrained models.

While this is allowed by the MIT License (and there is sufficient attribution to the source repos), it might be helpful to more explicitly state that the curated models are forks/modifications. These models also have a dependency on the source packages, which I can't promise that it won't have breaking changes if I do decide to update the package.

I do like the new accompanying examples for those projects, and it's good to see the projects actually being used! :)

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#13

Post by mikeshi42 »

orliesaurus wrote: post #9

Thanks for submitting! Can you tell me how this differs from something like https://algorithmia.com/ ? I am curious to understand the main differences between their approach and yours! Cheers :)

Of course! We're huge believers in creating a transparent platform that talks about models at a high-level for general understanding, but also want to make sure we include and cite the relevant original source code, and applicable research papers backing the model.

We're not trying to build something black box, or tied to proprietary infrastructure/APIs that'll cost you money. The models are free for you to use, download, and extend, according to their respective license. You can deploy the model on your own servers and use it as many times as you like, without paying a single cent. You can further fine-tune/transfer learn the model for your specific deployment, if the out of the box model doesn't work exactly how you'd like.

We're both trying to empower engineers with Machine Learning, we just hope to accomplish that through making it transparent and free to use, so that they're extensible and flexible for whatever use case you need. Along the way we also hope that the developers can learn a bit of ML as well, so they can better leverage the models for their use case!

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#15

Post by hsikka »

minimaxir wrote: post #11

Two of my projects, textgenrnn ( https://github.com/minimaxir/textgenrnn ) and reactionrnn ( https://github.com/minimaxir/reactionrnn ) are among the pretrained models. While this is allowed by the MIT License (and there is sufficient attribution to the source repos), it might be helpful to more explicitly state that the curated models are forks/modifications. These models also have a dependency on the source package…

Hey, thank you! That is an excellent point, and definitely a huge potential problem that we're gunning to fix, both in the submissions already up and those that will come in the future. With this version of ModelDepot, we really just wanted to pique people's curiosity and get them to see the power and potential of sharing well documented models.

Also, thank you for contributing to the ML community at large! I really enjoy your work personally, and hearing that you dig the examples we patched together means the world :)

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#17

Post by mikeshi42 »

badminton1 wrote: post #16

One day there will be a trained model called "software engineer" and we will be out of a job. The training data may come from github, extracting requirements from issues, and mapping it to the code that closed the ticket.

But then we can finally spend _all_ of our time on HN!

But we really do think ML, even in the near future, will automate some of our jobs away (and that's a good thing!), if you're interested in some of our thoughts on that: https://medium.com/modeldepot/we-previously-talked-about-how...

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#18

Post by sgt101 »

badminton1 wrote: post #16

One day there will be a trained model called "software engineer" and we will be out of a job. The training data may come from github, extracting requirements from issues, and mapping it to the code that closed the ticket.

Who will write the specs that cause the code to be generated?

oh...

Re: Show HN: Curated, Pre-trained ML Models for Transfer Learning

#20

Post by rm999 »

minimaxir wrote: post #11

Two of my projects, textgenrnn ( https://github.com/minimaxir/textgenrnn ) and reactionrnn ( https://github.com/minimaxir/reactionrnn ) are among the pretrained models. While this is allowed by the MIT License (and there is sufficient attribution to the source repos), it might be helpful to more explicitly state that the curated models are forks/modifications. These models also have a dependency on the source package…

Hey, I just installed and played around with reactionRNN; I hate to be negative (especially to people open sourcing models, kudos!), but your model seems to perform quite poorly. It immediately failed my "easy" smell tests: https://i.imgur.com/FvfuZgy.png, and didn't really work on most of my other tests: "This book sucks" is 0% angry, "I'm going to go home and listen to emo music and cry" is 0% sad, "Check out this hilarious youtube video" is only 26% haha. Your example "He was only 41." is 100% sad, but "He was only 42." is 0% sad. These aren't hand-picked, these are literally things I just typed in. From what I can tell it usually gets anything negative wrong, and usually picks "haha" for the positive ones.

Subjective performance is worse than your included examples. I've been building models my whole career, and what I've learned is most people will take claimed performance at face value until it burns them. It's beneficial to no one if someone comes up with an idea based off your repo description, builds it out, then finds it doesn't work adequately. My advice is to update your examples and test cases, and keep finding ways to improve the model.

Post reply on HN