Viewing profile — tasdfqwer0897

Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still gett…

Yeah this is a good point! We are spending a lot of time thinking about reliability and it's true that existing models fall a little flat here. I think ultimately the key to making…

Yeah, we did have to custom-build our own benchmarks. And we are not building a chatbot, we're building something collaborative that you can work with to accomplish the stuff you w…

Thanks - glad you like it! I probably won't get to all of these but let me try a couple: 1. There's a spectrum (sort of) between using full on RL techniques and just doing sequence…

We used a combination of human demonstrations and feedback data! You need custom software both to record the demonstrations and to represent the state of the Tool in a model-consum…

Yes! We plan on putting out a more detailed technical post soon.

Hey, I helped make this! Happy to answer any questions.

> do you see improvements in Transformer or attention based architectures as essential... I do personally, but there is some disagreement about this in the field. In fact, I would …

I personally agree that this experiment is evidence that there are certain problems that cannot be solved simply by making the models bigger, and one of the main research questions…

Unfortunately not, but we do release both the programming dataset and the math questions dataset, so in principle you could try those out with one of the open-source models from e.…

I think it might be a mistake to think that the model is not confident because its response is something a human might say if they were not confident. The model is 'just' completin…

Hey, I am one of the lead authors of this paper. Happy to answer questions. This is a twitter thread going over the main results: https://twitter.com/gstsdn/status/1427794393373626…

We have been working on this recently on the Google Brain team. We are working both on synthesizing programs from scratch (see https://arxiv.org/abs/2002.09030 for example) and on …

This actually might have interesting connections to ideas from differential privacy. Maybe the work is derivative of a particular training image if we can easily predict the presen…

So if you wave your hands enough, it seems like maybe there's an argument to be made that the weights of a trained GAN somehow correspond to a 'compilation' of the training data as…

So you are worried that your existing attribution method is too focused on 'obvious' attributes and you want to see if you can make it focus on less obvious things? IIUC, that's so…

Someone on the machine learning reddit asked me this: > Question: How does copyright work for GAN output? If I input 300,000 copyright protected photos of celebrities and generate …

Hmm, I'm not sure what you mean by applicable loss functions? I'll answer what I think you're asking and you can tell me if I got it wrong: There's been a lot of effort spent on co…

Hey, I wrote this! Happy to answer questions.