Viewing profile — AdamDKing

The script for this scam hasn't changed in years! Here's Kitboga with the same scam over 2 years ago: https://twitter.com/kitboga/status/1009830578407997440 (it's almost always 22 …

Possibly due to the current Google Cloud outage. https://status.cloud.google.com/incident/compute/19008

On the : GPT-2 and this model were trained by sampling fixed-length segments of text from a set of web pages. So if the sample happens to start near the end of one page then it wil…

>How exactly the large GPT-2 models are deployed is a mystery I really wish was open-sourced more. TalkToTransformer.com uses preemptible P4 GPUs on Google Kubernetes Engine. Chang…

Thanks for the upvotes! The site is running quite a bit slower than planned, but I think I know why. I should be able to get it going at full speed around tomorrow.

The site was using one K80 GPU but it's slowing down significantly so I'm adding a second GPU. The servers run on Google Kubernetes Engine.

You seem to be saying this work is based on convolutional neural networks. That's incorrect. It uses the same attention mechanisms from natural language processing which involve no…

It seems that using "fixed attention" for text would encourage the network to periodically summarize the context so far and put it in that fixed column for the rows below to access…

That line refers to training the model from scratch. You can still run the trained model very quickly with one "cheap" GPU. That said, I'm not sure why one wouldn't get a similar r…

For all the 3D diagrams that I made (including the animated one at the end) I wrote code that used https://threejs.org/ and my custom library. It worked, but with a lot of hassle. …

NVIDIA just released the code: https://github.com/nvlabs/spade/