Show HN: Can an AI model fit on a single pixel?
1–10 of 11 posts
Re: Show HN: Can an AI model fit on a single pixel?
#2This was just a fun thought experiment.
Feed it two inputs (e.g. chance of rain and wind speed; this is one of the examples in the demo) and it learns to answer a yes/no question like "bring an umbrella?" It's a one-neuron binary classifier with three learned parameters: two weights and a bias. Those three numbers map directly to Red, Green, and Blue. Save the model: you get a 1x1 PNG. Load the pixel: you get your classifier back. The color is the model.
Re: Show HN: Can an AI model fit on a single pixel?
#3This was just a fun thought experiment. Feed it two inputs (e.g. chance of rain and wind speed; this is one of the examples in the demo) and it learns to answer a yes/no question like "bring an umbrella?" It's a one-neuron binary classifier with three learned parameters: two weights and a bias. Those three numbers map directly to Red, Green, and Blue. Save the model: you get a 1x1 PNG. Load the pixel: you get your cl…
It is fun. The trainer seems to get stuck in local minima though.
Re: Show HN: Can an AI model fit on a single pixel?
#4This was just a fun thought experiment. Feed it two inputs (e.g. chance of rain and wind speed; this is one of the examples in the demo) and it learns to answer a yes/no question like "bring an umbrella?" It's a one-neuron binary classifier with three learned parameters: two weights and a bias. Those three numbers map directly to Red, Green, and Blue. Save the model: you get a 1x1 PNG. Load the pixel: you get your cl…
It is fun. The trainer seems to get stuck in local minima though.
Thanks; does this fix it? https://github.com/dvelton/ai-pixel/commit/ba04e1c649e0ec99b...
Re: Show HN: Can an AI model fit on a single pixel?
#5Earlier quoted context omitted.
It is fun. The trainer seems to get stuck in local minima though.
Thanks; does this fix it? https://github.com/dvelton/ai-pixel/commit/ba04e1c649e0ec99b...
Tried again and no. To reproduce create a corridor e.g.
X O
X O
X O
X O
X O
Re: Show HN: Can an AI model fit on a single pixel?
#6This is super fun! Very elegant idea
Has anyone done this for larger neural nets? Is there a way to extract some kind of pattern or is the image just noise no matter how you construct it? I'd be curious to see something like that
Re: Show HN: Can an AI model fit on a single pixel?
#7Earlier quoted context omitted.
Thanks; does this fix it? https://github.com/dvelton/ai-pixel/commit/ba04e1c649e0ec99b...
Tried again and no. To reproduce create a corridor e.g. X O X O X O X O X O Line can get jammed in non vertical positon.
Increased default epochs to 2000 instead of 500, I think that fixed it but let me know if you still run into this.
Re: Show HN: Can an AI model fit on a single pixel?
#8This is super fun! Very elegant idea Has anyone done this for larger neural nets? Is there a way to extract some kind of pattern or is the image just noise no matter how you construct it? I'd be curious to see something like that
Not sure what happens if you start scaling this, but curious too. Would love to see someone who actually knows ML try it.
Re: Show HN: Can an AI model fit on a single pixel?
#9Earlier quoted context omitted.
Tried again and no. To reproduce create a corridor e.g. X O X O X O X O X O Line can get jammed in non vertical positon.
Increased default epochs to 2000 instead of 500, I think that fixed it but let me know if you still run into this.
Works for me now, thanks!