ML on Apple ][+
11–20 of 33 posts
Re: ML on Apple ][+
#12Since when did regression get upgraded to full blown ML?
Re: ML on Apple ][+
#13I thought this was going to be about the programming language, and I was wondering how they managed to implement it on a machine that small.
Re: ML on Apple ][+
#14Re: ML on Apple ][+
#15Since when did regression get upgraded to full blown ML?
Re: ML on Apple ][+
#16I thought this was going to be about the programming language, and I was wondering how they managed to implement it on a machine that small.
Re: ML on Apple ][+
#17Earlier quoted context omitted.
A million things. Diffusion, back propagation, attention, to name a few.
Back prop and attention are just extensions of interpolation.
Back prop requires and limits to analytically differentiable in a normal way.
Attention is... Oh dear comparing linear regression to attention is comparing a diesel jet engine to a horse.
Re: ML on Apple ][+
#18One of my early "this is neat " programs was a genetic algorithm in Pascal. You entered a bunch of digits and it "evolved" the same sequence of digits. It started out with 10 random numbers. Their fitness (lower was better) was the sum the difference. So if the target was "123456" and the test number was "214365", it had a fitness of 6. It took the top 5, and then mutated a random digit by a random +/- 1. It printed…
That's when I learned a very important principal. "When something needs doing quickly, don't force artificial constraints on yourself"
I could have spent three days figuring out how to deal with the memory constraints. But instead I just cut the data in half and gave it two runs. The quick solution was the one that was needed. Kind of an important memory for me that I have thought about quite a bit in the last 30+ years.
Re: ML on Apple ][+
#19Earlier quoted context omitted.
Back prop and attention are just extensions of interpolation.
By that logic it's all "just linear maths". Back prop requires and limits to analytically differentiable in a normal way. Attention is... Oh dear comparing linear regression to attention is comparing a diesel jet engine to a horse.