The Apple II was not what I got at the time, and its graphics and sound were really sub-par compared to cheaper competition, but it was a really nice combination of things that are hard to match:
1) It had very fast storage for the time
2) It had excellent documentation in the box
3) The BASIC interpreters were better than what shipped with the Atari and Commodore machines
4) Apple LOGO was particularly well executed for something on an 8-bit machine
5) I had the impression it was easier at the time to get pirated copies of more sophisticated software like macro assemblers, Apple Pascal, etc for the Apple; Commodore and Atari circles were about the games
6) It had a built-in debugger ("monitor") with mini assembler
7) It had card slots that were straightforward to interface to - building real hardware for it was possible for a hobbyist. Also, it was affordable and practical to have an 80-column display
8) As you've noted the educational software for younger kids was exceptional
I just don't see anything remotely like that today but a used Apple II, and even then you're not going to have the ferment of early-mid-eighties home computer culture.
The counterargument is that today we have an embarassment of riches - the paradox of choice - and if you carefully select hardware and software and books for your kids (Scratch or Snap, paint programs, robotics kits, whatever takes with their interests) there's a much bigger world for them to explore.