I think this is an example of exceptions looming large in our mind, precisely because they are exceptions, and taking an outsized proportion of our attention. Before you go crazy remapping your keyboard to make symbols easy, take a scan of your real code. I fired a script to count the incidence of all symbols across a couple codebases large enough to be fairly representative here:
Perl Java Go
1 . spc - %26.40 spc - %17.98 spc - %10.43
2 . e - %6.15 e - %7.93 e - %8.92
3 . a - %4.41 t - %6.76 r - %6.83
4 . t - %4.34 r - %5.68 t - %6.72
5 . r - %3.85 s - %5.34 s - %4.99
6 . s - %3.84 a - %5.19 i - %4.83
7 . i - %3.34 i - %4.96 n - %4.67
8 . o - %3.03 o - %3.95 o - %4.57
9 . \n - %2.99 n - %3.79 a - %4.41
10. n - %2.97 p - %3.37 \t - %3.60
11. l - %2.67 u - %2.91 \n - %3.44
12. d - %2.32 c - %2.79 c - %3.05
13. c - %2.25 d - %2.55 l - %2.73
14. u - %2.07 l - %2.50 u - %2.55
15. _ - %2.02 \n - %2.44 d - %2.32
16. $ - %1.70 . - %1.99 p - %2.08
17. m - %1.70 m - %1.94 g - %1.98
18. p - %1.55 g - %1.62 . - %1.81
19. f - %1.41 ) - %1.29 m - %1.65
20. h - %1.31 ( - %1.28 b - %1.62
scp is space. Even Perl, a notoriously symbol-heavy language, has its first "symbol" show up only slot 15. This codebase prefers separation_by_underscores, so if you have camelCase you might not even get that. Java's first shows up as the period in 16, go's slots in at 18. (Go programmers typically aren't using the TAB key that much, it's autoformatted into existence with gofmt.)
I'm not saying there's no room for a bit of optimization, but I suspect a lot of programmers would mentally place symbols way higher than they actually belong in the precedence scale.
The other problem that emerges if you get too serious with this is that the languages are different enough that if you do swap out some symbols for some more privileged spaces on your keyboard, they aren't the same ones across languages. In Perl, $ shows up in slot 16 at 1.7%. In Java, it's slot 66 at .01%. Java favors the period first in slot 16 at 2%, in Perl that's slot 40 at .37%. I once did a reasonable attempt at a multi-language survey with roughly equal amounts of each language and what I found was if you're multilingual you have only marginal improvements available with the symbols.
Whether it's worth it is up to you, but the fruit here is much less low-hanging than you might think.
(I don't have a J/K codebase here to check.)