You can't really compare JS to Google or Facebook. It's still a company of * Very flat hierarchy and very limited bureaucracy. At JS there's like at most two people between you and the folks who run the place.
* JS is technically isolated. They're not really part of the same conversation as the web-focused and much more public tech giants are. Lots of NIH, custom hand-rolled solutions. Maybe part of that is a consequence of going all-in on an ecosystem (Ocaml) that basically only you use and run, maybe part of that is that really smart people love to invent their own better solutions to problems, maybe part of that is that most of what JS does is either, like, command-line/TUI apps for traders to interact with or trading systems where a proprietary technical advantage is where you get your edge.
* There's a particular Jane Street "way of thinking". Another comment on this thread exemplifies it pretty well [1] - technocratic and rationalist. If you don't fit into that mould you'll feel out of place, if you can even get hired at all.
* More of a 9-6, butt-in-chair mentality than at other tech jobs I've worked. There's some flexibility about the 9-6 thing (and 9-6 can be pretty optimistic at times), but they're limited by the nature of the markets. At the time and for me, anyway, there was zero possibility of ever doing any work at home. COVID may have changed this.
* There's still things clubs, office events, and perks, but to a lesser degree and more informally than at larger companies. It feels more like working a regular job at a real business. JS is also a lot smaller and more homogenous (see above), so less of that is needed to create social cohesion.
If you have specific questions, or can elaborate on what your "negative perception" entails, I can probably comment further.
[1] https://news.ycombinator.com/item?id=24273348