It's an artificial distinction. If you are wealthy, you have access to opportunities with good odds, call it trading and tell everyone about it so they know you are a sophisticated and wise investor. If you are poor, you have few good options and generally wouldn't brag about your gambling. If you do, you are labelled irresponsible.
And rightly so. For two main reasons
- demonstrably negative expected value of the bets (like in casino floor games or the lottery)
- relatively high proportion of total net worth wagered
I'm very comfortable with labeling this as irresponsible (regardless of levels of wealth). It's not just a case of "everyone does it but only poor people are shamed for it", there's a clear distinction between the two cases.