The main issue I believe at play is that non-competitive types (eg non bodybuilders) frequently are not very good at assessing how hard they're pushing themselves. Because of that working with 1lb (or very low % of 1RM) is often ineffective because they have a hard time telling if the 99th, 100th, or 120th rep is truly 1 Rep In Reserve (RIR). For a similar reason training "to failure" with a reasonably high % of 1RM means by definition that they're going to 0 or 1 RIR. Low rest makes it easier to truly hit that 2 through 0 RIR range because without sufficient rest you are essentially doing a broken up single set.
Jeff nippard has a bunch of good videos on the subject that pulls from similar studies as the author:
- https://www.youtube.com/watch?v=xiJKa41Fsxo