Earlier quoted context omitted.
During a later period (early 2000's) Perl was the only scripting language with good Unicode support, including inside regular expressions, which was revolutionary at the time. There was so much cool stuff you could only do in Perl, and then like you say it all ran into the brick wall of Perl 6.
The brick wall of Perl 6 was itself a solution to an internal nightmare inside of core Perl development. Particularly around conflicts involving Tom Christensen, which caused no progress to be made on Perl 5.6.1 despite major bugs in 5.6.0. For example: my $x = 5 + 6; $x .= "0"; print $x + 5; # 16, not 115. The result in the year 2000 was a famous cup throwing incident by Jon Orwant. And Perl 6 was a plan to separate…
They did not add support for encoding/decoding html entities or URLs were added. No standard modules for this.
No easy method of making html pages from a URL request besides running as CGI.
This made perl lose to php which made it very easy to make a simple "Hello, world" page.
php would never had any traction if perl developers had made web support high priority.