Earlier quoted context omitted.
That's not accurate at all. If you contribute back changes to it then they have to comply with the license too and publish the source.
The entire purpose of the AGPL is that users of the server are now users of your program, so having access to the code is their right. IANAL but this is how I've always understood the AGPL to work. See: https://tldrlegal.com/license/gnu-affero-general-public-lice... Edit: See also their own FAQ: http://www.affero.org/oagf.html#How_does_the_Affero_Public_L...
The GPL goes both ways. Wire release under the AGPL, sure. That means if you want to use it on your server you have to release the source code of any modifications. Of course you do. But they do too. It's open source, they accept contributions. Those contributions are copyright the contributors and licensed AGPL.