Live data from Hacker News

Meta’s renewed commitment to jemalloc

engineering.fb.com

191–200 of 259 posts

Re: Meta’s renewed commitment to jemalloc

#191

Earlier quoted context omitted.

Java is pretty greedy with the memory it claims. Especially historically it was pretty hard to get the JVM to release memory back to the OS. To an outsider, that looks like the JVM heap just steadily growing, which is easy to mistake for a memory leak.

This only really ends up being a problem on windows. On systems with proper virtual memory setups, the cost of unused memory is very low (since the the OS can just page it out)

Not used Windows Server that much?

Re: Meta’s renewed commitment to jemalloc

#192

Earlier quoted context omitted.

This only really ends up being a problem on windows. On systems with proper virtual memory setups, the cost of unused memory is very low (since the the OS can just page it out)

Unfortunately, the JVM and collectors like the JVM's plays really bad with virtual memory. (Actually, G1 might play better. Everything else does not). The issue is that through the standard course of a JVM application running, every allocated page will ultimately be touched. The JVM fills up new gen, runs a minor collection, moves old objects to old gen, and continues until old gen gets filled. When old gen is filled…

Depends on which JVM, PTC and Aicas do alright with their real time GCs for embedded deployment.

Re: Meta’s renewed commitment to jemalloc

#193

Earlier quoted context omitted.

Like "never work at Meta unless you can out-toxic your coworkers".

Yea I knew meta was toxic, but publicly beefing over something over a decade ago is a whole other matter. I can’t even remember what I was working on 10 years ago, and even if I did I wouldn’t be bringing people down that much later.

Yeah, I am loving the public mudslinging over shit from 10 years ago, like high school girls fighting. This is like the FAANG version of the TV show Suits. We can call it FAANGs and use Midjorney to create the cover art and give the actors vampire fangs.

On a more serious note, it seems like any hyper competitive company eventually spirals into an awful, toxic working env.

Re: Meta’s renewed commitment to jemalloc

#194
jemalloc saved my icinga2 installation that kept exploding in memory usage, when i (and agents from sub-zones) was hammering its api

when i preloaded jemalloc , memory remained at significantly lower levels, and - more importantly - it was stable.

there seems to be no single correct solution to memory allocation, depending on the workload

Re: Meta’s renewed commitment to jemalloc

#197

Earlier quoted context omitted.

doesn't java also? I heard that was a common complaint for minecraft

Minecraft for somewhat silly reasons was largely stuck using Java8 for ~a decade longer than it should have which meant that it was using some fairly outdated GC algorithms.

"silly reasons" being Java breaking backwards compatibility

decade seems a usual timescale for that, considering f.e. python 2->3

Re: Meta’s renewed commitment to jemalloc

#198
post #77

Earlier quoted context omitted.

Java is pretty greedy with the memory it claims. Especially historically it was pretty hard to get the JVM to release memory back to the OS. To an outsider, that looks like the JVM heap just steadily growing, which is easy to mistake for a memory leak.

Java has a quite strict max heap setting, it's very uncommon to let it allocate up to 25% of the system memory (the default). It won't grow past that point, though. Baring bugs/native leaks - Java has a very predictable memory allocation.

we aren't talking about allocation, tho

we are talking about DEallocation

Re: Meta’s renewed commitment to jemalloc

#199

Earlier quoted context omitted.

For the peanut gallery more: I worked with both of these guys at Meta on this. The "servers are only on for a few hours" thing was like never true so I have no idea where that claim is coming from. The web performance test took more than a few hours to run alone and we had way more aggressive soaks for other workloads. My recollection was that "write zeroes" just became a cheaper operation between '12 and '14. A fun…

[flagged]

This is literally how pretty much every conversation goes when you work with people close to the metal. It's a stylistic thing at this point.

For what it's worth, 20 years ago all programming newsgroups were like this. I grew my thick skin on alt.lang.perl lol

Re: Meta’s renewed commitment to jemalloc

#200
> With the leverage jemalloc provides however, it can be tempting to realize some short-term benefit. It requires strong self-discipline as an organization to resist that temptation and adhere to the core engineering principles.

This doesn't quite read properly to me. What does it actually mean, does anyone know?

Post reply on HN