Live data from Hacker News

Meta’s renewed commitment to jemalloc

engineering.fb.com

81–90 of 259 posts

Re: Meta’s renewed commitment to jemalloc

#84
post #34

Few months back, some of the services switched to jemalloc for the Java VM. It took months (of memory dumps and tracing sys-calls) to blame the JVM, itself, for getting killed by the oom_killer. Initially the idea was diagnostics, instead the the problem disappeared on its own.

If you changed from glibc to jemalloc and that solved your issues, then you should blame glibc, not the JVM.

Re: Meta’s renewed commitment to jemalloc

#89
post #68
post #8

I recently started using Microsoft's mimalloc (via an LD_PRELOAD) to better use huge (1 GB) pages in a memory intensive program. The performance gains are significant (around 20%). It feels rather strange using an open source MS library for performance on my Linux system. There needs to be more competition in the malloc space. Between various huge page sizes and transparent huge pages, there are a lot of gains to be…

I remember in the early days of web services, using the apache portable runtime, specifically memory pools. If you got a web request, you could allocate a memory pool for it, then you would do all your memory allocations from that pool. And when your web request ended - either cleanly or with a hundred different kinds of errors, you could just free the entire pool. it was nice and made an impression on me. I think th…

Look into talloc, used inside Samba (and other FLOSS projects like sssd). Exactly this.

Re: Meta’s renewed commitment to jemalloc

#90
post #11

One has to wonder if this due to the global memory shortage. ("Oh - changing our memory allocator to be more efficient will yield $XXM dollar savings over the next year").

With the reputation of that company, one can wonder a lot of backstories that are even more depressing than a memory shortage.
Post reply on HN