Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Migrating Messenger storage to optimize performance

code.facebook.com

Post reply on HN
Print view View original

11–20 of 35 posts

Re: Migrating Messenger storage to optimize performance

#11

Post by djohnston »

mtgx wrote: post #6
bigato wrote: post #5

What about giving me an easy option to export my messages while you are at it?

Unfortunately, the feature to export your messages is only available to Facebook's data partners.

your ignorance adds nothing of value to this conversation. facebook data partners do not have a download your data button. that's not how any of this works.

Re: Migrating Messenger storage to optimize performance

#12

Post by midom »

godelmachine wrote: post #9
tomnipotent wrote: post #2

TL;DR - Moved from HBase to MyRocks engine on MySQL sitting on top of NVMe storage via their Lightning Server [1], which is a JBOF (just a bunch of flash) setup using x16 PCIe. [1] https://code.facebook.com/posts/989638804458007/introducing-...

Have they published a paper on this on Facebook Research?

doesn't really qualify much as research - just lots of engineering to cover all corners

Re: Migrating Messenger storage to optimize performance

#13

Post by midom »

djohnston wrote: post #11
mtgx wrote: post #6

Earlier quoted context omitted.

Unfortunately, the feature to export your messages is only available to Facebook's data partners.

your ignorance adds nothing of value to this conversation. facebook data partners do not have a download your data button. that's not how any of this works.

based on his previous submissions, he did not come here to discuss database technology or be factually correct.

Re: Migrating Messenger storage to optimize performance

#14

Post by felixhandte »

bigato wrote: post #8
tagx wrote: post #7

Earlier quoted context omitted.

You can use the download your information tool to download all your data on FB, including all your messages https://www.facebook.com/help/212802592074644 A Brooklyn based artist did this recently and made a book of his conversation history (and covered an apartment with some of the pages). You can find a bit more information and pictures at https://www.halfspace.uk/messages-2011-2017

I said "easy". And by the way, the second link is dead.

Works fine for me.

Re: Migrating Messenger storage to optimize performance

#15

Post by spyspy »

oerpli wrote: post #4

They say that they brought some new search features to mobile, though I would prefer if they fixed their search on desktop (or in general) first, as it only returns results from recent messages. Until sometime in 2016/2017 it was possible to look for specific things at whatever time (e.g. 2011) and now even things from <3y ago don't return anything.

I don't see the ability to search within the app. Have they not rolled it out yet?

Re: Migrating Messenger storage to optimize performance

#18

Post by jensvdh »

godelmachine wrote: post #9
tomnipotent wrote: post #2

TL;DR - Moved from HBase to MyRocks engine on MySQL sitting on top of NVMe storage via their Lightning Server [1], which is a JBOF (just a bunch of flash) setup using x16 PCIe. [1] https://code.facebook.com/posts/989638804458007/introducing-...

Have they published a paper on this on Facebook Research?

Social media apps have "Research" now?

Re: Migrating Messenger storage to optimize performance

#20

Post by alexbeloi »

jensvdh wrote: post #18
godelmachine wrote: post #9

Earlier quoted context omitted.

Have they published a paper on this on Facebook Research?

Social media apps have "Research" now?

Yes they do/have research. Facebook had 12 papers at the last computer vision conference I attended (CVPR '17) and won the awards for best paper and best student paper.
Post reply on HN