Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

TFS: A file system built for performance, space efficiency, and scalability

github.com

Post reply on HN
Print view View original

41–50 of 126 posts

Re: TFS: A file system built for performance, space efficiency, and scalability

#41

Post by Someone »

grub5000 wrote: post #2

Improved caching TFS puts a lot of effort into caching the disk to speed up disk accesses. It uses machine learning to learn patterns and predict future uses to reduce the number of cache misses. See that does sound like a good idea - I've always observed HDDs with an SSD cache to have a phenomanly useless caching system

Certainly a good idea, _if_ you have unlimited resources.

Without that, I think one should focus on getting the on disk structures right and the code manipulating them solid. That is enough of a challenge.

Re: TFS: A file system built for performance, space efficiency, and scalability

#42

Post by lordnaikon »

laumars wrote: post #34
joshbaptiste wrote: post #32

Earlier quoted context omitted.

Exactly, BcacheFS, HAMMER2 are other file-systems that are being worked on by some REALLY good programmers for years and years to come. It seems like a file-system takes longer to stabilize than a kernel.

> It seems like a file-system takes longer to stabilize than a kernel. For good reason in my opinion. An unstable kernel will cause application glitches, unnecessary slowness or OS crashes. They are annoying but not persistent (ie a reboot and you can carry on for a bit). However an unstable file system are persistent and thus could destroy all of your data forcing you to recover from backups (assuming you're diligen…

It is even worse. You can recover from backups but that implies that you already know at which point you destroyed your data and how fast you discovered that – if that ever happens. Imagine you're collecting data over a substantial period of time (maybe do calculations based on it that influence how you're collecting further data) and you're very smart and backup all your data let's say every day. The problem is if your data gets defects due to the file-system it is very unlikely to detect that. You can run your system for like a year without apparent problems whatsoever. Lets say that error accumulates and you eventually detect this by accident. Your backups are pretty much worthless ...

Re: TFS: A file system built for performance, space efficiency, and scalability

#43

Post by tracker1 »

deno wrote: post #36
tracker1 wrote: post #27

Earlier quoted context omitted.

Well.. let's google it... "TFS" .. hmm, abbridged lead in to the wikipedia article at the top... And though I'm not a systems programmer likely to implement, or support the code for a filesystem, I am A programmer, and work in IT... And systems operators are also likely to come accross TFS (Team Foundation Server) in terms of supporting a deployment of it. Though, they've started to refer to the source control protoc…

If you’re looking for Java and the first result is the Wikipedia article on the island[1] do you just switch programming languages? I hear C is very search engine friendly. Probably why it’s so popular. [1] https://en.wikipedia.org/wiki/Java

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better.

That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Coffee" to be very successful either.

Re: TFS: A file system built for performance, space efficiency, and scalability

#44

Post by omgtehlion »

arjie wrote: post #35
tracker1 wrote: post #27

Earlier quoted context omitted.

Well.. let's google it... "TFS" .. hmm, abbridged lead in to the wikipedia article at the top... And though I'm not a systems programmer likely to implement, or support the code for a filesystem, I am A programmer, and work in IT... And systems operators are also likely to come accross TFS (Team Foundation Server) in terms of supporting a deployment of it. Though, they've started to refer to the source control protoc…

For what it's worth, I think you should have taken the advice of the guy you're replying to. The first result for "TFS file system" is https://github.com/redox-os/tfs .

The first result I get is: GitHub - alibaba/tfs: TFS (Taobao File System) is a distributed file ...

Re: TFS: A file system built for performance, space efficiency, and scalability

#45

Post by Kudos »

tracker1 wrote: post #43
deno wrote: post #36

Earlier quoted context omitted.

If you’re looking for Java and the first result is the Wikipedia article on the island[1] do you just switch programming languages? I hear C is very search engine friendly. Probably why it’s so popular. [1] https://en.wikipedia.org/wiki/Java

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better. That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Co…

There are at least two other filesystems called TFS, how hard is it to just add another character to the acronym, tbh(fs)?

Re: TFS: A file system built for performance, space efficiency, and scalability

#46

Post by deno »

tracker1 wrote: post #43
deno wrote: post #36

Earlier quoted context omitted.

If you’re looking for Java and the first result is the Wikipedia article on the island[1] do you just switch programming languages? I hear C is very search engine friendly. Probably why it’s so popular. [1] https://en.wikipedia.org/wiki/Java

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better. That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Co…

It’s not “prevalent technology.” It’s a proprietary product published by a well-known software company.

If you want Microsoft’s TFS just search for “Microsoft TFS.” There is no confusion.

Re: TFS: A file system built for performance, space efficiency, and scalability

#47

Post by primer42 »

grub5000 wrote: post #2

Improved caching TFS puts a lot of effort into caching the disk to speed up disk accesses. It uses machine learning to learn patterns and predict future uses to reduce the number of cache misses. See that does sound like a good idea - I've always observed HDDs with an SSD cache to have a phenomanly useless caching system

I'm not a big fan of putting machine learning into a file system. Usually you can't understand why a machine learning algorithm is doing what it's doing, and I would be worried about a production server suddenly having massively different performance because the cache learning algorithm started doing something differently. Interesting idea, but I would want to battle test it before I bought in.

Re: TFS: A file system built for performance, space efficiency, and scalability

#48

Post by obstinate »

tracker1 wrote: post #43
deno wrote: post #36

Earlier quoted context omitted.

If you’re looking for Java and the first result is the Wikipedia article on the island[1] do you just switch programming languages? I hear C is very search engine friendly. Probably why it’s so popular. [1] https://en.wikipedia.org/wiki/Java

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better. That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Co…

You're tilting at windmills. Most threads where someone starts something new has someone making similar complaints to the one you're making here. Yet people's behavior doesn't change. And it won't -- it's just too much overhead to avoid the ever-expanding space of products that have the same name.

Re: TFS: A file system built for performance, space efficiency, and scalability

#49

Post by tracker1 »

obstinate wrote: post #48
tracker1 wrote: post #43

Earlier quoted context omitted.

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better. That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Co…

You're tilting at windmills. Most threads where someone starts something new has someone making similar complaints to the one you're making here. Yet people's behavior doesn't change. And it won't -- it's just too much overhead to avoid the ever-expanding space of products that have the same name.

Yes, but there's at least two other filesystems called TFS as well, per other threads... so even then, it's still overload. If I were releasing something to the public, I would probably namespace or consider something different in this case.

Re: TFS: A file system built for performance, space efficiency, and scalability

#50

Post by tracker1 »

deno wrote: post #46
tracker1 wrote: post #43

Earlier quoted context omitted.

The point is, there's already a prevalent technology in use by the same name... I wouldn't really expect to choose a programming language based on google-ability... go, is to this day hard to search for on its' own, "golang" being better. That said, I wouldn't expect a "new" programming language called "Java-Script" (not the current ES/JavaScript) to gain traction. Or for that matter a programming language called "Co…

It’s not “prevalent technology.” It’s a proprietary product published by a well-known software company. If you want Microsoft’s TFS just search for “Microsoft TFS.” There is no confusion.

See the definition of prevalent... Even if it's proprietary, it's pretty widespread... not to mention other file systems called TFS already.
Post reply on HN