Live data from Hacker News

Inventor Claims to Have Solved Floating Point Error Problem

hpcwire.com

141–150 of 205 posts

Re: Inventor Claims to Have Solved Floating Point Error Problem

#141
post #67

Earlier quoted context omitted.

That's what I was thinking too; If I do 1 / 3, then of course it will have to truncate, and integration errors would still be inevitable.

Actually it's possible to represent 1/3 perfectly accurately, but what about all the numbers that it's theoretically impossible to compute? (Almost all real numbers have this property)

If they can't be computed, what are you planning on using them for? The biggest problem is going to be with the useful transcendentals.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#142

At a glance this reads similar to Interval Arithmetic in that it places bounds on how much error a value carries. Is there something more novel to his approach? https://en.wikipedia.org/wiki/Interval_arithmetic

I think the novel part is in the encoding of the error in the bits of the value. It's hard to see how much value this patent really holds.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#143
post #120

Earlier quoted context omitted.

Actually it's possible to represent 1/3 perfectly accurately, but what about all the numbers that it's theoretically impossible to compute? (Almost all real numbers have this property)

> Almost all real numbers have this property > Almost all I love this comment because it brings back memories of school. In a layman's terms, I think almost all in this case means all but a finite amount can we say almost all real numbers are irrational? 1 1/1 2/1 3/1 4/1 5/1 ... 2 1/2 2/2 3/2 4/2 5/2 ... 3 ... so clearly we can count all the rational numbers but how many irrational numbers are there? are there (many…

You can count computable irrationals by numbering the algorithms that calculate (successive approximations to) them and lining them up in order. This is what Turing used his "Turing Machines" to do.

So all of the irrationals that we use or could ever use in calculations are countable. The uncountability of the irrationals comes entirely from the uncomputable ones, which we will probably never see.

The reals are deeply weird.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#144

The floating point error problem has not been solved. This patent describes a floating-point representation that includes fields for storing error information. The standard IEEE floating-point representation has three fields: a sign field, an exponent field, and a mantissa (or significand). This patent proposes reducing the size of other fields and adding additional fields to store error information. The error inform…

how is this better than checking if its within some value by some epsilon manually?

Re: Inventor Claims to Have Solved Floating Point Error Problem

#145
post #67

Earlier quoted context omitted.

That's what I was thinking too; If I do 1 / 3, then of course it will have to truncate, and integration errors would still be inevitable.

There is inaccuracy, but the point is that it tracks how much inaccuracy there might be. I picture this as being similar to how computers can't trust time for all sorts of reasons, so Google's Spanner uses time ranges and estimates of potential inaccuracy to make it possible to work with that. It will truncate, so you won't really have 1/3, but you'll know it's approximately 0.333, definitely more than 6/20 but defin…

Yes, this is my exact understanding of the article too.

So in that case, "[it] allows representation of real numbers accurate to the last digit" doesn't really hold true.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#146

The floating point error problem has not been solved. This patent describes a floating-point representation that includes fields for storing error information. The standard IEEE floating-point representation has three fields: a sign field, an exponent field, and a mantissa (or significand). This patent proposes reducing the size of other fields and adding additional fields to store error information. The error inform…

It depends on how you interpret "floating point error". If by that you mean the error the error inherent in the representation, it actually increases that through loss of precision, as you note. If you interpret it as "problems caused by lack of precision in floating point" (i.e. the patriot missile problem references in the article is a "floating point error"), then the tracking of precision will allow you to easily know when you've hit an error threshold that is unacceptable, allowing you to avoid those problems.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#147
post #103
post #26

> “In the current art, static error analysis requires significant mathematical analysis and cannot determine actual error in real time,” reads a section of the patent. “This work must be done by highly skilled mathematician programmers. Therefore, error analysis is only used for critical projects because of the greatly increased cost and time required. In contrast, the present invention provides error computation in…

I'm the main author of Arb. Note that it's an arbitrary-precision library. It's ~100x times slower than hardware floating-point because of using arbitrary-precision floating-point numbers implemented entirely in software. But if you have to do arbitrary-precision arithmetic to begin with, Arb's error tracking only adds negligible further overhead. For machine precision, I believe ordinary interval arithmetic is the b…

> It's ~100x times slower than hardware floating-point because of using arbitrary-precision floating-point numbers implemented entirely in software.

Thanks for the numbers, how did you get that estimate? Did you consider SIMD?

Re: Inventor Claims to Have Solved Floating Point Error Problem

#148
post #9

Without reading the patent it sounds a lot like interval arithmetic [1] which sounds like a really good idea at first but is not without its own problems. For example the inverse 1/x for an interval x like [-1,+1] containing 0 consists of two intervals (-∞,-1] and [+1;+∞). [1] https://en.wikipedia.org/wiki/Interval_arithmetic

You could always just return nan in that case, like for normal arithmetic.

In which case you go from a potentially imprecise result to no result at all which would arguably make things worse, especially if you happen to know that x is non-zero and division by zero is not an issue. The problem is that using a single interval is not generally good enough to track error bounds for arbitrary calculations while avoiding to turn everything into the useless (-∞,+∞). The common solution is to use multi-interval arithmetic but having to deal with a data structure of variable length is really painful for hardware implementations.

Re: Inventor Claims to Have Solved Floating Point Error Problem

#149
post #134
post #120

Earlier quoted context omitted.

> Almost all real numbers have this property > Almost all I love this comment because it brings back memories of school. In a layman's terms, I think almost all in this case means all but a finite amount can we say almost all real numbers are irrational? 1 1/1 2/1 3/1 4/1 5/1 ... 2 1/2 2/2 3/2 4/2 5/2 ... 3 ... so clearly we can count all the rational numbers but how many irrational numbers are there? are there (many…

The rational numbers are clearly countable. The irrational numbers are uncountable, which means that for every rational number there are infinitely many irrational numbers.

But for every integer there are also an infinite number of rationals. And since we can put the rationals into 1-1 correspondence with integers, that means that for every rational there are an infinite number of rationals.

Infinity is funny like that.

The conclusion that there are somehow more irrationals than rationals depends on subtle philosophical points that have no possible proof or disproof and usually get glossed over. Accepting that philosophy also leads to the conclusion that not only do numbers which can in no way ever be represented exist, but there are more of them than numbers which we can explicitly name. Now I ask you, in what sense do they REALLY exist?

Re: Inventor Claims to Have Solved Floating Point Error Problem

#150
post #120

Earlier quoted context omitted.

Actually it's possible to represent 1/3 perfectly accurately, but what about all the numbers that it's theoretically impossible to compute? (Almost all real numbers have this property)

> Almost all real numbers have this property > Almost all I love this comment because it brings back memories of school. In a layman's terms, I think almost all in this case means all but a finite amount can we say almost all real numbers are irrational? 1 1/1 2/1 3/1 4/1 5/1 ... 2 1/2 2/2 3/2 4/2 5/2 ... 3 ... so clearly we can count all the rational numbers but how many irrational numbers are there? are there (many…

It's not a finite amount, but an amount with measure zero.
Post reply on HN