| ??? 06/10/02 21:26 Read: times |
#24236 - RE: floating point optimization |
erik malund wrote:
------------------------------- My GUESS is that you have a measurement precise to say 3 digits that some salesman want displayed in 8 digits. In that case calculate the first 3 digits and set a randomly generated number in the remaining 5. We've done plenty of instrumentation jobs where the internal requirements of the calculations required 8 digit precision, not very fast, but very precise. You don't need to do many operations on 14 bit data to need 32 bit data. Steve |



