Results 1 to 1 of 1

Math Help - Difficult Numerical Analysis Problem

  1. #1
    Super Member
    Joined
    Feb 2008
    Posts
    535

    Difficult Numerical Analysis Problem

    Consider a computer using a positive binary floating point representation with n bits of precision in the significand. Assume that rounding is used in going from a number x outside the computer to its floating point approximation fl(x) inside the computer.

    Show that:

    -2^(e-n) <= x - fl(x) <= 2^(e-n)

    (e != 2.71 in this case. ---> -126 <= e <= 127)

    Please help. I havnt a clue... Thanks
    Last edited by jzellt; September 14th 2011 at 11:14 PM. Reason: Mis spelled word...
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Numerical Analysis Problem
    Posted in the Differential Geometry Forum
    Replies: 8
    Last Post: October 23rd 2011, 11:59 AM
  2. Numerical analysis problem
    Posted in the Advanced Applied Math Forum
    Replies: 1
    Last Post: February 22nd 2009, 01:19 PM
  3. Numerical analysis (approximation) problem
    Posted in the Calculus Forum
    Replies: 1
    Last Post: June 8th 2008, 12:52 PM
  4. Numerical Analysis problem
    Posted in the Calculus Forum
    Replies: 0
    Last Post: April 12th 2008, 06:24 PM
  5. Numerical Analysis problem
    Posted in the Advanced Algebra Forum
    Replies: 0
    Last Post: April 10th 2008, 04:44 PM

Search Tags


/mathhelpforum @mathhelpforum