RE: [libreoffice-users] a little math problem with Calc

["Dennis E. Hamilton" <dennis.hamilton@acm.org>]

What I found interesting was that Calc (in LO 3.3.2) did not have that problem:

 Have A1 hold 11.18
 Then A2 = INT(100*(A1-INT(A1)))

works just fine.

I think it would be safest to do 

  A3 = ROUND(100*(A1-INT(A1))) 

though.



-----Original Message-----
From: Steve Edmonds [mailto:steve.edmonds@ptglobal.com] 
Sent: Thursday, July 05, 2012 13:37
To: users@global.libreoffice.org
Subject: Re: [libreoffice-users] a little math problem with Calc

Hi.
I tried your function but made the last line Test = r(3).
It does return 17.

My guess is that by the completion of r(2)=r(1)*100 the value is very 
slightly less than 18 and int then produces 17.

steve

On 5/07/12 1:50 PM, alex sato wrote:
> Hi,
>
> I have a problem with functions I made.
>
> Let's say I create the function:
>
> Function Test (n)
> dim r(3)
> r(0)=int(n)
> r(1)=n-r(0)
> r(2)=r(1)*100
> r(3)=int(r(2))
> Test = r
> End Function
>
> Then, in a empty spreadsheet take the following steps:
> -select A1:D1
> -press [F2]
> -Insert the formula =TEST(E1)
> -press [CTRL]+[SHIFT]+[ENTER]
> -insert 11,18 in E1 and see the result in cell D1
>
> I think the result should be 18 but I'm getting 17
> Where is the error?
>
> By the way, I downloaded and installed the latest version of LibreOffice
> before write this email to make sure that is not a solved bug. And I tried
> this at least in 3 computers.
>
> Thanks in Advance
>
> Alex Mitsio Sato
>

-- 
For unsubscribe instructions e-mail to: users+help@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be deleted


-- 
For unsubscribe instructions e-mail to: users+help@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be deleted