2012 Archives by date, by thread · List index

# Re: [libreoffice-users] a little math problem with Calc

```There is no problem using formula in a cell to make the calculation. The
problem occurs only in a macro (using ooBasic). I used the Test macro just
to show my problem.
I don't know if it was expected or if it is a bug.
If it is not a bug I wish to understand why and what I could do to get what
I expect in the results.

Thanks

Alex Mitsio Sato

On Thu, Jul 5, 2012 at 7:43 PM, Dennis E. Hamilton
<dennis.hamilton@acm.org>wrote:

```
```What I found interesting was that Calc (in LO 3.3.2) did not have that
problem:

Have A1 hold 11.18
Then A2 = INT(100*(A1-INT(A1)))

works just fine.

I think it would be safest to do

A3 = ROUND(100*(A1-INT(A1)))

though.

-----Original Message-----
From: Steve Edmonds [mailto:steve.edmonds@ptglobal.com]
Sent: Thursday, July 05, 2012 13:37
To: users@global.libreoffice.org
Subject: Re: [libreoffice-users] a little math problem with Calc

Hi.
I tried your function but made the last line Test = r(3).
It does return 17.

My guess is that by the completion of r(2)=r(1)*100 the value is very
slightly less than 18 and int then produces 17.

steve

On 5/07/12 1:50 PM, alex sato wrote:
```
```Hi,

I have a problem with functions I made.

Let's say I create the function:

Function Test (n)
dim r(3)
r(0)=int(n)
r(1)=n-r(0)
r(2)=r(1)*100
r(3)=int(r(2))
Test = r
End Function

Then, in a empty spreadsheet take the following steps:
-select A1:D1
-press [F2]
-Insert the formula =TEST(E1)
-press [CTRL]+[SHIFT]+[ENTER]
-insert 11,18 in E1 and see the result in cell D1

I think the result should be 18 but I'm getting 17
Where is the error?

before write this email to make sure that is not a solved bug. And I
```
```tried
```
```this at least in 3 computers.

Alex Mitsio Sato

```
```
--
For unsubscribe instructions e-mail to: users+help@global.libreoffice.org
Problems?
http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be
deleted

--
For unsubscribe instructions e-mail to: users+help@global.libreoffice.org
Problems?
http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be
deleted

```
```
--
For unsubscribe instructions e-mail to: users+help@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be deleted
```