Date: prev next · Thread: first prev next last
2014 Archives by date, by thread · List index


Thanks for the offer, Andrew!

The original file is definitely bigger than the allowable limit. However,
when I originally tried to import it, it opened up the first third of the
file and allowed me to save it, and reopen it. However, when I tried to
save it a second time, it crashed and the file was corrupted.

I am pretty sure the problem is not that I am running out of memory. I have
24 gig on a 64-bit machine. I think the program is just buggy when you try
to run it at its absolute outside capacity limit.

So I have figured out how to open my file in R and save subsets small
enough to open more reliably.

I wish the program checked for file size and offered a sensible list of
options when it is too big, like opening the first N rows, or opening n
rows after skipping m rows, or opening a taking a p percent sample of rows.
But perhaps that is too much to hope for in a spreadsheet.

And thanks again for your thought and attention.

Warmest regards, Andrew


On Fri, Apr 4, 2014 at 10:44 PM, Andrew Douglas Pitonyak [via Document
Foundation Mail Archive] <ml-node+s969070n4104166h4@n3.nabble.com> wrote:

On 04/04/2014 07:44 PM, andrewH wrote:

I am working with a data set that keeps causing my LibreOffice to
freeze. I
am pretty sure that this is only because it is big. It is a
pipe-separated
text from the US Economic Census imported into Calc, about 30 columns
and
around a million rows. (The actual data set is bigger, but Calc quits at
a
million-odd. The complete file is about 0.8 gig.) I suspect but can not
prove that this is related to file handling somehow, e.g. breaking down
during auto-saving. The first time I saved the data as a Calc file it
took
nearly an hour with the "soffice.bin *32" process running at 25 percent
of
CPU time and using about 825 meg of memory the entire time. (Not sure
why
this is showing up as a 32-bit version).  And when Calc freezes, all the
LibreOffice programs freeze. So I can't just switch to another file and
noodle away while waiting.

It looks to me as though Calc cannot handle more than 1048576 rows of
data,

Do you have more rows than that? If yes, then I think that you cannot
open the file.

If you have less than that, and, if you think that you are simply
running out of memory.... if you can figure out how to get the data to
me, I can run a test on a 64 bit version (running on Linux). My machine
has 32 GB of RAM...


--
Andrew Pitonyak
My Macro Document: http://www.pitonyak.org/AndrewMacro.odt
Info:  http://www.pitonyak.org/oo.php


--
To unsubscribe e-mail to: [hidden email]<http://user/SendEmail.jtp?type=node&node=4104166&i=0>
Problems?
http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be
deleted



------------------------------
 If you reply to this email, your message will be added to the discussion
below:

http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4104166.html
 To unsubscribe from Intentionally crashing LibreOffice when
frozen/LibreOffice will not start., click 
here<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4104156&code=YWhvZXJuZXJAcnByb2dyZXNzLm9yZ3w0MTA0MTU2fC0yMDQ3NjI1NDM5>
.
NAML<http://nabble.documentfoundation.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>




-- 
J. Andrew Hoerner
Director, Sustainable Economics Program
Redefining Progress
(510) 507-4820




--
View this message in context: 
http://nabble.documentfoundation.org/Intentionally-crashing-LibreOffice-when-frozen-LibreOffice-will-not-start-tp4104156p4105609.html
Sent from the Users mailing list archive at Nabble.com.
-- 
To unsubscribe e-mail to: users+unsubscribe@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/users/
All messages sent to this list will be publicly archived and cannot be deleted

Context


Privacy Policy | Impressum (Legal Info) | Copyright information: Unless otherwise specified, all text and images on this website are licensed under the Creative Commons Attribution-Share Alike 3.0 License. This does not include the source code of LibreOffice, which is licensed under the Mozilla Public License (MPLv2). "LibreOffice" and "The Document Foundation" are registered trademarks of their corresponding registered owners or are in actual use as trademarks in one or more countries. Their respective logos and icons are also subject to international copyright laws. Use thereof is explained in our trademark policy.