On Fri, 2010-11-19 at 16:03 +0000, Caolán McNamara wrote:
On Fri, 2010-11-19 at 01:32 +0100, Miklos Vajna wrote:I'm asking because I guess the more complex to run it, the fewer people will actually try it out at all.True. I was sort of wondering about potential colossal size. But sure I guess a separate repo for megatest, optional like l10n in the normal course of things, and a "make check" would do the trick for me.
Oh - incidentally; the KDE guys already have quite a nice test suite here: svn co svn://anonsvn.kde.org/home/kde/trunk/tests/kofficetests/ Warning: quite big ;-) I suggest we work with them to grow that - they seemed open to that. We could also use git-svn to move / mirror and add to it on freedesktop.org. Let me know if I should create a new repository for that. It'd would also be great to have some people to look through the tests to see what (if anything) breaks us, and/or we are missing, and/or do the shell instrumentation to simply load, save, and close all of those files :-) In fact - this is a really useful test; I ran an soffice under gdb, and then: for a in `find /opt/OpenOffice/kofficetests/interoperability -type f | grep -v '\.svn/'`; do ./soffice $a; sleep 1; done It failed after only a handful of documents on the attached with: #0 0xabd83b95 in writerfilter::dmapper::DomainMapper_Impl::finishParagraph(boost::shared_ptr<writerfilter::dmapper::PropertyMap>) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #1 0xabd6e446 in writerfilter::dmapper::DomainMapper::utext(unsigned char const*, unsigned int) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #2 0xabcc17c6 in writerfilter::ooxml::OOXMLFastContextHandler::endOfParagraph() () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #3 0xabc1fefd in writerfilter::ooxml::OOXMLFactory_wml::endAction(writerfilter::ooxml::OOXMLFastContextHandler*) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #4 0xabca302d in writerfilter::ooxml::OOXMLFactory::endAction(writerfilter::ooxml::OOXMLFastContextHandler*, long) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #5 0xabcbda5a in writerfilter::ooxml::OOXMLFastContextHandler::lcl_endFastElement(long) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #6 0xabcbd45f in writerfilter::ooxml::OOXMLFastContextHandler::endFastElement(long) () from /data/opt/OOInstall/program/../basis-link/program/libwriterfilterli.so #7 0xabf86c65 in sax_fastparser::FastSaxParser::callbackEndElement(char const*) () from /data/opt/OOInstall/program/../basis-link/program/fastsax.uno.so So ... I am certain, that simply building a large collection of documents exercising our various features, and then loading / saving / closing them all in a big long churning run every now and then would catch a ton of bugs for us :-) Any volunteers to play with it ? Thanks, Michael. -- michael.meeks@novell.com <><, Pseudo Engineer, itinerant idiot
Attachment:
mw07_template_urban_merge_fax.docx
Description: MS-Word 2007 document