Re: Some thoughts about our tests and the build time

Markus Mohrhard <markus.mohrhard -AT- googlemail.com>
Tue, 17 May 2016 10:26:07 +0200

Hey Miklos,

On Tue, May 17, 2016 at 9:31 AM, Miklos Vajna <vmiklos@collabora.co.uk>
wrote:

Hi Markus,

On Tue, May 17, 2016 at 02:37:02AM +0200, Markus Mohrhard <
markus.mohrhard@googlemail.com> wrote:

After that the results of a time make, therefore forcing the build of
everything test related and executing the tests:

real    11m30.192s
user    58m43.384s
sys    1m36.876s

And finally a second time make to measure the time it takes to just

execute

the tests:

real    6m37.479s
user    45m4.740s
sys    0m34.988s


Is this just toplevel 'make' or 'make check'? I find it a bit strange
that we have 'make build-nocheck' to build the code, 'make check' to run
the tests, and 'make' to do something between the two -- and this
"something" is the default. ;-)


It is just a toplevel make. So it only covers unitcheck and slowcheck and
not subsequentcheck. Therefore we have no java tests in these numbers.


Also, I didn't do measurements, but my impression is that the current
hot path in 'make check' are still the Java tests, so if we want faster
'make check', then perhaps a way towards that would be to accelerate the
conversion of the majority of those Java tests to in-process ones.

Or did I miss something? :-)



As mentioned this does not include the java tests.


To make it easier to see what I'm talking about I have attached the
combined *resource.log files.

Regards,
Markus


Regards,

Miklos

_______________________________________________
LibreOffice mailing list
LibreOffice@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/libreoffice

Name = basegfx.test
UserSpace = 2.408
KernelSpace = 0
Name = basic_macros.test
UserSpace = 1.284
KernelSpace = 0.024
Name = basic_scanner.test
UserSpace = 0.052
KernelSpace = 0.004
Name = binaryurp_test-cache.test
UserSpace = 0.696
KernelSpace = 0
Name = binaryurp_test-unmarshal.test
UserSpace = 0
KernelSpace = 0.004
Name = chart2_common_functors.test
UserSpace = 0.008
KernelSpace = 0
Name = chart2_export.test
UserSpace = 156.472
KernelSpace = 1.38
Name = chart2_import.test
UserSpace = 42.976
KernelSpace = 0.172
Name = chart2_trendcalculators.test
UserSpace = 10.688
KernelSpace = 0.096
Name = comphelper_ifcontainer.test
UserSpace = 0.004
KernelSpace = 0
Name = comphelper_syntaxhighlight_test.test
UserSpace = 0.004
KernelSpace = 0
Name = comphelper_test.test
UserSpace = 0.004
KernelSpace = 0
Name = comphelper_variadictemplates_test.test
UserSpace = 0.004
KernelSpace = 0
Name = configmgr_unit.test
UserSpace = 1.46
KernelSpace = 0.012
Name = connectivity_commontools.test
UserSpace = 0.836
KernelSpace = 0.012
Name = connectivity_mork.test
UserSpace = 0.884
KernelSpace = 0.016
Name = cppcanvas_test.test
UserSpace = 0.892
KernelSpace = 0.028
Name = cppuhelper_cppu_ifcontainer.test
UserSpace = 0.004
KernelSpace = 0
Name = cppuhelper_cppu_unourl.test
UserSpace = 0.004
KernelSpace = 0
Name = cppu_qa_any.test
UserSpace = 0.004
KernelSpace = 0
Name = cppu_qa_recursion.test
UserSpace = 0
KernelSpace = 0
Name = cppu_qa_reference.test
UserSpace = 0
KernelSpace = 0
Name = cppu_qa_unotype.test
UserSpace = 0.004
KernelSpace = 0
Name = cppu_test_cppumaker.test
UserSpace = 0.004
KernelSpace = 0
Name = dbaccess_dialog_save.test
UserSpace = 1.564
KernelSpace = 0.04
Name = dbaccess_embeddeddb_performancetest.test
UserSpace = 0.924
KernelSpace = 0.024
Name = dbaccess_empty_stdlib_save.test
UserSpace = 1.64
KernelSpace = 0.032
Name = dbaccess_firebird_test.test
UserSpace = 2.008
KernelSpace = 0.084
Name = dbaccess_hsqldb_test.test
UserSpace = 2.436
KernelSpace = 0.116
Name = dbaccess_macros_test.test
UserSpace = 1.324
KernelSpace = 0.052
Name = dbaccess_nolib_save.test
UserSpace = 1.644
KernelSpace = 0.064
Name = dbaccess_RowSetClones.test
UserSpace = 5.816
KernelSpace = 0.58
Name = desktop_lib.test
UserSpace = 12.192
KernelSpace = 0.172
Name = desktop_version.test
UserSpace = 0.008
KernelSpace = 0
Name = drawinglayer_border.test
UserSpace = 0.812
KernelSpace = 0.012
Name = editeng_borderline.test
UserSpace = 0.036
KernelSpace = 0.008
Name = editeng_core.test
UserSpace = 0.952
KernelSpace = 0.024
Name = editeng_lookuptree.test
UserSpace = 0.036
KernelSpace = 0.012
Name = filter_dxf_test.test
UserSpace = 0.852
KernelSpace = 0.028
Name = filter_eps_test.test
UserSpace = 1.228
KernelSpace = 0.08
Name = filter_met_test.test
UserSpace = 0.856
KernelSpace = 0.012
Name = filter_msfilter.test
UserSpace = 0.224
KernelSpace = 0.012
Name = filter_pcd_test.test
UserSpace = 0.844
KernelSpace = 0.02
Name = filter_pcx_test.test
UserSpace = 0.788
KernelSpace = 0.008
Name = filter_pict_test.test
UserSpace = 5.536
KernelSpace = 0.24
Name = filter_ppm_test.test
UserSpace = 0.756
KernelSpace = 0.02
Name = filter_priority.test
UserSpace = 0.852
KernelSpace = 0.012
Name = filter_psd_test.test
UserSpace = 0.956
KernelSpace = 0.004
Name = filter_ras_test.test
UserSpace = 1.008
KernelSpace = 0.06
Name = filter_tga_test.test
UserSpace = 0.928
KernelSpace = 0.068
Name = filter_tiff_test.test
UserSpace = 1.272
KernelSpace = 0.088
Name = filter_xslt.test
UserSpace = 0.792
KernelSpace = 0.02
Name = hwpfilter_test_hwpfilter.test
UserSpace = 0.788
KernelSpace = 0.012
Name = i18nlangtag_test_languagetag.test
UserSpace = 0.128
KernelSpace = 0.012
Name = i18npool_test_breakiterator.test
UserSpace = 0.08
KernelSpace = 0.012
Name = i18npool_test_characterclassification.test
UserSpace = 0.06
KernelSpace = 0.012
Name = i18npool_test_ordinalsuffix.test
UserSpace = 0.068
KernelSpace = 0.004
Name = i18npool_test_textsearch.test
UserSpace = 0.068
KernelSpace = 0
Name = libreofficekit_checkapi.test
UserSpace = 0
KernelSpace = 0
Name = lotuswordpro_test_lotuswordpro.test
UserSpace = 1.536
KernelSpace = 0.048
Name = Module_DLL.test
UserSpace = 0
KernelSpace = 0
Name = o3tl_tests.test
UserSpace = 0.004
KernelSpace = 0
Name = odk_checkapi.test
UserSpace = 0.004
KernelSpace = 0
Name = officecfg_cppheader_test.test
UserSpace = 0
KernelSpace = 0
Name = oox_tokenmap.test
UserSpace = 0.088
KernelSpace = 0.016
Name = oox_vba_compression.test
UserSpace = 0.08
KernelSpace = 0.008
Name = oox_vba_encryption.test
UserSpace = 0.076
KernelSpace = 0.016
Name = package2_test.test
UserSpace = 0.804
KernelSpace = 0.02
Name = sal_bytesequence.test
UserSpace = 0
KernelSpace = 0
Name = salhelper_testapi.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_condition.test
UserSpace = 0.004
KernelSpace = 0
Name = sal_osl_file.test
UserSpace = 0.008
KernelSpace = 0.004
Name = sal_osl_getsystempathfromfileurl.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_module.test
UserSpace = 0.004
KernelSpace = 0
Name = sal_osl_mutex.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_old_test_file.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_pipe.test
UserSpace = 0.048
KernelSpace = 0.004
Name = sal_osl_process.test
UserSpace = 0.02
KernelSpace = 0
Name = sal_osl_profile.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_security.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_setthreadname.test
UserSpace = 0
KernelSpace = 0
Name = sal_osl_thread.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_alloc.test
UserSpace = 0.38
KernelSpace = 0.008
Name = sal_rtl_bootstrap.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_cipher.test
UserSpace = 0.008
KernelSpace = 0
Name = sal_rtl_crc32.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_digest.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_doublelock.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_locale.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_math.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_ostringbuffer.test
UserSpace = 0.02
KernelSpace = 0
Name = sal_rtl_oustringbuffer.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_oustring.test
UserSpace = 0.02
KernelSpace = 0
Name = sal_rtl_process.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_random.test
UserSpace = 0.304
KernelSpace = 4.364
Name = sal_rtl_ref.test
UserSpace = 0
KernelSpace = 0
Name = sal_rtl_strings.test
UserSpace = 0.004
KernelSpace = 0
Name = sal_rtl_textenc.test
UserSpace = 0.032
KernelSpace = 0
Name = sal_rtl_uri.test
UserSpace = 0.004
KernelSpace = 0
Name = sal_rtl_uuid.test
UserSpace = 0
KernelSpace = 0
Name = sal_tcwf.test
UserSpace = 0
KernelSpace = 0
Name = sal_types.test
UserSpace = 0
KernelSpace = 0
Name = sax_attributes.test
UserSpace = 0.008
KernelSpace = 0
Name = sax_parser.test
UserSpace = 0.76
KernelSpace = 0.024
Name = sax.test
UserSpace = 0.008
KernelSpace = 0.004
Name = sc_bugfix_test.test
UserSpace = 2.956
KernelSpace = 0.092
Name = sccomp_lpsolver.test
UserSpace = 1.848
KernelSpace = 0.02
Name = sc_condformats.test
UserSpace = 2.312
KernelSpace = 0.048
Name = sc_copypaste.test
UserSpace = 2.052
KernelSpace = 0.056
Name = sc_core.test
UserSpace = 0.072
KernelSpace = 0.016
Name = sc_filters_test.test
UserSpace = 38.82
KernelSpace = 0.244
Name = sc_functions_test.test
UserSpace = 1.956
KernelSpace = 0.044
Name = sc_html_export_test.test
UserSpace = 2.192
KernelSpace = 0.328
Name = sc_mark_test.test
UserSpace = 0.92
KernelSpace = 0.028
Name = sc_new_cond_format_api.test
UserSpace = 1.244
KernelSpace = 0.072
Name = sc_opencl_test.test
UserSpace = 1.34
KernelSpace = 0.024
Name = sc_rangelst_test.test
UserSpace = 1.048
KernelSpace = 0.044
Name = sc_subsequent_export_test.test
UserSpace = 95.768
KernelSpace = 0.712
Name = sc_subsequent_filters_test.test
UserSpace = 17.744
KernelSpace = 0.116
Name = sc_tiledrendering.test
UserSpace = 3.728
KernelSpace = 0.076
Name = sc_ucalc.test
UserSpace = 30.868
KernelSpace = 0.08
Name = sd_export_tests.test
UserSpace = 327.98
KernelSpace = 3.3
Name = sdext_pdfimport.test
UserSpace = 1.388
KernelSpace = 0.032
Name = sd_filters_test.test
UserSpace = 23.784
KernelSpace = 0.104
Name = sd_html_export_tests.test
UserSpace = 2.696
KernelSpace = 0.052
Name = sd_import_tests.test
UserSpace = 46
KernelSpace = 0.216
Name = sd_misc_tests.test
UserSpace = 7.344
KernelSpace = 0.048
Name = sd_svg_export_tests.test
UserSpace = 2.96
KernelSpace = 0.072
Name = sd_tiledrendering.test
UserSpace = 19.612
KernelSpace = 0.06
Name = sd_uimpress.test
UserSpace = 1.204
KernelSpace = 0.076
Name = services.test
UserSpace = 4.256
KernelSpace = 0.124
Name = sfx2_controlleritem.test
UserSpace = 0.056
KernelSpace = 0
Name = sfx2_metadatable.test
UserSpace = 0.044
KernelSpace = 0.016
Name = sot_test_sot.test
UserSpace = 15.468
KernelSpace = 0.012
Name = starmath_import.test
UserSpace = 1.284
KernelSpace = 0.044
Name = starmath_qa_cppunit.test
UserSpace = 1.664
KernelSpace = 0.04
Name = svgio.test
UserSpace = 1.076
KernelSpace = 0.028
Name = svl_inetcontenttype.test
UserSpace = 0.012
KernelSpace = 0
Name = svl_itempool.test
UserSpace = 0.012
KernelSpace = 0
Name = svl_items.test
UserSpace = 0.008
KernelSpace = 0.004
Name = svl_lngmisc.test
UserSpace = 0
KernelSpace = 0.012
Name = svl_notify.test
UserSpace = 0.012
KernelSpace = 0
Name = svl_qa_cppunit.test
UserSpace = 1.076
KernelSpace = 0.024
Name = svl_urihelper.test
UserSpace = 0.044
KernelSpace = 0.004
Name = svtools_graphic.test
UserSpace = 4.536
KernelSpace = 0.14
Name = svtools_html.test
UserSpace = 0.04
KernelSpace = 0.004
Name = svx_unit.test
UserSpace = 0.068
KernelSpace = 0.012
Name = sw_docbookexport.test
UserSpace = 6.204
KernelSpace = 0.048
Name = sw_filters_test.test
UserSpace = 62
KernelSpace = 0.564
Name = sw_globalfilter.test
UserSpace = 33.012
KernelSpace = 0.624
Name = sw_htmlexport.test
UserSpace = 11.408
KernelSpace = 0.192
Name = sw_htmlimport.test
UserSpace = 2.332
KernelSpace = 0.032
Name = sw_macros_test.test
UserSpace = 4.34
KernelSpace = 0.12
Name = sw_mailmerge.test
UserSpace = 34.168
KernelSpace = 0.412
Name = sw_odfexport.test
UserSpace = 34.436
KernelSpace = 0.452
Name = sw_odfimport.test
UserSpace = 12.656
KernelSpace = 0.124
Name = sw_ooxmlexport2.test
UserSpace = 80.068
KernelSpace = 0.848
Name = sw_ooxmlexport3.test
UserSpace = 67.572
KernelSpace = 0.788
Name = sw_ooxmlexport4.test
UserSpace = 109.824
KernelSpace = 1.5
Name = sw_ooxmlexport5.test
UserSpace = 150.38
KernelSpace = 1.332
Name = sw_ooxmlexport6.test
UserSpace = 118.584
KernelSpace = 0.96
Name = sw_ooxmlexport7.test
UserSpace = 161.948
KernelSpace = 1.552
Name = sw_ooxmlexport.test
UserSpace = 81.308
KernelSpace = 0.792
Name = sw_ooxmlfieldexport.test
UserSpace = 127.26
KernelSpace = 1.172
Name = sw_ooxmlimport.test
UserSpace = 109.244
KernelSpace = 1.08
Name = sw_ooxmlw14export.test
UserSpace = 11.624
KernelSpace = 0.168
Name = sw_rtfexport.test
UserSpace = 126.62
KernelSpace = 1.684
Name = sw_rtfimport.test
UserSpace = 61.148
KernelSpace = 0.528
Name = sw_tiledrendering.test
UserSpace = 5.388
KernelSpace = 0.076
Name = sw_uiwriter.test
UserSpace = 37.932
KernelSpace = 0.376
Name = sw_uwriter.test
UserSpace = 12.612
KernelSpace = 0.192
Name = sw_ww8export.test
UserSpace = 59.132
KernelSpace = 0.368
Name = sw_ww8import.test
UserSpace = 15.768
KernelSpace = 0.112
Name = tools_test.test
UserSpace = 0.012
KernelSpace = 0
Name = ucb_webdav_local_neon.test
UserSpace = 0.04
KernelSpace = 0
Name = unotools_fontdefs.test
UserSpace = 0.044
KernelSpace = 0
Name = unoxml_domtest.test
UserSpace = 0.792
KernelSpace = 0.012
Name = vcl_app_test.test
UserSpace = 0.036
KernelSpace = 0
Name = vcl_bitmap_test.test
UserSpace = 10.916
KernelSpace = 0.028
Name = vcl_complextext.test
UserSpace = 3.684
KernelSpace = 0.024
Name = vcl_filters_test.test
UserSpace = 2.168
KernelSpace = 0.056
Name = vcl_fontcharmap.test
UserSpace = 0.856
KernelSpace = 0.008
Name = vcl_fontmetric.test
UserSpace = 0.828
KernelSpace = 0.008
Name = vcl_font.test
UserSpace = 0.868
KernelSpace = 0.004
Name = vcl_lifecycle.test
UserSpace = 0.92
KernelSpace = 0.024
Name = vcl_mapmode.test
UserSpace = 0.844
KernelSpace = 0.012
Name = vcl_outdev.test
UserSpace = 0.82
KernelSpace = 0.02
Name = vcl_timer.test
UserSpace = 0.844
KernelSpace = 0.024
Name = vcl_wmf_test.test
UserSpace = 0.98
KernelSpace = 0.012
Name = writerfilter_misc.test
UserSpace = 0.072
KernelSpace = 0.02
Name = writerfilter_rtftok.test
UserSpace = 4.636
KernelSpace = 0.056
Name = writerperfect_calc.test
UserSpace = 14.684
KernelSpace = 0.128
Name = writerperfect_draw.test
UserSpace = 23.348
KernelSpace = 0.284
Name = writerperfect_impress.test
UserSpace = 5.172
KernelSpace = 0.088
Name = writerperfect_stream.test
UserSpace = 0.924
KernelSpace = 0.028
Name = writerperfect_writer.test
UserSpace = 30.572
KernelSpace = 0.344
Name = xmloff_uxmloff.test
UserSpace = 0.768
KernelSpace = 0.008
Name = xmlsecurity_signing.test
UserSpace = 6.132
KernelSpace = 0.168

Context

Some thoughts about our tests and the build time · Markus Mohrhard
- Re: Some thoughts about our tests and the build time · Xen
  - Re: Some thoughts about our tests and the build time · Wols Lists
- Re: Some thoughts about our tests and the build time · Miklos Vajna
  - Re: Some thoughts about our tests and the build time · Bjoern Michaelsen
  - Re: Some thoughts about our tests and the build time · Markus Mohrhard
    - Re: Some thoughts about our tests and the build time · Miklos Vajna
      - Re: Some thoughts about our tests and the build time · Markus Mohrhard
        
        Re: Some thoughts about our tests and the build time · Miklos Vajna
- Re: Some thoughts about our tests and the build time · Bjoern Michaelsen
  - Re: Some thoughts about our tests and the build time · Markus Mohrhard
    - Re: Some thoughts about our tests and the build time · Bjoern Michaelsen
- Re: Some thoughts about our tests and the build time · Michael Stahl
  - Re: Some thoughts about our tests and the build time · Bjoern Michaelsen
    - Re: Some thoughts about our tests and the build time · jan iversen
      - Re: Some thoughts about our tests and the build time · Bjoern Michaelsen

Privacy Policy | Impressum (Legal Info) | Copyright information: Unless otherwise specified, all text and images on this website are licensed under the Creative Commons Attribution-Share Alike 3.0 License. This does not include the source code of LibreOffice, which is licensed under the Mozilla Public License (MPLv2). "LibreOffice" and "The Document Foundation" are registered trademarks of their corresponding registered owners or are in actual use as trademarks in one or more countries. Their respective logos and icons are also subject to international copyright laws. Use thereof is explained in our trademark policy.