Re: testing commonsallayout branch

Hi,

you can find results of my testing in
http://bender.dam.fmph.uniba.sk/~milos/roundtrip/layouttext/rslt-web-mod.ods

I've tested 149 files obtained from the officeshots repository at
http://dav.officeshots.org/testsuites/. I've tested the last 5.2
released version and the master version on Windows. Linux and Mac.In the
table they are separated by a black vertical bar.

Since there is no gold standard, I took the 5.2 version on Linux as a
reference to which I've compared all other versions. Maybe that a
different one should have been taken as the reference. The results are
sorted, with the worst graded (largest differences) on top.

To see the difference it is best to view the document overlay in the
second column (labeled as THE). The first column (LND) shows the
documents side-by-side, where just large differences are visible. 3-rd
and 4-th columns show details.

Observations:
Rendering on MAC differs from that on Linux more than rendering on
Windows. This seems to be partially caused by a slightly large line
spacing on Mac. On Win and Lin letter 'g' touches table lines below
which changes number of detected lines in the document. Examples: lines
8 and 9. It is unclear if the Mac version is OK or the Win&Lin.
Another reason: incorrect drop caps in master on Mac, lines 3, 7 and 9

Improvements: lines 12, 13, 16, 17, 26-29, only on Windows, on Mac and
LINUX were OK before

Line 18: something has changed in master, which applies to all
platforms. It is not related to the layout engine

I think that each difference should be analyzed separately - sometimes
it may be caused by the layout engine, but sometimes perhaps by
something different.

I will be glad to test a different set of files, which may be eventually
more appropriate. If interpretation of the results in unclear, please ask.

best
Milos




On 2016-10-25 01:15, Khaled Hosny wrote:
> Hi,
>
> I think the daily builds would be the better as they should have any new
> fixes:
> http://dev-builds.libreoffice.org/daily/master/
>
> To enable the new layout you need to set SAL_USE_COMMON_LAYOUT
> environment variable, to disable it you need to unset the variable
> (setting it to 0 will NOT disable it as the code just check the presence
> of the variable not its value).
>
> Regards,
> Khaled
>
> On Mon, Oct 24, 2016 at 01:40:19PM +0200, Milos Sramek wrote:
> > Hi,
> >
> > to be sure that I do everything right:
> >
> > The master build should be downloaded from
> > http://dev-builds.libreoffice.org/pre-releases/win/x86_64/
> > http://dev-builds.libreoffice.org/pre-releases/mac/x86_64/
> > http://dev-builds.libreoffice.org/pre-releases/deb/x86_64/
> >
> > The builds are from October 21-st - are they already the right ones?
> >
> > How to select the layout code? Which environment settings to use?
> >
> > best
> > Milos
> >
> > On 2016-10-24 00:30, Khaled Hosny wrote:
> > > Hi,
> > >
> > > Things I’d like to test at this point:
> > > * master with and without the new layout code activated on the three
> > >   platforms. To see if we have any regressions or, hopefully, progressions.
> > > * master with the new layout code across platforms (to see if we really
> > >   getting identical results as we hope).
> > >
> > > Regards,
> > > Khaled
> > >
> > > On Fri, Oct 21, 2016 at 09:18:01PM +0200, Milos Sramek wrote:
> > > > Hi,
> > > >
> > > >
> > > > I've changed subject, since the discussion went in a different direction.
> > > >
> > > > Meanwhile I've discovered, that one can run OSX in a virtual machine :).
> > > > That fits to my environment well.
> > > >
> > > > I've tested a few random files with a few random version on Linux, Mac
> > > > and Windows. The results:
> > > > http://bender.dam.fmph.uniba.sk/~milos/roundtrip/odttest-mac-win/rslt-web.ods
> > > >
> > > > Brief explanantion:
> > > > grade 0: pixel level identical
> > > > grade 1: some differences, probably not visible
> > > > ...
> > > > Grade meaning is explained in a comment
> > > >
> > > > > is a link to pdf:
> > > > column LND: side by side
> > > > column THE: overlay
> > > > column HLPE: vertically aligned lines
> > > > column FDE: vertically and horizontally aligned
> > > >
> > > > first sheet: print test: printed by tested version (name in header) and
> > > > in reference version (LO43 on Linux) and compared
> > > > second sheet: roundtrip test: saved to odt and printed by the reference
> > > > version. No differences here
> > > >
> > > > Which versions should I test? The engines can be specified by
> > > > environment variable - I can test that too.
> > > >
> > > > Is there a way how to install multiple versions in parallel on MAC? I
> > > > can install only production and development one.
> > > >
> > > > best
> > > > Milos
> > > >
> > > >
> > > > On 2016-10-18 18:36, Khaled Hosny wrote:
> > > > > On Tue, Oct 18, 2016 at 09:06:42AM +0200, Milos Sramek wrote:
> > > > > > Dear Khaled,
> > > > > >
> > > > > > do you think that extensive comparison of rendering of numerous
> > > > > > documents with and without the new layout engine makes sense?
> > > > > > If yes, I can run my tests in such a way to see if there are any
> > > > > > differences.
> > > > > This would be extremely helpful, and more so if it can run on Windows or
> > > > > Mac.
> > > > >
> > > > > > My test documents use latin script except for a few ones in Chinese. So,
> > > > > > if you happen to have sume documents in Arabic I can add them to my test
> > > > > > set.
> > > > > I’ve a random collection of documents somewhere, I’ll clean it up and
> > > > > send it to you.
> > > > >
> > > > > Regards,
> > > > > Khaled
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > LibreOffice mailing list
> > > > > LibreOffice@lists.freedesktop.org
> > > > > https://lists.freedesktop.org/mailman/listinfo/libreoffice
> > > > -- 
> > > > email & jabber: sramek.milos@gmail.com
> > > _______________________________________________
> > > LibreOffice mailing list
> > > LibreOffice@lists.freedesktop.org
> > > https://lists.freedesktop.org/mailman/listinfo/libreoffice
> > -- 
> > email & jabber: sramek.milos@gmail.com
> _______________________________________________
> LibreOffice mailing list
> LibreOffice@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/libreoffice


-- 
email & jabber: sramek.milos@gmail.com