Re: [libreoffice-l10n] Pootle migration

Hi *,

On Thu, Apr 7, 2011 at 3:10 PM, Christian Lohmaier
<lohmaier+ooofuture@googlemail.com> wrote:
> On Thu, Apr 7, 2011 at 1:37 PM, Andre Schnabel <Andre.Schnabel@gmx.net> wrote:
>
> > What *we* as a team of localizers need is a working and performant
> > setup to do our translation work.
>
> Yes, and I fully agree, and that of course is also my highest measuremen/goal.

I enabled caching of static content (images, the javascript, css), so
while that has no impact on the speed of the server itself, it has
huge impact on the feel of the site for users, as now the huge part of
a request doesn't have to be re-downloaded each time (the html is less
than 20% of a typical page request). Now the browser only needs to
download the html and can use the other files from its cache.

> [...]
> * Pootle has poor performance when generating the zips for download
> (fist trigger per language and project)
> → This again is CPU bound, and again: More RAM will not help.
> [...]
> When multiple users request huge zips at the same time, all server
> processes are busy. Currently there are two, can be increased to 4,
> but that's not a big difference. It is CPU bound (and also does a
> little disk i/o) and I repeat myself once again: MORE RAM WILL NOT
> HELP!!!

As this is the real (and only) problem with the server (a few users
reuqest the zips and thus block the workers that then cannot handle
other requests until generating the zips is finished) I kept thinking
about it and the easiest solution seems to just seperate the two, i.e.
create a seperate WSGIDaemonProcess group and use that for the
export-requests.

Thus only the exporters can run out - but then only the others users
wanting the zips will have to wait, those who just want to
review/translate in pootle itself can continue their work.

Thus especially to Friedel and Dwayne and Rimas: Is there a problem with adding

WSGIDaemonProcess pootle-export threads=3 stack-size=1048576
maximum-requests=5 inactivity-timeout=1200 display-name=%{GROUP}

<Location /*/*/export/zip>
    WSGIProcessGroup pootle-export
</Location>

to the vhost's config? In turn the process lifetime of the regular
threads can then be increased again. How many of the export workers
can be allowed then is more a question of stress concurrent ones add
to the i/o (be it mysql related or raw disk i/o) and less of memory
wastage.

ciao
Christian

-- 
Unsubscribe instructions: E-mail to l10n+help@libreoffice.org
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/www/l10n/
All messages sent to this list will be publicly archived and cannot be deleted