[Cdash] Database performance

[Tim Gallagher]

I'll try the asynchronous submission which will help the timeout issue, but the huge growth in insertions should still be there which is really the problem. Inserting one build report was taking 2.5 hours before I finally killed it. 

How can I get the queries? I was just watching the processes in top which shows "postgresql: cdash cdash 127.0.0.1 [processid] UPDATE". Is there some option to log queries?

Tim

----- Original Message -----
From: "Julien Jomier" <julien.jomier at kitware.com>
To: "tim gallagher" <tim.gallagher at gatech.edu>
Cc: cdash at public.kitware.com
Sent: Friday, January 27, 2012 2:06:16 PM
Subject: Re: [Cdash] Database performance

Hi Tim,

I would recommend to enable asynchronous submissions in your 
config.local.php:

   $CDASH_ASYNCHRONOUS_SUBMISSION = true;

This will let CDash receive the XML files and then process the 
submission asynchronously, without having time-outs (hopefully). The 
only minor drawback is that submissions are not instantly showing up on 
the dashboard.

Could you send us the queries that might be taking up some time and 
we'll try to investigate.

Julien

On 27/01/2012 04:08, Tim Gallagher wrote:
> Hi,
>
> We have the following setup for tests in our code:
>
>      foreach(TESTCASE ${LESLIE_AVAILABLE_TESTCASES})
>        set(CTEST_CONFIGURE_COMMAND "./setup.py -t ${TESTCASE} '{${LESLIE_CONFIGURE_DICT_BASE}}'")
>        ctest_configure(BUILD "${CTEST_REPO_DIRECTORY}" APPEND)
>        set(CTEST_BUILD_COMMAND "./setup.py -t ${TESTCASE} '{${LESLIE_BUILD_DICT_BASE}}'")
>        ctest_build(BUILD "${CTEST_REPO_DIRECTORY}" APPEND)
>        ctest_submit(PARTS Configure Build)
>      endforeach()
>
> Each build process generates something like 20K of data based on the output from CTest. After about 10 test cases, the submissions begin to time-out with:
>
>     Error when uploading file: /data/CTestScripts/leslie-release/leslie-TestData/Testing/20120127-0230/Build.xml
>     Error message was: Operation too slow. Less than 1 bytes/sec transfered the last 120 seconds
>
> When looking at the processes running on the server during this time, postgresql is busy running UPDATE and it takes progressively longer each time a submission comes in. There are over 200 tests, so only making it through 10 is a problem.
>
> Are there any suggestions on how to improve the performance here? Is this a problem with postgresql or with the SQL statements CDash uses? Has anybody come across this?
>
> Tim
> _______________________________________________
> Cdash mailing list
> Cdash at public.kitware.com
> http://public.kitware.com/cgi-bin/mailman/listinfo/cdash
>