[Cdash] cdash backup directory not being cleaned up - Found word(s) remove list in the Text body

[clinton at elemtech.com]

Thanks!

Doesn't that patch fix the problem if
$CDASH_ASYNCHRONOUS_SUBMISSION = true;

I have mine left to the default, which is
$CDASH_ASYNCHRONOUS_SUBMISSION = false;

Also, I'm not using https at the moment.

Perhaps related, I've had an entry in cron to call to CDash/autoRemoveBuilds.php to clean up old builds.
Could that have messed up removal of xml files?

If I visit .../cdash/dailyupdatescurl.php?projectid=1 in my browser, the old .xml files are cleaned up.

Clint


----- Original Message -----
> Hi Clinton,
> 
> I had the same problem with the CDash 2.0.2. I discovered that cleaning of
> the backup folder was not included in the asynchronous call until it was
> fixed in the the commit 72518b1a830920845201c4ce17b571cf59e0a5e0. However,
> this commit is not included in any 2.x release yet. I am sending a patch I
> derived from the mentioned commit and applied to my 2.0.2 installation. It
> seems to get cleaned correctly since then.
> 
> Mirek
> 
> diff --git a/cdash/do_submit.php b/cdash/do_submit.php
> index 2c65689..378fc9c 100644
> --- a/cdash/do_submit.php
> +++ b/cdash/do_submit.php
> @@ -39,6 +39,11 @@ function do_submit($filehandle, $projectid,
> $expected_md5='', $do_checksum=true,
>      curl_setopt($ch, CURLOPT_FRESH_CONNECT, true);
>      curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
>      curl_setopt($ch, CURLOPT_TIMEOUT, 1);
> +    if ($CDASH_USE_HTTPS)
> +      {
> +      curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, 0);
> +      curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, 0);
> +      }
>      curl_exec($ch);
>      curl_close($ch);
>      }
> @@ -159,12 +164,28 @@ function do_submit_asynchronous($filehandle,
> $projectid, $expected_md5='')
>    if(function_exists("curl_init") == TRUE)
>      {
>      $currentURI = get_server_URI(true);
> +    $request =
> $currentURI."/cdash/dailyupdatescurl.php?projectid=".$projectid;
> +
> +    $ch = curl_init();
> +    curl_setopt($ch, CURLOPT_URL, $request);
> +    curl_setopt($ch, CURLOPT_FRESH_CONNECT, true);
> +    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
> +    curl_setopt($ch, CURLOPT_TIMEOUT, 1);
> +    if ($CDASH_USE_HTTPS)
> +      {
> +      curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, 0);
> +      curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, 0);
> +      }
> +    curl_exec($ch);
> +    curl_close($ch);
> +
>      $clientscheduleid = isset($_GET["clientscheduleid"]) ?
>      $_GET["clientscheduleid"] : 0;
>      if($clientscheduleid !== 0)
>        {
>        pdo_query("INSERT INTO client_jobschedule2submission
>        (scheduleid,submissionid) ".
>          "VALUES ('$clientscheduleid','$submissionid')");
>        }
> +    // Call process submissions via cURL.
>      $request =
>      $currentURI."/cdash/processsubmissions.php?projectid=".$projectid;
>  
>      $ch = curl_init();
> 
> -----Original Message-----
> From: Cdash [mailto:cdash-bounces at public.kitware.com] On Behalf Of Julien
> Jomier
> Sent: Saturday, March 28, 2015 7:51 PM
> To: David Cole; Clinton Stimpson
> Cc: cdash
> Subject: [SPAM] - Re: [Cdash] cdash backup directory not being cleaned up -
> Found word(s) remove list in the Text body
> 
> Dave, Clinton,
> 
> I'm guessing the asynchronous call is not working properly.
> Are you getting daily file changed at the top of the dashboard?
> 
> Can you try to call the dailyupdates directly from your browser?
> Something like:
> 
>    http://localhost/CDash/cdash/dailyupdatescurl.php?projectid=1
> 
> with the projectid being the id of your project.
> 
> Let me know if that works (or not),
> Julien
> 
> > On Fri, Mar 27, 2015 at 1:19 PM, Clinton Stimpson <clinton at elemtech.com>
> > wrote:
> >> Hi,
> >>
> >> I have another problem with cdash.
> >>
> >> The backup directory contains the submitted .xml files.
> >> I have in my cdash/config.php file
> >> $CDASH_BACKUP_TIMEFRAME = '48'; // 48 hours
> >>
> >> According to this, the .xml files older than 48 hours are supposed to
> >> be cleaned up when new submissions arrive.
> >> http://www.vtk.org/Wiki/CDash:Administration#Backup_mechanism
> >>
> >> This is not the case for me.  My backup directory is accumulating and
> >> contains files from the distant past.  Much more than 48 hours ago.
> >>
> >> Is anyone else seeing this, or could it be specific to my setup?
> >> For example, I install cdash in a version specific folder, and then
> >> make a softlink for apache.  I don't know if something like that
> >> would prevent the cleanup.  Permissions shouldn't be a problem
> >> because apache can put the files there, so it should be able to remove
> >> them.
> >>
> >> Clint
> _______________________________________________
> Cdash mailing list
> Cdash at public.kitware.com
> http://public.kitware.com/mailman/listinfo/cdash
>