[Dart] offered: Perl script, wanted: Dart XML help
Blezek, Daniel J (GE, Research)
blezek at crd.ge.com
Tue May 29 10:08:37 EDT 2007
Scott,
You are right, this is indeed a shortcoming of the documentation, and something we've always wanted to address. As much as I dislike the "special" tests, there is really no way around it with our current design. Proper documentation would ease the pain.
It's going to be a Dart month in June, so perhaps much more will documentation will be forthcoming.
-dan
-----Original Message-----
From: dart-bounces+blezek=crd.ge.com at public.kitware.com [mailto:dart-bounces+blezek=crd.ge.com at public.kitware.com] On Behalf Of Scott Oster
Sent: Tuesday, May 29, 2007 10:02 AM
To: dart at public.kitware.com
Subject: RE: [Dart] offered: Perl script, wanted: Dart XML help
I don't remember the details of lack of intersection between Dart.pdf and the actual code (it's been quite a while since I looked at it). However, I do recall lack of documentation (at least then) on "Note" and especially "Update." Also the requirements on test "nesting" was unclear without looking at the code (for example Update.Update.Update); this is still an issue my code has on Build errors (there's some restriction on error nesting, which I don't follow). Though I seem to recall past discussion on the list indicating that was more of a bug.
The Dart documentation is actually pretty good. The main thing that would have made it much easier to generate test files from external code, would be an XSD for the file format, and some feature exhaustive example files (which can be hard to come by for Dart newcomers).
Scott
Scott Oster
Senior Research Specialist
Biomedical Informatics Department
Ohio State University
oster at bmi.osu.edu
lab: 614-292-9845
voice mail: 614-292-8680
> -----Original Message-----
> From: dart-bounces+oster=bmi.osu.edu at public.kitware.com [mailto:dart-
> bounces+oster=bmi.osu.edu at public.kitware.com] On Behalf Of Blezek,
> Daniel J (GE, Research)
> Sent: Tuesday, May 29, 2007 9:40 AM
> To: Scott Oster; Ken Cox; dart at public.kitware.com
> Subject: RE: [Dart] offered: Perl script, wanted: Dart XML help
>
> Scott,
>
> Would you mind sending a short list of the "special tests" that I
> baked into Dart? I would be happy to document them.
>
> -dan
>
> -----Original Message-----
> From: dart-bounces+blezek=crd.ge.com at public.kitware.com [mailto:dart-
> bounces+blezek=crd.ge.com at public.kitware.com] On Behalf Of Scott Oster
> Sent: Tuesday, May 22, 2007 12:32 PM
> To: Ken Cox; dart at public.kitware.com
> Subject: RE: [Dart] offered: Perl script, wanted: Dart XML help
>
> This may or may not be of help (depending on whether you are familiar
> with XSL)...
> Here's an XSL transform I wrote to translate cruisecontrol log files
> into dart submissions:
> http://gforge.nci.nih.gov/plugins/scmcvs/cvsweb.php/cagrid-1-
> 0/caGrid/test/CC2DART.xsl?rev=1.11;cvsroot=cagrid-1-0
> All of the results here are submitted by it:
> http://quality.cagrid.org:8081/caGrid-1.0/Dashboard/
>
> The reason I point it out is I had to do some DART2 code digging to
> find the "special tests." I believe this was extracted from here:
> http://svn.na-
> mic.org/svn/Dart/trunk/Source/dart/Resources/Server/TestProcessorRules.
> xml
>
> The one issue this still has is build errors are not rolled up
> properly due to a limitation of the way DART expects test errors to be named.
>
> Scott
>
>
> Scott Oster
>
> Senior Research Specialist
> Biomedical Informatics Department
> Ohio State University
> oster at bmi.osu.edu
> lab: 614-292-9845
> voice mail: 614-292-8680
>
>
> > -----Original Message-----
> > From: dart-bounces+oster=bmi.osu.edu at public.kitware.com
> > [mailto:dart-
> > bounces+oster=bmi.osu.edu at public.kitware.com] On Behalf Of Ken Cox
> > Sent: Tuesday, May 22, 2007 12:14 PM
> > To: dart at public.kitware.com
> > Subject: [Dart] offered: Perl script, wanted: Dart XML help
> >
> > Thanks to those who documented Dart XML! However, I still have a
> > couple of problems:
> >
> > 1) Empty Time. When I submit the test-results.xml below, the Time
> > column is blank on the Dashboard under Test (the Time column is
> > correct on the TestCatalog page). With the build-results.xml, the
> > Time column says 0.0.
> > 2) Empty Output. When I push down to the specific test page, the
> Test
> > Output section is blank.
> > 2) Not on same line. I want to submit Build results separately, but
> > have them displayed on the same line as the Test results. I tried
> > setting <DateTimeStamp> to the exact same value but still got two
> > separate lines on the Dashboard.
> >
> > If you can offer any help I would greatly appreciate it. If you can
> > point me at the area of the code which parses or describes the
> > "built in"
> > Measurement names, it would probably be good enough.
> >
> > Here's my offer: I have perl scripts that I use to run tests written
> > in the perl test harness and submit them to Dart. If you would be
> > interested in these scripts, let me know, and I'll polish them just
> > a little and share them. Here are the scripts:
> >
> > dart-run-tests - run perl tests and submit the results to dart
> using
> > dart-submit
> > dart-submit - given an XML template file and name/value pairs,
> > substitute name/value pairs into the template file and submit the
> > result to Dart.
> >
> > Here are the results I submitted that don't work as I wanted:
> >
> > ------ build-results.xml
> > ----------------------------------------------
> > ---
> > <?xml version="1.0" encoding="utf-8"?> <DartSubmission version="2.0"
> > createdby="ArchiveTask">
> > <Site>sample-site</Site>
> > <BuildName>sample-build</BuildName>
> > <Track>Nightly</Track>
> > <DateTimeStamp>2007-05-22T11:10:00-0400</DateTimeStamp>
> > <Test>
> > <Name>.Build.makeall</Name>
> > <Status>passed</Status>
> > <Measurement name="StageName" type="text/string">make-
> > all</Measurement>
> > <Measurement name="BuildCommand" type="text/string">make
> > all</Measurement>
> > <Measurement name="ElapsedMinutes"
> > type="numeric/float">1.5</Measurement>
> > <Measurement name="TimeInSeconds"
> > type="numeric/float">90.1</Measurement>
> > <Measurement name="Execution Time"
> > type="numeric/float">90.2</Measurement>
> > <Measurement name="Message" type="text/string">message
> > here</Measurement>
> > <Measurement name="Output" type="text/string">output
> > here</Measurement>
> > <Log>log here</Log>
> > </Test>
> > </DartSubmission>
> > ------ test-results.xml
> > -----------------------------------------------
> > ---
> > <?xml version="1.0" encoding="utf-8"?> <DartSubmission version="2.0"
> > createdby="ArchiveTask">
> > <Site>sample-site</Site>
> > <BuildName>sample-build</BuildName>
> > <Track>Nightly</Track>
> > <DateTimeStamp>2007-05-22T11:10:00-0400</DateTimeStamp>
> > <Test>
> > <Name>.Test.test-name</Name>
> > <Status>passed</Status>
> > <Measurement name="TotalTests"
> > type="numeric/integer">4</Measurement>
> > <Measurement name="PassedTests"
> > type="numeric/integer">3</Measurement>
> > <Measurement name="FailedTests"
> > type="numeric/integer">1</Measurement>
> > <Measurement name="Execution Time"
> > type="numeric/float">12.34</Measurement>
> > <Measurement name="Output" type="text/string">output
> > here</Measurement>
> > <Log>log here</Log>
> > </Test>
> > </DartSubmission>
> > --------------------------------------------------
> >
> > Thanks and Regards,
> > Ken Cox
> > Vivox, Inc.
> > _______________________________________________
> > Dart mailing list
> > Dart at public.kitware.com
> > http://public.kitware.com/mailman/listinfo/dart
> _______________________________________________
> Dart mailing list
> Dart at public.kitware.com
> http://public.kitware.com/mailman/listinfo/dart
> _______________________________________________
> Dart mailing list
> Dart at public.kitware.com
> http://public.kitware.com/mailman/listinfo/dart
_______________________________________________
Dart mailing list
Dart at public.kitware.com
http://public.kitware.com/mailman/listinfo/dart
More information about the Dart
mailing list