<div dir="ltr"><div><div><div><div><div>Hi Tim,<br><br></div>If I remember correctly, that was VTK's suggested way at that time with dealing with arrays that had different memory layouts than VTK used (and yes, I think I may have put that in the code). In PV master now there's a much better way of doing it (it's not in PV 5.0.1 but will be in PV 5.1). If you use the vtkSOADataArrayTemplate class it will save on memory and be more efficient. An example looks like:<br> vtkSOADataArrayTemplate<double>* coords = vtkSOADataArrayTemplate<double>::New();<br> coords->SetNumberOfComponents(3);<br> coords->SetNumberOfTuples(this->NumPoints);<br> coords->SetArray(0, this->CoordsArray, this->NumPoints, false, true);<br> coords->SetArray(1, this->CoordsArray+this->NumPoints, this->NumPoints, false, true);<br> coords->SetArray(2, this->CoordsArray+this->NumPoints*2, this->NumPoints, false, true);<br><br></div>Here, CoordsArray is a double* that stores the coordinates in SOA form (x0, x1, x2, ..., y0, y1, y2, ..., z0, z1, z2, ...) and NumPoints is the number of points in the array (i.e. the length of the array divided by 3). Some very fine details are at <a href="http://www.vtk.org/Wiki/VTK/Tutorials/DataArrays">http://www.vtk.org/Wiki/VTK/Tutorials/DataArrays</a> if you want to read more about it but that's really for people writing VTK filters and stuff like that.<br><br></div>As for the warning, you can comment that out in the code if it's generating too much noise.<br><br></div>Best,<br></div>Andy<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 10, 2016 at 12:35 AM, Gallagher, Timothy P <span dir="ltr"><<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Ah hah, the errors were being sent somewhere else and not caught properly by my submission script.
<br>
</p>
<p><br>
</p>
<p>I found the error and now it works, I get my images and my VTK files. The only warnings now are:</p>
<p><br>
</p>
<p><span>24vtkCPTensorArrayTemplateIdE (0x23b4320): GetVoidPointer called. This is very expensive for vtkMappedDataArray subclasses, since the scalar array must be generated for each call. Consider using a vtkTypedDataArrayIterator instead.</span></p>
<p><br>
</p>
<p>which is something I can deal with later. I have to figure out what the vtkCPTensorArrayTemplate does exactly -- I believe that was something you had added when you took a look at our code awhile back. But it doesn't seem to matter for what we're doing now.
<br>
</p>
<p><br>
</p>
<p>It feels good to close the ticket in our tracker about getting coprocessing on Crays -- it's been open since 2012.
<br>
</p>
<br>
<p>Thanks again for all your help.</p>
<p><br>
</p>
<p>Tim<br>
</p>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Andy Bauer <<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>><br>
<b>Sent:</b> Monday, May 9, 2016 10:41 PM<span class=""><br>
<b>To:</b> Gallagher, Timothy P<br>
<b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br>
<b>Subject:</b> Re: [Paraview] Linking to Catalyst</span></font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>
<div>
<div>
<div>
<div>Hi Tim,<br>
<br>
</div><span class="">
I assume that writing out a data set works on other machines, correct? Can you try the gridwriter.py script at
<a href="https://gitlab.kitware.com/paraview/paraview/blob/master/Examples/Catalyst/SampleScripts/gridwriter.py" target="_blank">
https://gitlab.kitware.com/paraview/paraview/blob/master/Examples/Catalyst/SampleScripts/gridwriter.py</a> to output the full data set? It should work with PV 4.4. Note that outputs a full data set every time step. I'm not sure about Python warnings or errors
but the C++ warnings and errors will be sent to std::cerr instead of std::cout.
</span><div style="margin-bottom:20px;overflow:auto;width:100%;text-indent:0px">
<table style="width:90%;background-color:rgb(255,255,255);overflow:auto;padding-top:20px;padding-bottom:20px;margin-top:20px;border-top:1px dotted rgb(200,200,200);border-bottom:1px dotted rgb(200,200,200)" cellspacing="0">
<tbody>
<tr style="border-spacing:0px" valign="top">
<td colspan="1" style="width:250px;display:table-cell;padding-right:20px">
<div style="background-color:rgb(255,255,255);min-height:250px;margin:auto;display:table;width:250px">
<a href="https://gitlab.kitware.com/paraview/paraview/blob/master/Examples/Catalyst/SampleScripts/gridwriter.py" style="display:table-cell;text-align:center" target="_blank"><img style="display:inline-block;margin-left:auto;margin-right:auto;max-width:250px;max-height:250px;min-height:250px;width:250px;border-width:0px;vertical-align:bottom" src="https://gitlab.kitware.com/uploads/project/avatar/14/pvIcon-512x512.png" height="250" width="250"></a></div>
</td>
<td colspan="2" style="vertical-align:top;padding:0px;display:table-cell">
<div></div>
<div style="color:rgb(17,111,160);font-weight:400;font-size:21px;font-family:"wf_segoe-ui_light","Segoe UI Light","Segoe WP Light","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;line-height:21px">
<a href="https://gitlab.kitware.com/paraview/paraview/blob/master/Examples/Catalyst/SampleScripts/gridwriter.py" style="text-decoration:none" target="_blank">Examples/Catalyst/SampleScripts/gridwriter.py ·
master · ParaView / ParaView</a></div>
<div style="margin:10px 0px 16px;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:14px">
<a href="http://gitlab.kitware.com" target="_blank">gitlab.kitware.com</a></div>
<div style="display:block;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:20px;max-height:100px;overflow:hidden">
Parallel Data Analysis and Visualization Application based on VTK.</div>
</td>
</tr>
</tbody>
</table>
</div>
<br>
<br>
</div><div><div class="h5">
Did you make the script with PV 4.4? The PV Python API has some changes (especially for rendering) between revisions. I think the best option is to just comment out the parts that are causing trouble.<br>
<br>
</div></div></div><div><div class="h5">
If you're still having issues, maybe send your full script along with std::cout and std::cerr outputs so I can get a little deeper into the issues.<br>
<br>
</div></div></div>
Good luck,<br>
</div>
Andy<br>
</div><div><div class="h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, May 9, 2016 at 6:14 PM, Gallagher, Timothy P <span dir="ltr">
<<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Okay, really close to finally crossing this off my list -- it's been on it for years.
<br>
</p>
<p><br>
</p>
<p>I can get the code to generate images but it won't save data files. I don't get any errors and I get my images, just no VTK files. I have tried the default that the catalyst generator creates:</p>
<p><br>
</p>
<p><span>parallelMultiBlockDataSetWriter1 = servermanager.writers.XMLMultiBlockDataWriter(Input=slice1)</span></p>
<p><span>coprocessor.RegisterWriter(parallelMultiBlockDataSetWriter1, filename='slices_%t.vtm', freq=freq_file)</span></p>
<p><br>
</p>
<p>and I tried another form that the grid writer you've send me in the past used:</p>
<p><br>
</p>
<p><span>writer = coprocessor.CreateWriter(XMLMultiBlockDataWriter, filename='slices_%t.vtm', freq=freq_file)</span></p>
<p><br>
</p>
<p>in all cases, freq_file = 1000.</p>
<p><br>
</p>
<p>Neither one will output any vtk files. <br>
</p>
<p><br>
</p>
<p>Any thoughts?</p>
<p><br>
</p>
<p>Also, minor note but it is kind of annoying -- both the catalyst generator and the trace generator seem to do this, but they add commands that set attributes that are not part of the classes when run through the python script. For example, I had to comment
out:</p>
<p><br>
</p>
<p></p>
<div># slice1Display.SelectInputVectors = ['CELLS', 'Velocity [m/s]'] <br>
# slice1Display.WriteLog = '' </div>
<p></p>
<p><br>
</p>
<p>Any ideas why it does that? Or is there a way (and downfall) to just let it add attributes without manually calling add_attribute() each time?<br>
</p>
<p><br>
</p>
<p>Tim<br>
</p>
<br>
<br>
<div style="color:rgb(49,55,57)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> ParaView <<a href="mailto:paraview-bounces@paraview.org" target="_blank">paraview-bounces@paraview.org</a>> on behalf of Gallagher, Timothy P <<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>><br>
<b>Sent:</b> Monday, May 9, 2016 5:13 PM<br>
<b>To:</b> Andy Bauer
<div>
<div><br>
<b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br>
<b>Subject:</b> Re: [Paraview] Linking to Catalyst</div>
</div>
</font>
<div> </div>
</div>
<div>
<div>
<div>
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Yeah -- okay, pointing it to the build directory instead of the install made sure everything was found.
<br>
</p>
<p><br>
</p>
<p>One step closer to getting this working on Cray.<br>
</p>
<p><br>
</p>
<p>Thanks,</p>
<p><br>
</p>
<p>Tim<br>
</p>
<br>
<br>
<div style="color:rgb(49,55,57)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Andy Bauer <<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>><br>
<b>Sent:</b> Monday, May 9, 2016 4:54 PM<br>
<b>To:</b> Gallagher, Timothy P<br>
<b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br>
<b>Subject:</b> Re: [Paraview] Linking to Catalyst</font>
<div> </div>
</div>
<div>
<div dir="ltr">Hmm, that could be a bug in the superbuild. The superbuild arguments aren't all passed to the ParaView build itself and it could be that this option was missing for the PV specific build part. Instead of doing the whole build from scratch, I'd
suggest you just search for the ParaViewConfig.cmake file to find where PV was actually built and just point to that.<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, May 9, 2016 at 4:50 PM, Gallagher, Timothy P <span dir="ltr">
<<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Well shoot, it looks like I didn't build with the install development files on, even though I set it when I configured the superbuild. I must have done that part wrong<br>
</p>
<br>
<p>My configure line is:</p>
<p><br>
</p>
<p></p>
<div>cmake \<br>
-DCMAKE_INSTALL_PREFIX:PATH=${HOME}/pv-test/${version}_osmesa \<br>
-DCMAKE_BUILD_TYPE=Release \</div>
...
<p></p>
<p></p>
<div>-DPARAVIEW_ENABLE_CATALYST=ON \<br>
-DPARAVIEW_ENABLE_PYTHON=ON \<br>
-DPARAVIEW_INSTALL_DEVELOPMENT_FILES=ON \<br>
-DPARAVIEW_BUILD_QT_GUI=OFF \<br>
-DBUILD_TESTING=OFF \<br>
-DVTK_USE_X=OFF \<br>
</div>
...
<p></p>
<p></p>
<div>-DVTK_OPENGL_HAS_OSMESA=ON \<br>
-DOSMESA_INCLUDE_DIR:STRING="${INSTALLPATH}/osmesa/include" \<br>
-DOSMESA_LIBRARY:STRING="${INSTALLPATH}/osmesa/lib/libOSMesa.so" \<br>
./ParaViewSuperbuild<br>
</div>
<p></p>
<p><br>
</p>
<p>and all of the other PARAVIEW* options seemed to pass through properly when the superbuild made paraview. Any ideas why that option didn't pass through?</p>
<p><br>
</p>
<p>Thanks -- I knew it had to be something really obvious!</p>
<p><br>
</p>
<p>Tim</p>
<p><br>
</p>
<p><br>
</p>
<div style="color:rgb(49,55,57)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Andy Bauer <<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>><br>
<b>Sent:</b> Monday, May 9, 2016 4:43 PM<br>
<b>To:</b> Gallagher, Timothy P<br>
<b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br>
<b>Subject:</b> Re: [Paraview] Linking to Catalyst</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>
<div>
<div><span>
<div>Hi Tim,<br>
<br>
</div>
Is the PV directory you're pointing to a build directory or an install directory? If it's an install directory you'll need to enable PARAVIEW_INSTALL_DEVELOPMENT_FILES. Other than that, my suggestion would be to try linking one of the Catalyst examples from
<a href="https://github.com/Kitware/ParaViewCatalystExampleCode" target="_blank">
https://github.com/Kitware/ParaViewCatalystExampleCode</a> and see how that works for you. Another thing you could try is using a newer version of CMake from
<a href="https://cmake.org/download/" target="_blank">https://cmake.org/download/</a>. For the Linux x86_64 tarball, you can just untar the executables from that and use directly.
</span>
<div style="margin-bottom:20px;overflow:auto;width:100%;text-indent:0px">
<table style="width:90%;background-color:rgb(255,255,255);overflow:auto;padding-top:20px;padding-bottom:20px;margin-top:20px;border-top:1px dotted rgb(200,200,200);border-bottom:1px dotted rgb(200,200,200)" cellspacing="0">
<tbody>
<tr style="border-spacing:0px" valign="top">
<td colspan="1" style="width:250px;display:table-cell;padding-right:20px">
<div style="background-color:rgb(255,255,255);min-height:250px;margin:auto;display:table;width:250px">
<a href="https://github.com/Kitware/ParaViewCatalystExampleCode" style="display:table-cell;text-align:center" target="_blank"><img style="display:inline-block;margin-left:auto;margin-right:auto;max-width:250px;max-height:250px;min-height:250px;width:250px;border-width:0px;vertical-align:bottom" src="https://avatars3.githubusercontent.com/u/87549?v=3&s=400" height="250" width="250"></a></div>
</td>
<td colspan="2" style="vertical-align:top;padding:0px;display:table-cell">
<div></div>
<div style="color:rgb(17,111,160);font-weight:400;font-size:21px;font-family:"wf_segoe-ui_light","Segoe UI Light","Segoe WP Light","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;line-height:21px">
<a href="https://github.com/Kitware/ParaViewCatalystExampleCode" style="text-decoration:none" target="_blank">GitHub - Kitware/ParaViewCatalystExampleCode: Example ...</a></div>
<div style="margin:10px 0px 16px;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:14px">
<a href="http://github.com" target="_blank">github.com</a></div>
<div style="display:block;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:20px;max-height:100px;overflow:hidden">
ParaViewCatalystExampleCode - Example problems and snippets of code to demonstrate ParaView's Catalyst.</div>
</td>
</tr>
</tbody>
</table>
</div>
<br>
<br>
</div>
<div>
<div>Let us know if none of those ideas don't work for you.<br>
<br>
</div>
</div>
</div>
Best,<br>
</div>
Andy<br>
</div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, May 9, 2016 at 3:58 PM, Gallagher, Timothy P <span dir="ltr">
<<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Hello again,</p>
<p><br>
</p>
<p>I'm (finally) trying to get Catalyst to successfully link to our application code on Excalibur (Cray, ARL HPC). I was able to build paraview and all of the dependencies thanks to help I've gotten on the list here in the past. However, when I try to link
my code to it (and this is a code that works fine with Catalyst on other platforms), I get:</p>
<p><br>
</p>
<p></p>
<div> CMake Error at /p/home/tgallagh/pv-test/4.4.0_osmesa/lib/cmake/paraview-4.4/vtkModuleAPI.cmake:120 (message):<br>
Requested modules not available:<br>
<br>
vtkPVPythonCatalyst<br>
Call Stack (most recent call first):<br>
/p/home/tgallagh/pv-test/4.4.0_osmesa/lib/cmake/paraview-4.4/VTKConfig.cmake:80 (vtk_module_config)<br>
/p/home/tgallagh/pv-test/4.4.0_osmesa/lib/cmake/paraview-4.4/ParaViewConfig.cmake:49 (include)<br>
CMakeLists.txt:218 (find_package)<br>
<br>
The section in my CMakeLists that looks for paraview is:<br>
<br>
<div>option(LESLIE_USE_COPROCESSING "Turn on CoProcessing with Paraview" OFF)<br>
if(LESLIE_USE_COPROCESSING)<br>
find_package(ParaView REQUIRED vtkPVPythonCatalyst<br>
HINTS $ENV{PARAVIEW_CP_ROOT})<br>
include(${PARAVIEW_USE_FILE})<br>
include_directories(${PROJECT_SOURCE_DIR}/utils)<br>
add_definitions(-DPARAVIEW_COPROCESSING)<br>
endif()<br>
mark_as_advanced(LESLIE_USE_COPROCESSING)<br>
</div>
<br>
</div>
and it doesn't seem to work. On other machines, I never needed to set the PARAVIEW_CP_ROOT variable, it always just found it. When I build my code, I point the paraview directory (where it finds the paraviewConfig.cmake file) to:
<p></p>
<p><br>
</p>
<p><span>/p/home/tgallagh/pv-test/4.4.0_osmesa/lib/cmake/paraview-4.4</span></p>
<p><br>
</p>
<p>and it seems to find it okay. <br>
</p>
<p><br>
</p>
<p>Lastly, the vtkPVPythonCatalyst.so library is in the lib/paraview-4.4/site-packages/vtk directory and there is
<a href="http://libvtkPVPythonCatalyst-pv4.4.so" target="_blank">libvtkPVPythonCatalyst-pv4.4.so</a>* and
<a href="http://libvtkPVPythonCatalystPython27D-pv4.4.so" target="_blank">libvtkPVPythonCatalystPython27D-pv4.4.so</a>* in lib/paraview-4.4/<br>
</p>
<p><br>
</p>
<p>I'm at a loss to understand why it is reporting the module is missing -- did I miss something somewhere?
<br>
</p>
<p><br>
</p>
<p>Thanks as always,</p>
<p><br>
</p>
<p>Tim<br>
</p>
</div>
</div>
<br>
_______________________________________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">
http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">
http://paraview.org/Wiki/ParaView</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">
http://markmail.org/search/?q=ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div></div></div>
</div>
</div>
</div>
</blockquote></div><br></div>