<div dir="ltr"><div><div>Hi,<br><br></div>Regarding the initial problem, would it be useful to add a new method Initialize(vtkMPICommunicator* comm) to vtkCPProcessor? - it should be quite straightforward to do.<br><br></div><div>Best,<br></div>Joachim<br></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><b>Joachim Pouderoux</b><br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><font size="1"><i>PhD, Technical Expert</i></font><br><b><font size="1"><a href="http://www.kitware.fr" target="_blank">Kitware SAS</a></font></b><br></blockquote>
</div></div></div>
<br><div class="gmail_quote">2016-03-10 16:48 GMT+01:00 Andy Bauer <span dir="ltr"><<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div>Hi Yohann,<br><br></div>Thanks for the info! <br><br></div>If you get some interesting results it would be great if you could share it. We've recently created some highlighted applications that use Catalyst at <a href="http://www.paraview.org/catalyst-adaptors/" target="_blank">http://www.paraview.org/catalyst-adaptors/</a>. If you'd like to have a section there on elsA, I'd be more than happy to add it in.<br><br></div>Best,<br></div>Andy<br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 10, 2016 at 5:37 AM, VAUTRIN Yohann (SAFRAN) <span dir="ltr"><<a href="mailto:yohann.vautrin@safran.fr" target="_blank">yohann.vautrin@safran.fr</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="FR"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Hi Andy,<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">I’m using elsA, a CFD package developed by ONERA in France. I was given a few links by the project manager if you want more information about the software:<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">• An Overview of the Multi-Purpose elsA Flow Solver (<a href="http://www.aerospacelab-journal.org/sites/www.aerospacelab-journal.org/files/AL2-10.pdf" target="_blank">http://www.aerospacelab-journal.org/sites/www.aerospacelab-journal.org/files/AL2-10.pdf</a>)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">• Advanced Aerodynamic Applications with the elsA Software (<a href="http://www.aerospacelab-journal.org/sites/www.aerospacelab-journal.org/files/AL2-12.pdf" target="_blank">http://www.aerospacelab-journal.org/sites/www.aerospacelab-journal.org/files/AL2-12.pdf</a>)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">• The Onera elsA CFD software : input from research and feedback from industry - L. Cambier, S. Heib, S. Plot - Mechanics & Industry, 2013<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">elsA is written in C++ (plus some Fortran routines) but possesses a user interface in Python. I’m using a mechanism in the code that calls a Python script when the internal finish state machine changes state (e.g.: at each increment, before the computation, at the end, …).<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Hope that answers your question. Let me know if you want more information ;).<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Yohann<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal" style="margin-left:35.4pt"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Andy Bauer [mailto:<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>] <br><b>Sent:</b> Wednesday, March 09, 2016 4:41 PM</span></p><div><div><br><b>To:</b> VAUTRIN Yohann (SAFRAN)<br><b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br><b>Subject:</b> Re: [Paraview] [Catalyst] Setting the MPI Comm in Python<u></u><u></u></div></div><p></p><div><div><p class="MsoNormal" style="margin-left:35.4pt"><span lang="EN-US"><u></u> <u></u></span></p><div><div><div><div><p class="MsoNormal" style="margin-right:0cm;margin-bottom:12.0pt;margin-left:35.4pt">Hi Yohann,<u></u><u></u></p></div><p class="MsoNormal" style="margin-right:0cm;margin-bottom:12.0pt;margin-left:35.4pt">Glad to hear that you were able to get it working! By the way, what simulation code are you instrumenting to use Catalyst if you don't mind saying? I'd be interested to know how it works for you.<u></u><u></u></p></div><p class="MsoNormal" style="margin-left:35.4pt">Best,<u></u><u></u></p></div><p class="MsoNormal" style="margin-left:35.4pt">Andy<u></u><u></u></p></div><div><p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p><div><p class="MsoNormal" style="margin-left:35.4pt">On Wed, Mar 9, 2016 at 5:34 AM, VAUTRIN Yohann (SAFRAN) <<a href="mailto:yohann.vautrin@safran.fr" target="_blank">yohann.vautrin@safran.fr</a>> wrote:<u></u><u></u></p><div><div><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi Andy,</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Thank you for your feedback, it helped me solve my problem.</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">If anyone is having a similar problem, what I ended up doing is:</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">import mpi4py.MPI as MPI</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">import vtk</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">comm = MPI.COMM_WORLD</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">rank = comm.Get_rank()</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">size = comm.Get_size()</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">in_subcomm = [0,3,6,9] # list of ranks to include in the VTK communicator</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">subcomm = comm.Split(1 if rank in in_subcomm else 0,rank)</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">#--- In another part of the program called only by the procs in in_subcomm</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">vtkComm = vtk.vtkMPI4PyCommunicator.ConvertToVTK(subcomm)</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">vtkCont = vtk.vtkMPIController()</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">vtkCont.SetCommunicator(vtkComm)</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><i><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">vtk.vtkMPIController.SetGlobalController(vtkCont)</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Due to the way my application works, I had to split the communicator myself, i.e. without using CreateSubController() or PartitionController() because vtk is loaded only by some procs and not every single one (a Mpi_Comm_split operation would therefore be impossible to do).</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">--</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Yohann</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Andy Bauer [mailto:<a href="mailto:andy.bauer@kitware.com" target="_blank">andy.bauer@kitware.com</a>] <br><b>Sent:</b> Sunday, March 06, 2016 12:55 PM<br><b>To:</b> VAUTRIN Yohann (SAFRAN)<br><b>Cc:</b> <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br><b>Subject:</b> Re: [Paraview] [Catalyst] Setting the MPI Comm in Python</span><u></u><u></u></p><div><div><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><div><div><div><div><p class="MsoNormal" style="margin-bottom:12.0pt;margin-left:70.8pt">Hi,<u></u><u></u></p></div><p class="MsoNormal" style="margin-bottom:12.0pt;margin-left:70.8pt">Can you use a different controller that has the same MPI processes assigned to it? If that works for you, you should be able to just create a vtkMPIController and use either CreateSubController() or PartitionController() to create one similar to what you want. Note that you may need to create two vtkMPIControllers, one that corresponds to MPI_COMM_WORLD and one for your partitioning. After you've done that you can use the vtkMPIController::SetGlobalController() to have VTK and ParaView use that for interprocess communication.<u></u><u></u></p></div><p class="MsoNormal" style="margin-left:70.8pt">Best,<u></u><u></u></p></div><p class="MsoNormal" style="margin-left:70.8pt">Andy<u></u><u></u></p></div><div><p class="MsoNormal" style="margin-left:70.8pt"> <u></u><u></u></p><div><p class="MsoNormal" style="margin-left:70.8pt">On Fri, Feb 26, 2016 at 10:09 AM, VAUTRIN Yohann (SAFRAN) <<a href="mailto:yohann.vautrin@safran.fr" target="_blank">yohann.vautrin@safran.fr</a>> wrote:<u></u><u></u></p><div><div><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">Hi,</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">I’m working on a Catalyst adaptor written in Python for one of the CFD codes I use at work and I’m having trouble setting the MPI communicator I want the vtkCPProcessor object to use (in order to use a subset of MPI_COMM_WORLD). The MPI communicator I create is a mpi4py.MPI_Comm object, which I convert to a vtkMPICommunicator object using vtk.vtkMPI4PyCommunicator.ConvertToVTK. However vtk.vtkPVCatalystPython.vtkCPProcessor.Initialize is expecting a vtkMPICommunicatorOpaqueComm object and there does not seem to be a way for me to create such an object from the Python interface. Am I missing something here or is something not wrapped correctly or wrong?</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">For the moment I use mpi4py.MPI.COMM_WORLD to test everything. The following minimal example replicates my problem:</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">import mpi4py.MPI</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">import vtk</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">comm = mpi4py.MPI.COMM_WORLD</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">coprocessor = vtk.vtkPVCatalystPython.vtkCPProcessor()</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">coprocessor.Initialize(vtk.vtkMPI4PyCommunicator.ConvertToVTK(comm))</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">The last line fails with this message:</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><i><span lang="EN-US">TypeError: Initialize argument 1: method requires a vtkMPICommunicatorOpaqueComm, a vtkMPICommunicator was provided.</span></i><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">I hope I post on the right mailing list as this could actually be a problem in VTK.</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">Thank you for your help.</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US"> </span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">Best,</span><u></u><u></u></p><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-US">Yohann V.</span><u></u><u></u></p></div><p style="margin-left:70.8pt">#<br>" Ce courriel et les documents qui lui sont joints peuvent contenir des informations confidentielles, être soumis aux règlementations relatives au contrôle des exportations ou ayant un caractère privé. S'ils ne vous sont pas destinés, nous vous signalons qu'il est strictement interdit de les divulguer, de les reproduire ou d'en utiliser de quelque manière que ce soit le contenu. Toute exportation ou réexportation non autorisée est interdite.Si ce message vous a été transmis par erreur, merci d'en informer l'expéditeur et de supprimer immédiatement de votre système informatique ce courriel ainsi que tous les documents qui y sont attachés."<br>******<br>" This e-mail and any attached documents may contain confidential or proprietary information and may be subject to export control laws and regulations. If you are not the intended recipient, you are notified that any dissemination, copying of this e-mail and any attachments thereto or use of their contents by any means whatsoever is strictly prohibited. Unauthorized export or re-export is prohibited. If you have received this e-mail in error, please advise the sender immediately and delete this e-mail and all attached documents from your computer system."<br>#<u></u><u></u></p></div><p class="MsoNormal" style="margin-bottom:12.0pt;margin-left:70.8pt"><br>_______________________________________________<br>Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br><br>Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br><br>Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a><br><br>Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" target="_blank">http://markmail.org/search/?q=ParaView</a><br><br>Follow this link to subscribe/unsubscribe:<br><a href="http://public.kitware.com/mailman/listinfo/paraview" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><u></u><u></u></p></div><p class="MsoNormal" style="margin-left:70.8pt"> <u></u><u></u></p></div></div></div></div></div><p class="MsoNormal" style="margin-left:35.4pt"><br>#<br>" Ce courriel et les documents qui lui sont joints peuvent contenir des informations confidentielles, être soumis aux règlementations relatives au contrôle des exportations ou ayant un caractère privé. S'ils ne vous sont pas destinés, nous vous signalons qu'il est strictement interdit de les divulguer, de les reproduire ou d'en utiliser de quelque manière que ce soit le contenu. Toute exportation ou réexportation non autorisée est interdite Si ce message vous a été transmis par erreur, merci d'en informer l'expéditeur et de supprimer immédiatement de votre système informatique ce courriel ainsi que tous les documents qui y sont attachés."<br>******<br>" This e-mail and any attached documents may contain confidential or proprietary information and may be subject to export control laws and regulations. If you are not the intended recipient, you are notified that any dissemination, copying of this e-mail and any attachments thereto or use of their contents by any means whatsoever is strictly prohibited. Unauthorized export or re-export is prohibited. If you have received this e-mail in error, please advise the sender immediately and delete this e-mail and all attached documents from your computer system."<br>#<u></u><u></u></p></div><p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p></div></div></div></div></div><br>#<br>
" Ce courriel et les documents qui lui sont joints peuvent contenir des informations confidentielles, être soumis aux règlementations relatives au contrôle des exportations ou ayant un caractère privé. S'ils ne vous sont pas destinés, nous vous signalons qu'il est strictement interdit de les divulguer, de les reproduire ou d'en utiliser de quelque manière que ce soit le contenu. Toute exportation ou réexportation non autorisée est interdite Si ce message vous a été transmis par erreur, merci d'en informer l'expéditeur et de supprimer immédiatement de votre système informatique ce courriel ainsi que tous les documents qui y sont attachés."<br>
******<br>
" This e-mail and any attached documents may contain confidential or proprietary information and may be subject to export control laws and regulations. If you are not the intended recipient, you are notified that any dissemination, copying of this e-mail and any attachments thereto or use of their contents by any means whatsoever is strictly prohibited. Unauthorized export or re-export is prohibited. If you have received this e-mail in error, please advise the sender immediately and delete this e-mail and all attached documents from your computer system."<br>
#<br></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">http://paraview.org/Wiki/ParaView</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">http://markmail.org/search/?q=ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><br>
<br></blockquote></div><br></div>