<div dir="ltr">Hi John,<div><br></div><div>Good news. It is now much easier to propagate meta-data and requests in VTK now. (Don't give me a hard time about not communicating this. I am working on my issues). All you need is a subclass of a vtkInformationKey that overrides CopyDefaultInformation(), probably to copy itself. Look at vtkEnsembleSource and vtkInformationDataObjectMetaDataKey to see an example. In fact, if your kd tree is a vtkDataObject subclass, you can use that key class to define a custom key like vtkEnsembleSource. No more need for keys to copy silliness.</div>
<div><br></div><div>There is also support for adding arbitrary request objects without changing executives. Look at vtkInformationIntegerRequestKey to see an example. You need a key subclass that overrides</div><div>CopyDefaultInformation(), NeedToExecute(), StoreMetaData() for that.</div>
<div><br></div><div>I will write a blog with details in the near future.</div><div><br></div><div>Best,</div><div>-berk</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Aug 27, 2014 at 7:46 AM, Biddiscombe, John A. <span dir="ltr"><<a href="mailto:biddisco@cscs.ch" target="_blank">biddisco@cscs.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-GB" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Berk,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">OK. I see how the piece requests change, but I was using the extent translator to pass bounds information and (more importantly) a PKdTree (from Zoltan) downstream
to the compositing engine to stop it from instantiating the D3 filter and performing a redundant and slow repartition when I enable transparency. My Zoltan partitioner used to add an extent translator (also containgin the KdTree) to the information in the
pipeline, which the compositing code could detect and act appropriately (with some minor tweaks).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Has the compositing code been enhanced in any way to make use of partitioning information that I can piggy-back for my needs?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">JB<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Berk Geveci [mailto:<a href="mailto:berk.geveci@kitware.com" target="_blank">berk.geveci@kitware.com</a>]
<br>
<b>Sent:</b> 27 August 2014 13:36<br>
<b>To:</b> Biddiscombe, John A.<br>
<b>Cc:</b> <a href="mailto:vtk-developers@vtk.org" target="_blank">vtk-developers@vtk.org</a>; <a href="mailto:paraview-developers@paraview.org" target="_blank">paraview-developers@paraview.org</a><br>
<b>Subject:</b> Re: [Paraview-developers] vtkStreamingDemandDrivenPipeline::EXTENT_TRANSLATOR<u></u><u></u></span></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Hi John,<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Check out:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><a href="http://www.vtk.org/Wiki/VTK/Parallel_Pipeline" target="_blank">http://www.vtk.org/Wiki/VTK/Parallel_Pipeline</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Overall, load balancing should be much easier now. The reader can make arbitrary partitioning decisions but can still get requests from downstream about partitioning. Two main strategies:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">- Downstream send extent + piece requests, reader does its own partitioning based on these two<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">- Downstream send specific extent requests to each rank (and no piece)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">The first one is appropriate to ParaView.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">This is much more robust and works through extract vois with subsampling etc. Something that never worked well in parallel.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">-berk<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, Aug 27, 2014 at 3:16 AM, Biddiscombe, John A. <<a href="mailto:biddisco@cscs.ch" target="_blank">biddisco@cscs.ch</a>> wrote:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">Recompiling my Paraview plugins against the latest version, I find that many of the vtk::Keys I use frequently are gone.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">In order to handle my dynamic load balancing, I use the extent translators (particularly my own custom ones) continuously.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Is there a replacement for this?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">thanks<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">JB<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Courier New"">--
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Courier New"">John Biddiscombe, email:biddisco @.at.@
<a href="http://cscs.ch" target="_blank">cscs.ch</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Courier New""><a href="http://www.cscs.ch/" target="_blank"><span style="color:windowtext">http://www.cscs.ch/</span></a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Courier New"">CSCS, Swiss National Supercomputing Centre | Tel:
<a href="tel:%2B41%20%2891%29%20610.82.07" target="_blank">+41 (91) 610.82.07</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="IT-CH" style="font-size:10.0pt;font-family:"Courier New"">Via Trevano 131, 6900 Lugano, Switzerland | Fax:
<a href="tel:%2B41%20%2891%29%20610.82.82" target="_blank">+41 (91) 610.82.82</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="IT-CH"> </span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Paraview-developers mailing list<br>
<a href="mailto:Paraview-developers@paraview.org" target="_blank">Paraview-developers@paraview.org</a><br>
<a href="http://public.kitware.com/mailman/listinfo/paraview-developers" target="_blank">http://public.kitware.com/mailman/listinfo/paraview-developers</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
<br>_______________________________________________<br>
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/vtk-developers" target="_blank">http://public.kitware.com/mailman/listinfo/vtk-developers</a><br>
<br>
<br></blockquote></div><br></div>