<div dir="ltr">Hi Michael,<div><br></div><div>Sorry to just getting around to responding to your question.</div><div><br></div><div>It looks like you are running out of memory on at least one compute node, but I'm guessing you already figured that out. You'll either need to reduce the data size somehow, increase the memory per core, or increase the number of cores.</div><div><br></div><div>HTH,</div><div>Cory</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 8, 2016 at 9:36 AM, Schlottke-Lakemper, Michael <span dir="ltr"><<a href="mailto:m.schlottke-lakemper@aia.rwth-aachen.de" target="_blank">m.schlottke-lakemper@aia.rwth-aachen.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
Dear all,
<div><br>
</div>
<div>We have recently come across the following error when using the D3 filter on large and distributed vtkUnstructuredGrids. We have our own reader that locally creates a vtkUnstructuredGrid by reading the according subdomain from a file in netcdf
format and I would like to use the D3 filter to have halo cells available on all domains (e.g. for gradient computations). For small scale meshes containing about 260 x 10^6 cells there is no problem. However, when I want to execute the filter on 1.8 x 10^9
cells I get the following error messages:</div>
<div><br>
</div>
<div>
<div>Warning: In /dev/shm/domini/ParaView/4.4.0/intel-para-2015.07-mpi-devel/ParaView-v4.4.0-source/VTK/Filters/Parallel/vtkPKdTree.cxx, line 207</div>
<div>vtkPKdTree (0x2943d0c0): (process 490) memory allocation on my node (BreadthFirstDivide)</div>
<div><br>
</div>
<div>ERROR: In /dev/shm/domini/ParaView/4.4.0/intel-para-2015.07-mpi-devel/ParaView-v4.4.0-source/VTK/Filters/ParallelMPI/vtkDistributedDataFilter.cxx, line 796</div>
<div>vtkDistributedDataFilter (0x29433cd0): Unable to build k-d tree structure</div>
<div><br>
</div>
<div><br>
</div>
<div>the same is happening with other remote nodes, i.e.,</div>
<div><br>
</div>
<div>
<div>Warning: In /dev/shm/domini/ParaView/4.4.0/intel-para-2015.07-mpi-devel/ParaView-v4.4.0-source/VTK/Filters/Parallel/vtkPKdTree.cxx, line 207</div>
<div>vtkPKdTree (0x2a9fdf20): (process 137) memory allocation on a remote node (BreadthFirstDivide)</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>I run a server on 576 cores using ParaView version 4.4.0. The program does not crash after this error, however, it is not creating any output. I have tracked down the error to the following (potential) location. I noticed that this error seems
to be generated in the function BreadthFirstDivision, which somehow returns the error code 1, which is then in AllCheckForFailure summarized to a value > 0 on all MPI ranks leading to the error message. I also noticed that this cannot be a VTKERROR as it is
not printed to the terminal. I believe that the error might reside in the check for midpt < -1, which would also return an error code of 1 in BreatdhFirstDivision.</div>
<div><br>
</div>
<div>I hope you can help me with this problem. Thanks a lot in advance!</div>
<div><br>
</div>
<div>Michael</div>
</div>
<br>
<br>
<div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<span style="border-collapse:separate;color:rgb(0,0,0);font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px">
<div style="word-wrap:break-word">
<span style="border-collapse:separate;color:rgb(0,0,0);font-family:Helvetica;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px">
<div style="word-wrap:break-word">
--<br>
Michael Schlottke-Lakemper<br>
<br>
Chair of Fluid Mechanics and Institute of Aerodynamics<br>
RWTH Aachen University<br>
Wüllnerstraße 5a<br>
52062 Aachen<br>
Germany<br>
<br>
Phone: <a href="tel:%2B49%20%28241%29%2080%2095188" value="+492418095188" target="_blank">+49 (241) 80 95188</a><br>
Fax: <a href="tel:%2B49%20%28241%29%2080%2092257" value="+492418092257" target="_blank">+49 (241) 80 92257</a><br>
Mail: <a href="mailto:m.schlottke-lakemper@aia.rwth-aachen.de" target="_blank">m.schlottke-lakemper@aia.rwth-aachen.de</a><br>
Web: <a href="http://www.aia.rwth-aachen.de" target="_blank">http://www.aia.rwth-aachen.de</a></div>
</span></div>
</span></div>
</div>
<br>
</div>
<br>_______________________________________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=Paraview-developers" rel="noreferrer" target="_blank">http://markmail.org/search/?q=Paraview-developers</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview-developers" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview-developers</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Cory Quammen<br>R&D Engineer<br>Kitware, Inc.</div>
</div>