<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Hi Andy,</p>
<p><br>
</p>
<p>Thanks for the tips. I will get working on the VTK_DEBUG_LEAKS now and see what it turns up.
<br>
</p>
<p><br>
</p>
<p>The initialize/finalize every time is definitely a hack and not for long-term use. But, sponsors want a report on Monday and we need to be able to visualize things for that -- the simulation is too big to write data files and post-process later. So I modified
the code to do that for now until I can find a proper fix. <br>
</p>
<p><br>
</p>
<p>I'll let you know if I get stuck with the log file. <br>
</p>
<p><br>
</p>
<p>Thanks again,</p>
<p><br>
</p>
<p>Tim<br>
</p>
<br>
<br>
<div style="color: rgb(49, 55, 57);">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> Andy Bauer <andy.bauer@kitware.com><br>
<b>Sent:</b> Friday, May 20, 2016 2:39 PM<br>
<b>To:</b> Gallagher, Timothy P<br>
<b>Cc:</b> paraview@paraview.org<br>
<b>Subject:</b> Re: [Paraview] Memory leak with Catalyst</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>
<div>
<div>
<div>Hi Tim,<br>
<br>
</div>
If you build Catalyst with VTK_DEBUG_LEAKS enabled it is pretty good at finding VTK objects that aren't deleted properly. You should be able to run this with a small amount of calls to Catalyst as well. If you try this and want help understanding the output
(if an object like a vtkUnstructuredGrid is leaked it will often give a whole bunch of false leaks that the unstructured grid is just holding the references to), just share your output file and I can take a look at it to try and narrow down the culprit. That
may be slightly easier to use than Valgrind.<br>
<br>
</div>
<div>Beyond this, you could maybe try the same run but without doing any Catalyst work to see what happens then. That may be a lot of compute cycles but I'm not sure how else to try and bisect where the memory leak is occurring.<br>
</div>
<div><br>
</div>
Initializing and finalizing Catalyst every time you want output would probably work but I'd think there may be significant overhead doing it like this. Plus, it's not really solving the problem -- just avoiding it.<br>
<br>
</div>
Best,<br>
</div>
Andy<br>
<div>
<div>
<div><br>
</div>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, May 20, 2016 at 12:57 PM, Gallagher, Timothy P <span dir="ltr">
<<a href="mailto:tim.gallagher@gatech.edu" target="_blank">tim.gallagher@gatech.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div dir="ltr">
<div style="font-size:12pt; color:#000000; background-color:#ffffff; font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Hi,</p>
<p><br>
</p>
<p>One of our users is running a very big simulation and writing out images of two slices (two different views) every 1000 iterations and writing out the data for the two slices (two different data writers) as VTK files every 5000 iterations. It is using Paraview
4.4. <br>
</p>
<p><br>
</p>
<p>After 21000 iterations, the simulation is killed because the memory on the compute nodes fills up. I usually know how to track down memory problems in our code using valgrind and related tools, but is that the right way to go to try and find this problem?</p>
<p><br>
</p>
<p>Are there any tips on how to isolate where the problem may be? I don't know if it is in the adapter, or in paraview itself. Has anybody encountered problems with runaway memory using Catalyst in 4.4 when writing images or VTK files?
<br>
</p>
<p><br>
</p>
<p>I know when we use pvpython to generate images and loop over many files, sometimes the memory also blows up and so we usually move the loop over the files outside the pvpython script and into a driver script that executes a new pvpython for each file. Is
there a way to shut down/start up Catalyst each time it needs to write something? Is that advisable?
<br>
</p>
<p><br>
</p>
<p>Thanks,</p>
<p><br>
</p>
<p>Tim<br>
</p>
</div>
</div>
<br>
_______________________________________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">
http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">
http://paraview.org/Wiki/ParaView</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">
http://markmail.org/search/?q=ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>