<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Don’t forget that each pvserver can’t tell that it is sharing the memory with siblings. Thus, you care about memory use at the node or computer level.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In theory you are correct regarding D3. It rebalances work, and also creates ghost cells around processor boundaries. But, it is an old, somewhat moody filter. Further, it increases memory footprint significantly (at least copies the
data). If you can work without it, do so. Generally, if you are slow, you need more nodes or less data. In practice, the D3 filter won’t speed you up.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Alan<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Quentin d'Avout [mailto:quentin@arrivo-loop.com]
<br>
<b>Sent:</b> Wednesday, October 18, 2017 1:04 PM<br>
<b>To:</b> Scott, W Alan <wascott@sandia.gov>; ParaView <paraview@paraview.org><br>
<b>Subject:</b> RE: [EXTERNAL] [Paraview] D3 filter crash<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><a name="_MailEndCompose">Hi Alan,<o:p></o:p></a></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose">The memory inspector turns back about 1% usage per core, so no overload here.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose">Running 12 instances on a 16-core machine.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose">Note: the same case runs fine in serial on the same machine, I’m just trying to speed up the data processing, as well as prove out some scripts I’m building for later use on a cloud machine.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose">It is my understanding that a D3 filter is required to balance the load across all nodes (working off of recomposed time steps).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose">Am I getting this wrong?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"> <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"><span style="font-size:10.0pt">Quentin d’Avout |
<span style="color:#ED7D31">Aerodynamics</span></span><o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"></span><a href="http://www.arrivo-loop.com/"><span style="mso-bookmark:_MailEndCompose"><span style="font-size:10.0pt;color:blue;text-decoration:none"><img border="0" width="151" height="40" style="width:1.5729in;height:.4166in" id="Picture_x0020_1" src="cid:image001.png@01D34812.0FF45B80" alt="Arrivo Loop"></span></span><span style="mso-bookmark:_MailEndCompose"></span></a><span style="mso-bookmark:_MailEndCompose"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="mso-bookmark:_MailEndCompose"> <o:p></o:p></span></p>
<span style="mso-bookmark:_MailEndCompose"></span>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Scott, W Alan [mailto:<a href="mailto:wascott@sandia.gov">wascott@sandia.gov</a>]
<br>
<b>Sent:</b> Wednesday, October 18, 2017 11:45 AM<br>
<b>To:</b> Quentin d'Avout <<a href="mailto:quentin@arrivo-loop.com">quentin@arrivo-loop.com</a>>; ParaView <<a href="mailto:paraview@paraview.org">paraview@paraview.org</a>><br>
<b>Subject:</b> RE: [EXTERNAL] [Paraview] D3 filter crash<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Kill it, that’s ridiculous.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">My guess is that you need more nodes? Before running the D3 filter, try View/ Memory Inspector. If any nodes are over about 60% or 70%, you either need more resource, or less data.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">I’m curious – why are you running the D3 filter?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Alan<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> ParaView [<a href="mailto:paraview-bounces@paraview.org">mailto:paraview-bounces@paraview.org</a>]
<b>On Behalf Of </b>Quentin d'Avout<br>
<b>Sent:</b> Wednesday, October 18, 2017 11:50 AM<br>
<b>To:</b> ParaView <<a href="mailto:paraview@paraview.org">paraview@paraview.org</a>><br>
<b>Subject:</b> [EXTERNAL] [Paraview] D3 filter crash<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Hello all,<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">I’m able to start a pvserver over multiple cores, connect to it in paraview GUI, open a foam file and load the results.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">I then apply a D3 filter before doing anything else, at which point paraview seems to get cranking (window darkens) and pvserver processes show some activity, but nothing else happens.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">I let it “run” for a day now, and it is still seemingly applying that filter.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Unfortunately no errors in either terminals (the pvserver and the paraview ones) nor in the paraview GUI output window.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Anybody ever experienced that?</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Thank you</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Quentin </span><o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>