<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 12px; font-family: Courier, sans-serif;">
<div>
<div>
<div>Andy, Ashton: We have now tried versions 5.2, 5.3, and 5.4. With large point data sets we still have the same Generic Warning cited below (followed by ERRORS that cause PV to hang). I reckon that we are hitting the MPI wall associated with 2^31 items
communicated at once - as per Andy’s note below.</div>
<div><br>
</div>
<div>All of our recent work has been using the downloadable binaries from paraview.org, for both the client and the server. We see the same behavior using the MacOS client to Linux server, and Linux client to Linux server.</div>
<div><br>
</div>
<div>This MPI shortcoming is a serious showstopper for us so we are going to have to find a remedy.</div>
<div><br>
</div>
<div>The first question is: why should either the client or the server think that more than 2^31 items need to be communicated in the first place? On the surface, this seems to be unreasonable.</div>
<div><br>
</div>
<div>To be clear, there is no problem opening and reading the datafiles, and displaying the outline view. The warning appears when we try to display the point view, when the number of points is too large. If we take a slice that reduces the number of points
to below some threshold, then the point view display is okay. As an example, consider a .cosmo64 formatted point data file. There are 36 Bytes of data per point. We can display ~28,000,000 points and ~35,500,000 points just fine. At 45,500,000 points (=1.638
GBytes) the Generic Warning gets thrown. This seems to be independent of the number of nodes and PEs used by the server, and whether the view RenderView or EyeDomeLighting. We also write/read .vtm format that behaves in a similar fashion: slices will display
okay until the slice is thick enough that there are too many points in the image.</div>
<div><br>
</div>
<div>I have tried doing MPI on the client, which seems to have no effect on the foregoing limitation on the number of displayable points. Please let me know if you can think of other switches that can be thrown, that may shed some more light on the issue,
or if you are aware of a forthcoming repair. Thanks very much, b.</div>
<div><br>
</div>
<div><br>
</div>
<div><span class="Apple-style-span" style="font-family: Courier;">=======================================================================73</span><span class="Apple-style-span" style="font-family: Courier;"><br>
</span><span class="Apple-style-span" style="font-family: Courier;"><>Bucky Kashiwa PhD, PE <> Post: MS B216, Los Alamos, NM 87545 <></span><span class="Apple-style-span" style="font-family: Courier;"><br>
</span><span class="Apple-style-span" style="font-family: Courier;"><> Ofc: TA3-SM123-RM276 <>Email: <a href="mailto:bak@lanl.gov">bak@lanl.gov</a>, <a href="mailto:kashiwa@qwest.net">kashiwa@qwest.net</a> <></span><span class="Apple-style-span" style="font-family: Courier;"><br>
</span><span class="Apple-style-span" style="font-family: Courier;"><>Voice: 505-667-8812 <> Fax: 505-665-5926 <> </span><span class="Apple-style-span" style="font-family: Courier;"><br>
</span><span class="Apple-style-span" style="font-family: Courier;"> <> Home: 505-988-7332 <> Cell: 505-795-5581 <></span><span class="Apple-style-span" style="font-family: Courier;"><br>
</span><span class="Apple-style-span" style="font-family: Courier;">=======================================================================73</span></div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Andy Bauer <<a href="mailto:andy.bauer@kitware.com">andy.bauer@kitware.com</a>><br>
<span style="font-weight:bold">Date: </span>Monday, December 19, 2016 at 4:17 PM<br>
<span style="font-weight:bold">To: </span>andrealphus <<a href="mailto:andrealphus@gmail.com">andrealphus@gmail.com</a>><br>
<span style="font-weight:bold">Cc: </span>Bucky Kashiwa <<a href="mailto:bak@lanl.gov">bak@lanl.gov</a>>, "<a href="mailto:ParaView@ParaView.org">ParaView@ParaView.org</a>" <<a href="mailto:ParaView@paraview.org">ParaView@paraview.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [Paraview] ... not yet supported for more than 2147483647 bytes.<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">There are two parts to this issue. The first is that that vtkMPICommunicator for PV 4.3.1 won't communicate data that is over 2^31 bytes of data. This is fixed in PV 5.2. The other issue is due to MPI having a limit of 2^31 objects to be communicated
in a single shot. This is MPI's API in that the count for objects that are typically sent/received is an int. See
<a href="http://www.mpich.org/static/docs/v3.1/www3/MPI_Send.html">http://www.mpich.org/static/docs/v3.1/www3/MPI_Send.html</a> for example.<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Dec 19, 2016 at 4:59 PM, andrealphus <span dir="ltr">
<<a href="mailto:andrealphus@gmail.com" target="_blank">andrealphus@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
That is a 32 bit error, from trying to index something with more than<br>
(2^32)/2 elements or indices. Are you using any custom<br>
libraries/packages/modules which might not be 64 bit compliant? Are<br>
you sure you built a 64 bit version (check your gcc -v).<br>
<br>
-ashton<br>
<div>
<div class="h5"><br>
On Mon, Dec 19, 2016 at 1:32 PM, Kashiwa, Bucky <<a href="mailto:bak@lanl.gov">bak@lanl.gov</a>> wrote:<br>
> On Linux using ParaView version 4.3.1 built with OSMesa-9.0.1, OpenMPI,<br>
> etc. Running pvserver with 12 PEs, client-server mode, Standard Release<br>
> ParaView-4.3.1-Linux-64bit client. With large point data (>2Gb) we get<br>
> this error, upon trying to display a large number of points:<br>
><br>
> Generic Warning: In<br>
> ../ParaView-v4.3.1-source/VTK/<wbr>Parallel/MPI/<wbr>vtkMPICommunicator.cxx,<br>
> line 194<br>
><br>
> This operation not yet supported for more than 2147483647 bytes.<br>
><br>
> Our CMakeCache.txt is attached, in case it may provide helpful clues.<br>
><br>
> Thanks much. B. Kashiwa<br>
><br>
><br>
><br>
</div>
</div>
> ______________________________<wbr>_________________<br>
> Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
><br>
> Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">
http://www.kitware.com/<wbr>opensource/opensource.html</a><br>
><br>
> Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">
http://paraview.org/Wiki/<wbr>ParaView</a><br>
><br>
> Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">
http://markmail.org/search/?q=<wbr>ParaView</a><br>
><br>
> Follow this link to subscribe/unsubscribe:<br>
> <a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">
http://public.kitware.com/<wbr>mailman/listinfo/paraview</a><br>
><br>
______________________________<wbr>_________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">
http://www.kitware.com/<wbr>opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">
http://paraview.org/Wiki/<wbr>ParaView</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">
http://markmail.org/search/?q=<wbr>ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/<wbr>mailman/listinfo/paraview</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</span>
</body>
</html>