<div dir="ltr">Btw, I am a bit confused that why after applying a "2D Glyph" filter and "Glyph Type" as "Vertex", the number of points decreases. For example, if after applying "TableToPoints" filter I have 1 cell and 100k points, I get 502 cells and 502 points after applying a "2D Glyph" filter. I was expecting the number of cells to increase but total number of points should have remained 100k, no? <div><br></div><div>I am not really sure if applying a 2D Glyph is the best solution in my case. I may go back to using 4.0.1 to convert this csv data into pvtu and then use the latest version to load it up. </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 3, 2017 at 2:14 PM, Faiz Abidi <span dir="ltr"><<a href="mailto:fabidi89@vt.edu" target="_blank">fabidi89@vt.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I see.<div><br>I did that because when I choose "Assign Cells Uniquely" as the "Boundary Mode" in the D3 filter, I was getting a warning like below:<br><br>Warning: In /home/faiz89/git/ParaView/VTK/<wbr>Common/DataModel/vtkKdTree.<wbr>cxx, line 1887<br>vtkKdTree (0x2db5950): vtkKdTree::<wbr>BuildMapForDuplicatePoints - invalid tolerance</div><div><br></div><div>But in spite of the warning, 8 vtu files get generated along with 1 pvtu file. So, maybe that warning can be ignored. <br><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 2, 2017 at 6:42 PM, Moreland, Kenneth <span dir="ltr"><<a href="mailto:kmorel@sandia.gov" target="_blank">kmorel@sandia.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_-543853952351027312m_-5474853998460624792WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">I’m pretty sure if you select Duplicate Cells it will just copy all the points to all processes, so that is not a good option. The divide cells is also giving
poor results on this front. I think you are better off using the 2D Glyph filter to break up the cell first.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">-Ken<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Faiz Abidi [mailto:<a href="mailto:fabidi89@vt.edu" target="_blank">fabidi89@vt.edu</a>]
<br>
<b>Sent:</b> Thursday, March 2, 2017 2:44 PM<span><br>
<b>To:</b> Moreland, Kenneth <<a href="mailto:kmorel@sandia.gov" target="_blank">kmorel@sandia.gov</a>><br>
<b>Cc:</b> ParaView <<a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a>>; Rajamohan, Srijith <<a href="mailto:srijithr@vt.edu" target="_blank">srijithr@vt.edu</a>>; Nicholas Polys <<a href="mailto:npolys@vt.edu" target="_blank">npolys@vt.edu</a>>; Ayat Mohammed <<a href="mailto:maaayat@vt.edu" target="_blank">maaayat@vt.edu</a>><br>
</span><b>Subject:</b> Re: [EXTERNAL] Re: [Paraview] CSV to PVTU<u></u><u></u></span></p><div><div class="m_-543853952351027312h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Ohk, that makes more sense. I could get it to work as well but also had to check "Boundary Mode" as "Duplicate Cells" while applying the D3 filter.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks Moreland! <u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Thu, Mar 2, 2017 at 3:59 PM, Moreland, Kenneth <<a href="mailto:kmorel@sandia.gov" target="_blank">kmorel@sandia.gov</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Faiz,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">I was able to replicate your problem. It looks like it is not an issue with D3 but a change with how
Table to Points creates data (or perhaps how data are written). It looks like Table to Points is creating one “cell” with a lot of points. This saves a little memory but ends up preventing D3 from dividing the points up.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">The best solution is to add a “2D Glyph” filter after the Table to Points but before the D3 filter.
Set the “Glyph Type” to “Vertex”. Then apply the D3 filter to the output of the 2D Glyph filter.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">-Ken</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Faiz Abidi [mailto:<a href="mailto:fabidi89@vt.edu" target="_blank">fabidi89@vt.edu</a>]
<br>
<b>Sent:</b> Thursday, March 2, 2017 1:38 PM<br>
<b>To:</b> Moreland, Kenneth <<a href="mailto:kmorel@sandia.gov" target="_blank">kmorel@sandia.gov</a>><br>
<b>Cc:</b> ParaView <<a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a>>; Rajamohan, Srijith <<a href="mailto:srijithr@vt.edu" target="_blank">srijithr@vt.edu</a>>; Nicholas Polys <<a href="mailto:npolys@vt.edu" target="_blank">npolys@vt.edu</a>>;
Ayat Mohammed <<a href="mailto:maaayat@vt.edu" target="_blank">maaayat@vt.edu</a>><br>
<b>Subject:</b> [EXTERNAL] Re: [Paraview] CSV to PVTU</span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">Hi Moreland,<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks for your reply.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">I thought same except maybe not use the GUI since my data is big and takes forever to load up in Paraview.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Quick question/observation - using the GUI and 8 processes, and applying the Tables to Points filter + D3 and then trying to save files doesn't create 8 vtu files and 1 pvtu file
as expected. Instead, what happens is that I get only 1 pvtu file along with 1 vtu file instead. Clearly something wrong. This was done using v5.2.0.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">I tried the same thing using v4.0.1 (yes, old but it works!) and I got 8 vtu files and 1 pvtu file as expected. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Do you think this is a bug with 5.2.0? Or do I need to do something different with 5.2.0? Any pointers appreciated! <u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">On Wed, Mar 1, 2017 at 4:15 PM, Moreland, Kenneth <<a href="mailto:kmorel@sandia.gov" target="_blank">kmorel@sandia.gov</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">You can use ParaView itself to read in the csv file, convert it to an unstructured grid (Table to Points
filter), redistributed on your 8 parallel processors (D3 filter) and then write out a pvtu file.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Offhand I cannot think of an easier way.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">-Ken</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> ParaView [mailto:<a href="mailto:paraview-bounces@paraview.org" target="_blank">paraview-bounces@parav<wbr>iew.org</a>]
<b>On Behalf Of </b>Faiz Abidi<br>
<b>Sent:</b> Wednesday, March 1, 2017 2:03 PM<br>
<b>To:</b> ParaView <<a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a>><br>
<b>Subject:</b> [EXTERNAL] [Paraview] CSV to PVTU</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">Hi again community! <u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Looking for suggestions - what would be a decently fast way to convert a huge CSV file into PVTU files? <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">What I want to do - load this huge file in a CAVE like environment, and use 8 parallel processors.<br>
-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Faiz Abidi | Master's Student at Virginia Tech | <a href="http://www.faizabidi.com" target="_blank">www.faizabidi.com</a> | <a href="tel:(540)%20998-6636" target="_blank">+1-540-9<wbr>98-6636</a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal">--
<u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Faiz Abidi | Master's Student at Virginia Tech | <a href="http://www.faizabidi.com" target="_blank">www.faizabidi.com</a> | <a href="tel:(540)%20998-6636" target="_blank">+1-540-9<wbr>98-6636</a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Faiz Abidi | Master's Student at Virginia Tech | <a href="http://www.faizabidi.com" target="_blank">www.faizabidi.com</a> | <a href="tel:(540)%20998-6636" value="+15409986636" target="_blank">+1-540-9<wbr>98-6636</a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_-543853952351027312gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Faiz Abidi | Master's Student at Virginia Tech | <a href="http://www.faizabidi.com" target="_blank">www.faizabidi.com</a> | <span style="font-size:small"><a href="tel:(540)%20998-6636" value="+15409986636" target="_blank">+1-540-<wbr>998-6636</a></span></div></div></div></div></div></div></div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Faiz Abidi | Master's Student at Virginia Tech | <a href="http://www.faizabidi.com" target="_blank">www.faizabidi.com</a> | <span style="font-size:small">+1-540-998-6636</span></div></div></div></div></div></div></div>
</div>