[Paraview-developers] FW: [EXTERNAL] Re: ParaView | Memory consumption on Paraview (#18035)

[Scott, W Alan]

Boonthanome,
Moving this to the developers list.

Kitware – looking at the memory usage below, a few questions:


  *   Why does merge blocks grow so much?  Why can’t this filter just do shallow copies?  Is this impossible, or just not implemented?
  *   Why can’t Merge Blocks do shallow copies?  Is this impossible, or just not implemented?
  *   (I think I know this one, but here it is).  Why does the ghost cell generator bloat memory so much?  Can’t you just use shallow copies of the primary data, and then add the ghost cells?
  *   Why can’t we have the cell data to point data filter be smart enough to add ghost cells if necessary for calculations, then throw them away?
  *   Any other ideas how to decrease the bloat of about 4 GB of data to be about 18 GB of data?

Thanks team,

Alan

From: Boonthanome Nouanesengsy [mailto:gitlab at gitlab.kitware.com]
Sent: Thursday, March 15, 2018 4:39 PM
To: Scott, W Alan <wascott at sandia.gov>
Subject: [EXTERNAL] Re: ParaView | Memory consumption on Paraview (#18035)


I tried the Pass Arrays pipeline again from a clean node. I got the node, and made a client/server connection. I basically got similar values.

Using Pass Arrays again:

  *   before loading data: 1.58 GB
  *   after loading data: 5.70 GB
  *   after pass arrays (1 cell array): 5.84 GB
  *   after Merge Blocks: 9.38 GB
  *   after ghost cells: 22.23 GB
  *   after cell data to point data: 22.23 GB
  *   after show surface: 22.43 GB
  *   after contour: 22.43 GB

The original data is about 4 GB, so it seems a bit much that the ghost cells filter will add 13 GB. Yes, it does make a copy of the data, padded with ghost cells, but the added ghost cells should not triple the amount of memory used.

Alan, the result of using Pass Arrays is that the output of a filter will have less arrays, and take less memory, correct? For example, if I do Pass Arrays -> Merge Blocks, then after applying Merge Blocks I only see one array available.

—
Reply to this email directly or view it on GitLab<https://gitlab.kitware.com/paraview/paraview/issues/18035#note_388627>.
You're receiving this email because of your account on gitlab.kitware.com. If you'd like to receive fewer emails, you can unsubscribe<https://gitlab.kitware.com/sent_notifications/ed8094fa29969659a9e638f3e457e518/unsubscribe> from this thread or adjust your notification settings.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://public.kitware.com/pipermail/paraview-developers/attachments/20180319/b73c827a/attachment-0001.html>