[Paraview-developers] FW: [EXTERNAL] [Paraview] Problems with memory footprint of parallel Paraview

[Scott, W Alan]

Utkarsh,
Would it be valuable to take a look at this user's memory issues?  I have no clue how to pick up a dataset that is that large.  Also, I am getting my thoughts together once again on the CTH AMR memory growth issues.  Expect an e-mail with thoughts later today.

Alan

-----Original Message-----
From: paraview-bounces at paraview.org [mailto:paraview-bounces at paraview.org] On Behalf Of Herwig Zilken
Sent: Wednesday, May 09, 2012 3:45 AM
To: paraview at paraview.org
Subject: [EXTERNAL] [Paraview] Problems with memory footprint of parallel Paraview

Hello,

I have some problems with the memory footprint of Paraview 3.14.0.
I run pvserver in parallel on 4 nodes of a cluster with 2 Paraview processes on each node. Each node has 16GB main memory.
So in total I have 8 Paraview processes and 64GB main memory (distributed on 4 nodes).

For testing purpose I loaded a dataset in hdf5/xdmf format with the xdmf reader. The dataset is a simple uniform rectilinear grid with one float attribute.
The size of the data is 16GB.

After loading the data everything seems reasonable. Each of the 8 Paraview processes allocates about 2GB main memory.
Then I create a contour. After that, each process allocates 2GB additional memory (resulting in 4GB for EACH of the 8 processes), although the memory inspector tells me that the generated contour is just 145MB.
Then I create a slice (plane). Ones again, every process allocates 2GB additional memory (resulting in 6GB total for each process) for a simple plane (of 350MB).

Of course, things are even getting worse when I try to load a 32GB dataset. Then every process allocates 4GB main memory, then 4GB in addition, and so on...

Is there any solution for the strange behavior? Maybe I have to set some special cmake compiler flags?


Thanks in advance,

Herwig







------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

Kennen Sie schon unseren neuen Film? http://www.fz-juelich.de/film Kennen Sie schon unsere app? http://www.fz-juelich.de/app _______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the ParaView Wiki at: http://paraview.org/Wiki/ParaView

Follow this link to subscribe/unsubscribe:
http://www.paraview.org/mailman/listinfo/paraview