[Paraview] Visualization problem with very large Ensight file

[Raashid Baig]

I have compiled ParaView3.2.1 on a cluster with OSMesa and openmpi
support. It works without any X server problem on 18 nodes.
I run paraview as

/usr/local/openmpi-1.2.4/bin/mpirun -np 18 --x LD_LIBRARY_PATH=/home/raashid/src/lib64/:$LD_LIBRARY_PATH --mca btl ^openib,mvapi -hostfile nodes ./pvserver --use-offscreen-rendering

I have generated a vtk-xml structured grid file with about 48 million
cells (file size about 800MB) which I am able to visualize without any
problem when I run pvserver on 18 nodes. While reading the files
memory usage in all the nodes go up and all the nodes seem to balance
the load.

However when I try to open an ensight file with 33 million cells
(Unstructured grid, generated by another software, but is a lot larger
in terms of disk space usage about 2.1GB). ParaView fails while trying
to load this file. pvserver crashes when the memory usage on the
headnode of the cluster is about 20% to total available memory. Also
on all other nodes, besides the head node paraview does not seem to
consume any memory. The erro message is as follows:

[raashid at n0 bin]$ /usr/local/openmpi-1.2.4/bin/mpirun -np 18 --x LD_LIBRARY_PATH=/home/raashid/src/lib64/:$LD_LIBRARY_PATH --mca btl ^openib,mvapi -hostfile nodes ./pvserver --use-offscreen-rendering
Listen on port: 11111
Waiting for client...
Client connected.
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
Executing with: 0
[n0:18863] *** Process received signal ***
[n0:18863] Signal: Segmentation fault (11)
[n0:18863] Signal code: Address not mapped (1)
[n0:18863] Failing at address: 0x2ab0ecbcb0
[n0:18863] [ 0] /lib64/tls/libpthread.so.0 [0x342f10c420]
[n0:18863] [ 1] ./pvserver(_ZN20vtkDataArrayTemplateIxE8GetValueEx+0x23) [0xcd7e35]
[n0:18863] [ 2] ./pvserver(_ZN14vtkIdTypeArray8GetValueEx+0x1d) [0xcd7dc7]
[n0:18863] [ 3] ./pvserver(_ZN17vtkEnSight6Reader28CreateUnstructuredGridOutputEiPcPKcP20vtkMultiBlockDataSet+0x3761) [0x29fb26d]
[n0:18863] [ 4] ./pvserver(_ZN17vtkEnSight6Reader16ReadGeometryFileEPKciP20vtkMultiBlockDataSet+0xd10) [0x29f11b8]
[n0:18863] [ 5] ./pvserver(_ZN16vtkEnSightReader11RequestDataEP14vtkInformationPP20vtkInformationVectorS3_+0x80c) [0x2a2610a]
[n0:18863] [ 6] ./pvserver(_ZN29vtkMultiBlockDataSetAlgorithm14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x8e) [0x2d12f24]
[n0:18863] [ 7] ./pvserver(_ZN12vtkExecutive13CallAlgorithmEP14vtkInformationiPP20vtkInformationVectorS3_+0x88) [0x2c88e3c]
[n0:18863] [ 8] ./pvserver(_ZN23vtkDemandDrivenPipeline11ExecuteDataEP14vtkInformationPP20vtkInformationVectorS3_+0x64) [0x2c83b5e]
[n0:18863] [ 9] ./pvserver(_ZN24vtkCompositeDataPipeline11ExecuteDataEP14vtkInformationPP20vtkInformationVectorS3_+0x30c) [0x2c688d4]
[n0:18863] [10] ./pvserver(_ZN23vtkDemandDrivenPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x373) [0x2c83383]
[n0:18863] [11] ./pvserver(_ZN32vtkStreamingDemandDrivenPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x1be) [0x2d97b96]
[n0:18863] [12] ./pvserver(_ZN24vtkCompositeDataPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x627) [0x2c6812f]
[n0:18863] [13] ./pvserver(_ZN23vtkDemandDrivenPipeline10UpdateDataEi+0x27d) [0x2c8398f]
[n0:18863] [14] ./pvserver(_ZN32vtkStreamingDemandDrivenPipeline6UpdateEi+0xbf) [0x2d97d15]
[n0:18863] [15] ./pvserver(_ZN12vtkExecutive6UpdateEv+0x38) [0x2c8747a]
[n0:18863] [16] ./pvserver(_ZN23vtkDemandDrivenPipeline6UpdateEv+0x15) [0x2c83413]
[n0:18863] [17] ./pvserver(_ZN32vtkStreamingDemandDrivenPipeline6UpdateEv+0x15) [0x2d97c53]
[n0:18863] [18] ./pvserver(_ZN12vtkAlgorithm6UpdateEv+0x26) [0x2c3d054]
[n0:18863] [19] ./pvserver(_ZN23vtkGenericEnSightReader11RequestDataEP14vtkInformationPP20vtkInformationVectorS3_+0x124) [0x2a66028]
[n0:18863] [20] ./pvserver(_ZN29vtkMultiBlockDataSetAlgorithm14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x8e) [0x2d12f24]
[n0:18863] [21] ./pvserver(_ZN12vtkExecutive13CallAlgorithmEP14vtkInformationiPP20vtkInformationVectorS3_+0x88) [0x2c88e3c]
[n0:18863] [22] ./pvserver(_ZN23vtkDemandDrivenPipeline11ExecuteDataEP14vtkInformationPP20vtkInformationVectorS3_+0x64) [0x2c83b5e]
[n0:18863] [23] ./pvserver(_ZN24vtkCompositeDataPipeline11ExecuteDataEP14vtkInformationPP20vtkInformationVectorS3_+0x30c) [0x2c688d4]
[n0:18863] [24] ./pvserver(_ZN23vtkDemandDrivenPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x373) [0x2c83383]
[n0:18863] [25] ./pvserver(_ZN32vtkStreamingDemandDrivenPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x1be) [0x2d97b96]
[n0:18863] [26] ./pvserver(_ZN24vtkCompositeDataPipeline14ProcessRequestEP14vtkInformationPP20vtkInformationVectorS3_+0x627) [0x2c6812f]
[n0:18863] [27] ./pvserver(_ZN23vtkDemandDrivenPipeline10UpdateDataEi+0x27d) [0x2c8398f]
[n0:18863] [28] ./pvserver(_ZN32vtkStreamingDemandDrivenPipeline6UpdateEi+0xbf) [0x2d97d15]
[n0:18863] [29] ./pvserver(_ZN12vtkExecutive6UpdateEv+0x38) [0x2c8747a]
[n0:18863] *** End of error message ***

[1]+  Stopped                 /usr/local/openmpi-1.2.4/bin/mpirun -np 18 --x LD_LIBRARY_PATH=/home/raashid/src/lib64/:$LD_LIBRARY_PATH --mca btl ^openib,mvapi -hostfile nodes ./pvserver --use-offscreen-rendering
[raashid at n0 bin]$ 

Due to large size of the ensight file and associated memory related
issues, I fail to convert it into a vtk-xml Untructured file through a
simple vtk program by reading the ensight file by vtkEnSight6Reader
and writring it through vtkXMLUnstructuredGridWriter.

Please suggest me how to over come this problem.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://public.kitware.com/pipermail/paraview/attachments/20080115/bca755ac/attachment.html