[Paraview] Problem reading large data set (ensight format)

[Paul Edwards]

Did you compile it yourself?  You could compile with debug information
and attach a debugger to find out where it is happening.

Regards,
Paul

On 16 April 2010 08:52,  <Luca.Clementi at tororosso.com> wrote:
> Dear Stephane & Zhanping,
> I tried to compile 3.8 from CVS, I did the checkout yesterday morning.
>
> But the problem persist, with the only difference that the error now appears
> after few second from the moment I click on Apply button (below the error).
>
> Zhanping,
> unfortunately I can't send the data file out :-( (it is also 20 GB). Is
> there anything I can do to get more debugging output?
>
> Thank you for your help,
> Luca
>
>
>
> ---------------------------
> lclementi at ws09:~/develop/paraview/paraview-cvs-bin/bin>
> /home/lclementi/develop/paraview/mvapich2/bin/mpirun -np 8
> /home/lclementi/develop/paraview/paraview-cvs-bin/bin/pvserver
> Listen on port: 11111
> Waiting for client...
> Client connected.
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Executing with: 0
> Process id: 0 >> ERROR: In
> /home/lclementi/develop/paraview/ParaView3-cvs/ParaView3/Servers/Common/vtkProcessModule.cxx,
> line 1314
> vtkProcessModule (0x584160): Exception: Insufficient memory exception.
>
> terminate called after throwing an instance of 'std::bad_alloc'
> what():  St9bad_alloc
> terminate called after throwing an instance of 'std::bad_alloc'
> what():  St9bad_alloc
> terminate called after throwing an instance of 'std::bad_alloc'
> what():  St9bad_alloc
> terminate called after throwing an instance of 'std::bad_alloc'
> what():  St9bad_alloc
> rank 5 in job 3  ws09_35270   caused collective abort of all ranks
> exit status of rank 5: killed by signal 9
>
> ---------------------------
>
> -----paraview-bounces at paraview.org wrote: -----
>>
>>Luca,
>>
>>It seems you are using pv 3.6.2, could
>>you try with paraview cvs or wait a few days and try it with the 3.8
>>version?
>>
>>
>>This kind of issue should be fixed now.
>>
>>
>>
>>
>>Stephane
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>zhanping.liu at kitware.com
>>
>>
>>
>>Envoyé par : paraview-bounces at paraview.org
>>
>>
>>14/04/2010 16:13
>>
>>
>>
>>
>>
>>A
>>
>>Luca.Clementi at tororosso.com
>>
>>
>>
>>cc
>>
>>paraview at paraview.org
>>
>>
>>
>>Objet
>>
>>Re: [Paraview] Problem reading large
>>data set (ensight format)
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>Luca:
>>
>>
>>
>>
>>
>>    It is hard to determine what really
>>causes this problem without loading the data to ParaView. Is that
>>possible
>>to share the dataset such that I can debug the code?
>>
>>
>>
>>
>>
>>    thanks.
>>
>>
>>
>>
>>
>>   -Zhanping
>>
>>
>>
>>
>>On Wed, Apr 14, 2010 at 4:58 AM, <
>>Luca.Clementi at tororosso.com
>>>
>>wrote:
>>
>>
>>Hi all,
>>
>>
>>I'm trying to read a large data set ~60Milion cells in Ensight
>>format.
>>The files on the disk are about 18GBs.
>>
>>
>>
>>
>>I compiled Paraview with mpich, I run 8 pvserver on my workstation
>>with
>>mpirun. My workstation has _144GB of RAM_ (which should be enough to
>>load
>>the entire data set), with two quad core.
>>
>>
>>
>>
>>When I try to load the data set I always get the error reported
>>below.
>>I monitored the situation and when this happen my workstation RAM
>>usage
>>is only ~ 26%.
>>
>>
>>
>>
>>
>>
>>Thank you for your help,
>>
>>
>>Luca
>>
>>
>>
>>
>>
>>
>>
>>
>>------------------------------------------
>>
>>
>>lclementi at ws09:~/develop/paraview/paraview-bin/bin>
>>/home/lclementi/develop/paraview/mvapich2/bin/mpirun
>>-np 8 /home/lclementi/develop/paraview/paraview-bin/bin/pvserver
>>
>>
>>Listen on port: 11111
>>
>>
>>Waiting for client...
>>
>>
>>Client connected.
>>
>>
>>Process id: 0 >> ERROR: In
>>/home/lclementi/develop/paraview/paraview-3.6.2-src/ParaView3/Servers
>>/Common/vtkProcessModule.cxx,
>>line 1297
>>
>>
>>vtkProcessModule (0x5d7330): Exception: Insufficient memory
>>exception.
>>
>>
>>
>>
>>terminate called after throwing an instance of 'std::bad_alloc'
>>
>>
>>what():  St9bad_alloc
>>
>>
>>terminate called after throwing an instance of 'std::bad_alloc'
>>
>>
>>what():  St9bad_alloc
>>
>>
>>terminate called after throwing an instance of 'std::bad_alloc'
>>
>>
>>what():  St9bad_alloc
>>
>>
>>terminate called after throwing an instance of 'std::bad_alloc'
>>
>>
>>what():  St9bad_alloc
>>
>>
>>rank 2 in job 1  ws09_35270   caused collective abort of all
>>ranks
>>
>>
>>exit status of rank 2: killed by signal 9
>>
>>
>>-----------------------------------
>>
>>
>>
>>
>>_____________________________________________________________________
>>____________________________________________
>>
>>
>>Questo messaggio è da intendersi esclusivamente ad uso del
>>destinatario
>>e può contenere informazioni che sono di natura privilegiata,
>>confidenziale
>>
>>
>>o non divulgabile secondo le leggi vigenti. Se il lettore del
>>presente
>>messaggio non è il destinatario designato, o il dipendente/agente
>>responsabile
>>
>>
>>per la consegna del messaggio al destinatario designato, si informa
>>che
>>ogni disseminazione, distribuzione o copiatura di questa
>>comunicazione
>>è
>>
>>
>>strettamente proibita anche ai sensi del decreto legislativo 196/03 .
>>Se
>>avete ricevuto questo messaggio per errore, vi preghiamo di
>>notificarcelo
>>
>>
>>immediatamente a mezzo e-mail di risposta e successivamente di
>>procedere
>>alla cancellazione di questa e-mail e relativi allegati dal vostro
>>sistema.
>>
>>
>>_____________________________________________________________________
>>____________________________________________
>>
>>
>>This message is intended only for the use of the addressee and may
>>contain
>>information that is privileged, confidential and exempt from
>>
>>
>>disclosure under applicable law. If the reader of this message is not
>>the
>>intended recipient, or the employee or agent responsible for
>>delivering
>>the
>>
>>
>>message to the intended recipient, you are hereby notified that any
>>dissemination,
>>distribution or copying of this communication is strictly
>>
>>
>>prohibited. If you have received this e-mail in error, please notify
>>us
>>immediately by return e-mail and delete this e-mail and all
>>attachments
>>from
>>
>>
>>your system.
>>
>>
>>_____________________________________________________________________
>>____________________________________________
>>
>>
>>
>>
>>_______________________________________________
>>
>>
>>Powered by
>>www.kitware.com
>>
>>
>>
>>
>>Visit other Kitware open-source projects at
>>http://www.kitware.com/opensource/opensource.html
>>
>>
>>
>>
>>Please keep messages on-topic and check the ParaView Wiki at:
>>http://paraview.org/Wiki/ParaView
>>
>>
>>
>>
>>Follow this link to subscribe/unsubscribe:
>>
>>
>>http://www.paraview.org/mailman/listinfo/paraview
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>--
>>
>>
>>Zhanping Liu, PhD
>>
>>
>>Kitware, Inc.
>>
>>
>>28 Corporate Drive
>>
>>
>>Clifton Park, NY 12065-8662
>>
>>
>>Phone: 518-371-3971 x 138
>>
>>
>>http://www.zhanpingliu.org
>>_______________________________________________
>>
>>
>>Powered by www.kitware.com
>>
>>
>>
>>
>>Visit other Kitware open-source projects at
>>http://www.kitware.com/opensource/opensource.html
>>
>>
>>
>>
>>Please keep messages on-topic and check the ParaView Wiki at:
>>http://paraview.org/Wiki/ParaView
>>
>>
>>
>>
>>Follow this link to subscribe/unsubscribe:
>>
>>
>>http://www.paraview.org/mailman/listinfo/paraview
>>
>>
>>
>>
>>Ce message et toutes les pièces jointes (ci-après le 'Message') sont
>>établis à l'intention exclusive des destinataires et les informations
>>qui y figurent sont strictement confidentielles. Toute utilisation de
>>ce Message non conforme à sa destination, toute diffusion ou toute
>>publication totale ou partielle, est interdite sauf autorisation
>>expresse.
>>Si vous n'êtes pas le destinataire de ce Message, il vous est
>>interdit de le copier, de le faire suivre, de le divulguer ou d'en
>>utiliser tout ou partie. Si vous avez reçu ce Message par erreur,
>>merci de le supprimer de votre système, ainsi que toutes ses copies,
>>et de n'en garder aucune trace sur quelque support que ce soit. Nous
>>vous remercions également d'en avertir immédiatement l'expéditeur par
>>retour du message.
>>Il est impossible de garantir que les communications par messagerie
>>électronique arrivent en temps utile, sont sécurisées ou dénuées de
>>toute erreur ou virus.
>>____________________________________________________
>>This message and any attachments (the 'Message') are intended solely
>>for the addressees. The information contained in this Message is
>>confidential. Any use of information contained in this Message not in
>>accord with its purpose, any dissemination or disclosure, either
>>whole or partial, is prohibited except formal approval.
>>If you are not the addressee, you may not copy, forward, disclose or
>>use any part of it. If you have received this message in error,
>>please delete it and all copies from your system and notify the
>>sender immediately by return message.
>>E-mail communication cannot be guaranteed to be timely secure, error
>>or virus-free.
>>_______________________________________________
>>Powered by www.kitware.com
>>
>>Visit other Kitware open-source projects at
>>http://www.kitware.com/opensource/opensource.html
>>
>>Please keep messages on-topic and check the ParaView Wiki at:
>>http://paraview.org/Wiki/ParaView
>>
>>Follow this link to subscribe/unsubscribe:
>>http://www.paraview.org/mailman/listinfo/paraview
>>
>>
>>
> _________________________________________________________________________________________________________________
> Questo messaggio è da intendersi esclusivamente ad uso del destinatario e
> può contenere informazioni che sono di natura privilegiata, confidenziale
> o non divulgabile secondo le leggi vigenti. Se il lettore del presente
> messaggio non è il destinatario designato, o il dipendente/agente
> responsabile
> per la consegna del messaggio al destinatario designato, si informa che ogni
> disseminazione, distribuzione o copiatura di questa comunicazione è
> strettamente proibita anche ai sensi del decreto legislativo 196/03 . Se
> avete ricevuto questo messaggio per errore, vi preghiamo di notificarcelo
> immediatamente a mezzo e-mail di risposta e successivamente di procedere
> alla cancellazione di questa e-mail e relativi allegati dal vostro sistema.
> _________________________________________________________________________________________________________________
> This message is intended only for the use of the addressee and may contain
> information that is privileged, confidential and exempt from
> disclosure under applicable law. If the reader of this message is not the
> intended recipient, or the employee or agent responsible for delivering the
> message to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication is strictly
> prohibited. If you have received this e-mail in error, please notify us
> immediately by return e-mail and delete this e-mail and all attachments from
> your system.
> _________________________________________________________________________________________________________________
>
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the ParaView Wiki at:
> http://paraview.org/Wiki/ParaView
>
> Follow this link to subscribe/unsubscribe:
> http://www.paraview.org/mailman/listinfo/paraview
>
>