[Paraview] Problem reading large data set (ensight format)

Zhanping Liu zhanping.liu at kitware.com
Fri Apr 16 10:16:51 EDT 2010 

Luca:

    Please try debugging it as Paul suggested and send the dump info to me.
The parallel EnSight reader was added recently and there may be some unknown
bugs, which may occur from parsing CASE files, reading geometry files, to
loading data attribute files.

    Thanks.

    -Zhanping

On Fri, Apr 16, 2010 at 4:58 AM, Paul Edwards <paul.m.edwards at gmail.com>wrote:

> Did you compile it yourself?  You could compile with debug information
> and attach a debugger to find out where it is happening.
>
> Regards,
> Paul
>
> On 16 April 2010 08:52,  <Luca.Clementi at tororosso.com> wrote:
> > Dear Stephane & Zhanping,
> > I tried to compile 3.8 from CVS, I did the checkout yesterday morning.
> >
> > But the problem persist, with the only difference that the error now
> appears
> > after few second from the moment I click on Apply button (below the
> error).
> >
> > Zhanping,
> > unfortunately I can't send the data file out :-( (it is also 20 GB). Is
> > there anything I can do to get more debugging output?
> >
> > Thank you for your help,
> > Luca
> >
> >
> >
> > ---------------------------
> > lclementi at ws09:~/develop/paraview/paraview-cvs-bin/bin>
> > /home/lclementi/develop/paraview/mvapich2/bin/mpirun -np 8
> > /home/lclementi/develop/paraview/paraview-cvs-bin/bin/pvserver
> > Listen on port: 11111
> > Waiting for client...
> > Client connected.
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Executing with: 0
> > Process id: 0 >> ERROR: In
> >
> /home/lclementi/develop/paraview/ParaView3-cvs/ParaView3/Servers/Common/vtkProcessModule.cxx,
> > line 1314
> > vtkProcessModule (0x584160): Exception: Insufficient memory exception.
> >
> > terminate called after throwing an instance of 'std::bad_alloc'
> > what():  St9bad_alloc
> > terminate called after throwing an instance of 'std::bad_alloc'
> > what():  St9bad_alloc
> > terminate called after throwing an instance of 'std::bad_alloc'
> > what():  St9bad_alloc
> > terminate called after throwing an instance of 'std::bad_alloc'
> > what():  St9bad_alloc
> > rank 5 in job 3  ws09_35270   caused collective abort of all ranks
> > exit status of rank 5: killed by signal 9
> >
> > ---------------------------
> >
> > -----paraview-bounces at paraview.org wrote: -----
> >>
> >>Luca,
> >>
> >>It seems you are using pv 3.6.2, could
> >>you try with paraview cvs or wait a few days and try it with the 3.8
> >>version?
> >>
> >>
> >>This kind of issue should be fixed now.
> >>
> >>
> >>
> >>
> >>Stephane
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>zhanping.liu at kitware.com
> >>
> >>
> >>
> >>Envoyé par : paraview-bounces at paraview.org
> >>
> >>
> >>14/04/2010 16:13
> >>
> >>
> >>
> >>
> >>
> >>A
> >>
> >>Luca.Clementi at tororosso.com
> >>
> >>
> >>
> >>cc
> >>
> >>paraview at paraview.org
> >>
> >>
> >>
> >>Objet
> >>
> >>Re: [Paraview] Problem reading large
> >>data set (ensight format)
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>Luca:
> >>
> >>
> >>
> >>
> >>
> >>    It is hard to determine what really
> >>causes this problem without loading the data to ParaView. Is that
> >>possible
> >>to share the dataset such that I can debug the code?
> >>
> >>
> >>
> >>
> >>
> >>    thanks.
> >>
> >>
> >>
> >>
> >>
> >>   -Zhanping
> >>
> >>
> >>
> >>
> >>On Wed, Apr 14, 2010 at 4:58 AM, <
> >>Luca.Clementi at tororosso.com
> >>>
> >>wrote:
> >>
> >>
> >>Hi all,
> >>
> >>
> >>I'm trying to read a large data set ~60Milion cells in Ensight
> >>format.
> >>The files on the disk are about 18GBs.
> >>
> >>
> >>
> >>
> >>I compiled Paraview with mpich, I run 8 pvserver on my workstation
> >>with
> >>mpirun. My workstation has _144GB of RAM_ (which should be enough to
> >>load
> >>the entire data set), with two quad core.
> >>
> >>
> >>
> >>
> >>When I try to load the data set I always get the error reported
> >>below.
> >>I monitored the situation and when this happen my workstation RAM
> >>usage
> >>is only ~ 26%.
> >>
> >>
> >>
> >>
> >>
> >>
> >>Thank you for your help,
> >>
> >>
> >>Luca
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>------------------------------------------
> >>
> >>
> >>lclementi at ws09:~/develop/paraview/paraview-bin/bin>
> >>/home/lclementi/develop/paraview/mvapich2/bin/mpirun
> >>-np 8 /home/lclementi/develop/paraview/paraview-bin/bin/pvserver
> >>
> >>
> >>Listen on port: 11111
> >>
> >>
> >>Waiting for client...
> >>
> >>
> >>Client connected.
> >>
> >>
> >>Process id: 0 >> ERROR: In
> >>/home/lclementi/develop/paraview/paraview-3.6.2-src/ParaView3/Servers
> >>/Common/vtkProcessModule.cxx,
> >>line 1297
> >>
> >>
> >>vtkProcessModule (0x5d7330): Exception: Insufficient memory
> >>exception.
> >>
> >>
> >>
> >>
> >>terminate called after throwing an instance of 'std::bad_alloc'
> >>
> >>
> >>what():  St9bad_alloc
> >>
> >>
> >>terminate called after throwing an instance of 'std::bad_alloc'
> >>
> >>
> >>what():  St9bad_alloc
> >>
> >>
> >>terminate called after throwing an instance of 'std::bad_alloc'
> >>
> >>
> >>what():  St9bad_alloc
> >>
> >>
> >>terminate called after throwing an instance of 'std::bad_alloc'
> >>
> >>
> >>what():  St9bad_alloc
> >>
> >>
> >>rank 2 in job 1  ws09_35270   caused collective abort of all
> >>ranks
> >>
> >>
> >>exit status of rank 2: killed by signal 9
> >>
> >>
> >>-----------------------------------
> >>
> >>
> >>
> >>
> >>_____________________________________________________________________
> >>____________________________________________
> >>
> >>
> >>Questo messaggio è da intendersi esclusivamente ad uso del
> >>destinatario
> >>e può contenere informazioni che sono di natura privilegiata,
> >>confidenziale
> >>
> >>
> >>o non divulgabile secondo le leggi vigenti. Se il lettore del
> >>presente
> >>messaggio non è il destinatario designato, o il dipendente/agente
> >>responsabile
> >>
> >>
> >>per la consegna del messaggio al destinatario designato, si informa
> >>che
> >>ogni disseminazione, distribuzione o copiatura di questa
> >>comunicazione
> >>è
> >>
> >>
> >>strettamente proibita anche ai sensi del decreto legislativo 196/03 .
> >>Se
> >>avete ricevuto questo messaggio per errore, vi preghiamo di
> >>notificarcelo
> >>
> >>
> >>immediatamente a mezzo e-mail di risposta e successivamente di
> >>procedere
> >>alla cancellazione di questa e-mail e relativi allegati dal vostro
> >>sistema.
> >>
> >>
> >>_____________________________________________________________________
> >>____________________________________________
> >>
> >>
> >>This message is intended only for the use of the addressee and may
> >>contain
> >>information that is privileged, confidential and exempt from
> >>
> >>
> >>disclosure under applicable law. If the reader of this message is not
> >>the
> >>intended recipient, or the employee or agent responsible for
> >>delivering
> >>the
> >>
> >>
> >>message to the intended recipient, you are hereby notified that any
> >>dissemination,
> >>distribution or copying of this communication is strictly
> >>
> >>
> >>prohibited. If you have received this e-mail in error, please notify
> >>us
> >>immediately by return e-mail and delete this e-mail and all
> >>attachments
> >>from
> >>
> >>
> >>your system.
> >>
> >>
> >>_____________________________________________________________________
> >>____________________________________________
> >>
> >>
> >>
> >>
> >>_______________________________________________
> >>
> >>
> >>Powered by
> >>www.kitware.com
> >>
> >>
> >>
> >>
> >>Visit other Kitware open-source projects at
> >>http://www.kitware.com/opensource/opensource.html
> >>
> >>
> >>
> >>
> >>Please keep messages on-topic and check the ParaView Wiki at:
> >>http://paraview.org/Wiki/ParaView
> >>
> >>
> >>
> >>
> >>Follow this link to subscribe/unsubscribe:
> >>
> >>
> >>http://www.paraview.org/mailman/listinfo/paraview
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>--
> >>
> >>
> >>Zhanping Liu, PhD
> >>
> >>
> >>Kitware, Inc.
> >>
> >>
> >>28 Corporate Drive
> >>
> >>
> >>Clifton Park, NY 12065-8662
> >>
> >>
> >>Phone: 518-371-3971 x 138
> >>
> >>
> >>http://www.zhanpingliu.org
> >>_______________________________________________
> >>
> >>
> >>Powered by www.kitware.com
> >>
> >>
> >>
> >>
> >>Visit other Kitware open-source projects at
> >>http://www.kitware.com/opensource/opensource.html
> >>
> >>
> >>
> >>
> >>Please keep messages on-topic and check the ParaView Wiki at:
> >>http://paraview.org/Wiki/ParaView
> >>
> >>
> >>
> >>
> >>Follow this link to subscribe/unsubscribe:
> >>
> >>
> >>http://www.paraview.org/mailman/listinfo/paraview
> >>
> >>
> >>
> >>
> >>Ce message et toutes les pièces jointes (ci-après le 'Message') sont
> >>établis à l'intention exclusive des destinataires et les informations
> >>qui y figurent sont strictement confidentielles. Toute utilisation de
> >>ce Message non conforme à sa destination, toute diffusion ou toute
> >>publication totale ou partielle, est interdite sauf autorisation
> >>expresse.
> >>Si vous n'êtes pas le destinataire de ce Message, il vous est
> >>interdit de le copier, de le faire suivre, de le divulguer ou d'en
> >>utiliser tout ou partie. Si vous avez reçu ce Message par erreur,
> >>merci de le supprimer de votre système, ainsi que toutes ses copies,
> >>et de n'en garder aucune trace sur quelque support que ce soit. Nous
> >>vous remercions également d'en avertir immédiatement l'expéditeur par
> >>retour du message.
> >>Il est impossible de garantir que les communications par messagerie
> >>électronique arrivent en temps utile, sont sécurisées ou dénuées de
> >>toute erreur ou virus.
> >>____________________________________________________
> >>This message and any attachments (the 'Message') are intended solely
> >>for the addressees. The information contained in this Message is
> >>confidential. Any use of information contained in this Message not in
> >>accord with its purpose, any dissemination or disclosure, either
> >>whole or partial, is prohibited except formal approval.
> >>If you are not the addressee, you may not copy, forward, disclose or
> >>use any part of it. If you have received this message in error,
> >>please delete it and all copies from your system and notify the
> >>sender immediately by return message.
> >>E-mail communication cannot be guaranteed to be timely secure, error
> >>or virus-free.
> >>_______________________________________________
> >>Powered by www.kitware.com
> >>
> >>Visit other Kitware open-source projects at
> >>http://www.kitware.com/opensource/opensource.html
> >>
> >>Please keep messages on-topic and check the ParaView Wiki at:
> >>http://paraview.org/Wiki/ParaView
> >>
> >>Follow this link to subscribe/unsubscribe:
> >>http://www.paraview.org/mailman/listinfo/paraview
> >>
> >>
> >>
> >
> _________________________________________________________________________________________________________________
> > Questo messaggio è da intendersi esclusivamente ad uso del destinatario e
> > può contenere informazioni che sono di natura privilegiata, confidenziale
> > o non divulgabile secondo le leggi vigenti. Se il lettore del presente
> > messaggio non è il destinatario designato, o il dipendente/agente
> > responsabile
> > per la consegna del messaggio al destinatario designato, si informa che
> ogni
> > disseminazione, distribuzione o copiatura di questa comunicazione è
> > strettamente proibita anche ai sensi del decreto legislativo 196/03 . Se
> > avete ricevuto questo messaggio per errore, vi preghiamo di notificarcelo
> > immediatamente a mezzo e-mail di risposta e successivamente di procedere
> > alla cancellazione di questa e-mail e relativi allegati dal vostro
> sistema.
> >
> _________________________________________________________________________________________________________________
> > This message is intended only for the use of the addressee and may
> contain
> > information that is privileged, confidential and exempt from
> > disclosure under applicable law. If the reader of this message is not the
> > intended recipient, or the employee or agent responsible for delivering
> the
> > message to the intended recipient, you are hereby notified that any
> > dissemination, distribution or copying of this communication is strictly
> > prohibited. If you have received this e-mail in error, please notify us
> > immediately by return e-mail and delete this e-mail and all attachments
> from
> > your system.
> >
> _________________________________________________________________________________________________________________
> >
> > _______________________________________________
> > Powered by www.kitware.com
> >
> > Visit other Kitware open-source projects at
> > http://www.kitware.com/opensource/opensource.html
> >
> > Please keep messages on-topic and check the ParaView Wiki at:
> > http://paraview.org/Wiki/ParaView
> >
> > Follow this link to subscribe/unsubscribe:
> > http://www.paraview.org/mailman/listinfo/paraview
> >
> >
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the ParaView Wiki at:
> http://paraview.org/Wiki/ParaView
>
> Follow this link to subscribe/unsubscribe:
> http://www.paraview.org/mailman/listinfo/paraview
>



-- 
Zhanping Liu, PhD
Kitware, Inc.
28 Corporate Drive
Clifton Park, NY 12065-8662
Phone: 518-371-3971 x 138
http://www.zhanpingliu.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.paraview.org/pipermail/paraview/attachments/20100416/84d4f441/attachment-0001.htm>

More information about the ParaView mailing list