[Paraview] [ParaView3-Developer] Locking (MPI?) problems with ParaView 3.5

Utkarsh Ayachit utkarsh.ayachit at kitware.com
Tue Feb 10 09:40:03 EST 2009


John,

Here's my understanding of what may be happening:
* pvclient has done a gather data information and is waiting to
receive that data
* pvserver0 has received this "gather data" request is asking all
satellites to gather data
* pvserver1 also received that "gather data" request but before is
starts processing it, pv1 needs to pass on the message to it's "child"
i.e process 3 (this is the fancy tree based message communication that
we are now using. So now, instead of the root node sending the message
to all processes one after the other, it uses a tree structure).
* pvserver2 I believe is happily waiting for the next message. It
already processed the "gather data" request, sent the response to the
root (although root has not processed that response yet) and now is
waiting for  the next request.
* pvserver3 is the rogue. It's stuck in "Cancel", hence it won't
receive any messages other send to it. This cancel was not done as a
part of this gather data request but was done at the end of some
previous request. Thus it's not yet able to receive the "gather data"
request pvserver1 is trying to send, consequently freezing pvserver1.

Of course, this is just one possible explanation. I've attached a
patch. Can you please test if this overcomes the issue. If not, you
may also want to try by connecting the "Cancel" out all together. That
will at the least help us narrow down the problem.

Utkarsh


On Tue, Feb 10, 2009 at 2:56 AM, John Biddiscombe <biddisco at cscs.ch> wrote:
> I've been having problems with paraview 3.5 (CVS) since I started working on
> a parallel problem last week (which means it may have existed for some time,
> but I was doing other things).
>
> How to reproduce the problem
> Start pvserver on 4 (or more) nodes and pvclient on 1
> Create Sources/wavelet
> ParaView hangs indefinitley without showing bounding box of cube.
>
> Reproducibility : not always (3 out of 4 times - for me). Sometimes paraview
> completes as usual, but shows other hanging symptoms later on.
>
> ParaView 3.4 does not have this problem.
>
> Something seems to have changed between 3.4 and 3.5 which is affecting the
> client server delivery of data. It appears to be an MPI related issue. I
> have attached the debugger to all pvserver nodes and the stack traces are
> shown below
>
> To summarize :
> pvserver 3 : Cancelled a request
> pvserver 2 : waiting in ReceiveDataInternal
> pvserver 1 : still in vtkMPICommunicatorSendData<char>
> pvserver 0 : still in vtkMPICommunicatorSendData<char>
> pvclient : trying to Receive
>
> It seems that one of the pvserver nodes has given up sending, or has nothing
> to send and the others are waiting without end.
>
> Notes 1: It took me time to go from one node to the other and attach gdb, so
> if I stopped one task - another might have been affected before it had its
> stack trace dumped. I'm not very expert at gdb.
>
> Notes 2: ParaView 3.4 seems to work flawlessly. Something is different in
> 3.5
>
> Notes 3: I ran the b_eff_io ( https://fs.hlrs.de/projects/par/mpi//b_eff_io/
> - NB. link unreliable) on 15 nodes and it completed without error and
> without any unusual behaviuor, so my instinct is that our hpmpi is working
> ok.
>
> Questions :
> 1) Has anyone else observed this behaviour?
> 2) Has anyone changed anything in the mpi-commmunicator code which might
> have caused this behaviour
> 3) It's possible we have a network problem and this is causing the locking,
> but our logs do not show any errors - can we rule this out?
> 4) If anyone has answered yes to 1/2, do they know what's wrong and can they
> fix it?
>
> I welcome help as this is preventing me finishing my current project.
>
> JB
>
>
> Stack trace for pvserver 3
> ==========================
>
> #0  0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6
> #1  0x0000002a9a725a97 in hpmp_yield () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #2  0x0000002a9a71f3b4 in hpmp_adv () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #3  0x0000002a9a757012 in hpmp_waitany () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #4  0x0000002a9a756cf0 in VMPI_Waitany () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #5  0x0000002a9a753a9e in VMPI_Wait () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #6  0x0000002a9a754520 in VMPI_Cancel () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #7  0x0000002a99e27045 in vtkMPICommunicator::Request::Cancel
> (this=0xacf740) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:973
> #8  0x0000002a95639e36 in vtkPVProgressHandler::CleanupSatellites
> (this=0xae8dd0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkPVProgressHandler.cxx:399
> #9  0x0000002a95639c85 in vtkPVProgressHandler::CleanupPendingProgress
> (this=0xae8dd0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkPVProgressHandler.cxx:337
> #10 0x0000002a956061ce in vtkProcessModule::CleanupPendingProgress
> (this=0x590ee0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:1267
> #11 0x0000002a965b22f7 in vtkProcessModuleCommand (arlu=0x591d20,
> ob=0x590ee0, method=0xb69dc9 "CleanupPendingProgress", msg=@0x7fbfffdec0,
> resultStream=@0x590330)
>     at
> /users/biddisco/build/pv-shared/Servers/Common/vtkProcessModuleClientServer.cxx:316
> #12 0x0000002a9995f4e0 in vtkClientServerInterpreter::ProcessCommandInvoke
> (this=0x591d20, css=@0x7fbfffe120, midx=0)
>     at
> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:384
> #13 0x0000002a9995ecfc in vtkClientServerInterpreter::ProcessOneMessage
> (this=0x591d20, css=@0x7fbfffe120, message=0)
>     at
> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:214
> #14 0x0000002a9995ebe9 in vtkClientServerInterpreter::ProcessStream
> (this=0x591d20, css=@0x7fbfffe120)
>     at
> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:183
> #15 0x0000002a9995eb7b in vtkClientServerInterpreter::ProcessStream
> (this=0x591d20, msg=0xb68e10 "\001\001", msgLength=48)
>     at
> /users/biddisco/code/pv-meshless/Utilities/VTKClientServer/vtkClientServerInterpreter.cxx:175
> #16 0x0000002a95658ee2 in vtkSelfConnection::ProcessStreamLocally
> (this=0xad1a10, data=0xb68e10 "\001\001", length=48) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkSelfConnection.cxx:128
> #17 0x0000002a955f5ca2 in vtkMPISelfConnectionProcessRMI (localArg=0xad1a10,
> remoteArg=0xb68e10, remoteArgLength=48) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:38
> #18 0x0000002a99d665e9 in vtkMultiProcessController::ProcessRMI
> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb68e10, argLength=48,
> rmiTag=397529)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:551
> #19 0x0000002a99d66372 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:503
> #20 0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434
> #21 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite
> (this=0xad1a10) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154
> #22 0x0000002a955f6110 in vtkMPISelfConnection::Initialize (this=0xad1a10,
> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113
> #23 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize
> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0,
> partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145
> #24 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1,
> argv=0x590050) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316
> #25 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, options=0x58fad0)
> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261
> #26 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at
> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45
>
> Stack trace for pvserver 2
> ==========================
>
> #0  0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6
> #1  0x0000002a9a725a97 in hpmp_yield () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #2  0x0000002a9a71f3b4 in hpmp_adv () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #3  0x0000002a9a766425 in recv_notfast () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #4  0x0000002a9a765be4 in VMPI_Recv () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #5  0x0000002a99e2460b in vtkMPICommunicator::ReceiveDataInternal
> (this=0xad04f0, data=0x7fbfffe2c0 "Ù\020\006", length=512, sizeoftype=1,
> remoteProcessId=-2, tag=1, info=0x7fbfffe170, useCopy=0,
>     senderId=@0xad0538) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:257
> #6  0x0000002a99e26889 in vtkMPICommunicator::ReceiveVoidArray
> (this=0xad04f0, data=0x7fbfffe2c0, maxlength=512, type=3,
> remoteProcessId=-1, tag=1)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:754
> #7  0x0000002a955f71c1 in vtkCommunicator::Receive (this=0xad04f0,
> data=0x7fbfffe2c0 "Ù\020\006", maxlength=512, remoteHandle=-1, tag=1)
>     at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:213
> #8  0x0000002a99d65da8 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:446
> #9  0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434
> #10 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite
> (this=0xad1a10) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154
> #11 0x0000002a955f6110 in vtkMPISelfConnection::Initialize (this=0xad1a10,
> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113
> #12 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize
> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0,
> partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145
> #13 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1,
> argv=0x590050) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316
> #14 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, options=0x58fad0)
> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261
> #15 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at
> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45
>
> Stack trace for pvserver 1
> ==========================
>
> #0  0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6
> #1  0x0000002a9a725a97 in hpmp_yield () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #2  0x0000002a9a71f3b4 in hpmp_adv () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #3  0x0000002a9a75ae2d in hpmp_blksend () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #4  0x0000002a9a758aff in VMPI_Ssend () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #5  0x0000002a99e29bf0 in vtkMPICommunicatorSendData<char>
> (data=0x7fbfffdf90 "Ù\020\006", length=57, sizeoftype=1, remoteProcessId=3,
> tag=1, datatype=0x2a9a923e40, Handle=0xadf4b0, useCopy=0,
>     useSsend=1) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:223
> #6  0x0000002a99e2656b in vtkMPICommunicator::SendVoidArray (this=0xad04f0,
> data=0x7fbfffdf90, length=57, type=3, remoteProcessId=3, tag=1)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:716
> #7  0x0000002a955f3983 in vtkCommunicator::Send (this=0xad04f0,
> data=0x7fbfffdf90 "Ù\020\006", length=57, remoteHandle=3, tag=1)
>     at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:152
> #8  0x0000002a99d65b57 in vtkMultiProcessController::TriggerRMIInternal
> (this=0x2a9eb49010, remoteProcessId=3, arg=0xb69c20, argLength=41,
> rmiTag=397529, propagate=true)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:397
> #9  0x0000002a99e2ad2c in vtkMPIController::TriggerRMIInternal
> (this=0x2a9eb49010, remoteProcessId=3, arg=0xb69c20, argLength=41,
> rmiTag=397529, propagate=true)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPIController.cxx:126
> #10 0x0000002a99d659b8 in vtkMultiProcessController::TriggerRMIOnAllChildren
> (this=0x2a9eb49010, arg=0xb69c20, argLength=41, rmiTag=397529)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:343
> #11 0x0000002a99d6634d in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010, reportErrors=1, dont_loop=0) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:501
> #12 0x0000002a99d65d53 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb49010) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:434
> #13 0x0000002a955f61e3 in vtkMPISelfConnection::InitializeSatellite
> (this=0xad1a10) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:154
> #14 0x0000002a955f6110 in vtkMPISelfConnection::Initialize (this=0xad1a10,
> argc=1, argv=0x590050, partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:113
> #15 0x0000002a955fa798 in vtkProcessModuleConnectionManager::Initialize
> (this=0x89efd0, argc=1, argv=0x590050, clientMode=0,
> partitionId=0x7fbfffe5fc)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:145
> #16 0x0000002a9560350e in vtkProcessModule::Start (this=0x590ee0, argc=1,
> argv=0x590050) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:316
> #17 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, options=0x58fad0)
> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261
> #18 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at
> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45
>
> Stack trace for pvserver 0
> ==========================
>
> #0  0x0000003dbd4afba9 in sched_yield () from /lib64/tls/libc.so.6
> #1  0x0000002a9a725a97 in hpmp_yield () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #2  0x0000002a9a71f3b4 in hpmp_adv () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #3  0x0000002a9a75ae2d in hpmp_blksend () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #4  0x0000002a9a758aff in VMPI_Ssend () from
> /opt/hpmpi/lib/linux_amd64/libmpi.so.1
> #5  0x0000002a99e29bf0 in vtkMPICommunicatorSendData<char>
> (data=0x7fbfffdc10 "m\234\a", length=62, sizeoftype=1, remoteProcessId=1,
> tag=1, datatype=0x2a9a923e40, Handle=0xadf4b0, useCopy=0,
>     useSsend=1) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:223
> #6  0x0000002a99e2656b in vtkMPICommunicator::SendVoidArray (this=0xad04f0,
> data=0x7fbfffdc10, length=62, type=3, remoteProcessId=1, tag=1)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPICommunicator.cxx:716
> #7  0x0000002a955f3983 in vtkCommunicator::Send (this=0xad04f0,
> data=0x7fbfffdc10 "m\234\a", length=62, remoteHandle=1, tag=1)
>     at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:152
> #8  0x0000002a99d65b57 in vtkMultiProcessController::TriggerRMIInternal
> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb6fed0, argLength=46,
> rmiTag=498797, propagate=true)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:397
> #9  0x0000002a99e2ad2c in vtkMPIController::TriggerRMIInternal
> (this=0x2a9eb49010, remoteProcessId=1, arg=0xb6fed0, argLength=46,
> rmiTag=498797, propagate=true)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMPIController.cxx:126
> #10 0x0000002a99d659b8 in vtkMultiProcessController::TriggerRMIOnAllChildren
> (this=0x2a9eb49010, arg=0xb6fed0, argLength=46, rmiTag=498797)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:343
> #11 0x0000002a955f6716 in vtkMPISelfConnection::GatherInformationRoot
> (this=0xad1a10, info=0xb6ac00, id={ID = 560}) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:290
> #12 0x0000002a955f6683 in vtkMPISelfConnection::GatherInformation
> (this=0xad1a10, serverFlags=1, info=0xb6ac00, id={ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkMPISelfConnection.cxx:275
> #13 0x0000002a955fc66b in
> vtkProcessModuleConnectionManager::GatherInformation (this=0x89efd0,
> connectionID=1, serverFlags=1, info=0xb6ac00, id={ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:565
> #14 0x0000002a95603311 in vtkProcessModule::GatherInformation
> (this=0x590ee0, connectionID=1, serverFlags=1, info=0xb6ac00, id={ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:293
> #15 0x0000002a955f2db6 in vtkClientConnection::SendInformation
> (this=0xae4be0, stream=@0x7fbfffe130) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkClientConnection.cxx:398
> #16 0x0000002a955f1d9f in vtkClientConnectionGatherInformationRMI
> (localArg=0xae4be0, remoteArg=0xb6b3b0, remoteArgLength=46)
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkClientConnection.cxx:109
> #17 0x0000002a99d665e9 in vtkMultiProcessController::ProcessRMI
> (this=0x2a9eb6b010, remoteProcessId=1, arg=0xb6b3b0, argLength=46,
> rmiTag=838491)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:551
> #18 0x0000002a99d66372 in vtkMultiProcessController::ProcessRMIs
> (this=0x2a9eb6b010, reportErrors=0, dont_loop=1) at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.cxx:503
> #19 0x0000002a9565235e in vtkRemoteConnection::ProcessCommunication
> (this=0xae4be0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkRemoteConnection.cxx:75
> #20 0x0000002a955fc046 in
> vtkProcessModuleConnectionManager::MonitorConnections (this=0x89efd0,
> msec=0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:430
> #21 0x0000002a95603a62 in vtkProcessModule::StartServer (this=0x590ee0,
> msec=0) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:438
> #22 0x0000002a95603602 in vtkProcessModule::Start (this=0x590ee0, argc=1,
> argv=0x590050) at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:349
> #23 0x0000002a95a9bd38 in vtkPVMain::Run (this=0x58fe00, options=0x58fad0)
> at /users/biddisco/code/pv-meshless/Servers/Filters/vtkPVMain.cxx:261
> #24 0x00000000004015fa in main (argc=1, argv=0x7fbfffe7f8) at
> /users/biddisco/code/pv-meshless/Servers/Executables/pvserver.cxx:45
>
> Stack trace for pvclient
> ========================
> #0  0x0000003dbdb0b5b4 in recv () from /lib64/tls/libpthread.so.0
> #1  0x0000002aa0b3d77f in vtkSocket::Receive (this=0x116ed70,
>     data=0x7fbfffc2cc, length=4, readFully=1)
>     at /users/biddisco/code/pv-meshless/VTK/Common/vtkSocket.cxx:381
> #2  0x0000002a9e039632 in vtkSocketCommunicator::ReceiveTagged (
>     this=0x1773fd0, data=0x7fbfffc4dc, wordSize=4, numWords=1, tag=838492,
>     logName=0x1b8d3d8 "Int32")
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkSocketCommunicator.cxx:701
> #3  0x0000002a9e0369b5 in vtkSocketCommunicator::ReceiveVoidArray (
>     this=0x1773fd0, data=0x7fbfffc4dc, length=1, type=6, remoteProcessId=1,
>     tag=838492)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkSocketCommunicator.cxx:282
> #4  0x0000002a98e85455 in vtkCommunicator::Receive (this=0x1773fd0,
>     data=0x7fbfffc4dc, maxlength=1, remoteHandle=1, tag=838492)
>     at /users/biddisco/code/pv-meshless/VTK/Parallel/vtkCommunicator.h:203
> #5  0x0000002a98e853f0 in vtkMultiProcessController::Receive
> (this=0x172fe40,
>     data=0x7fbfffc4dc, length=1, remoteProcessId=1, tag=838492)
>     at
> /users/biddisco/code/pv-meshless/VTK/Parallel/vtkMultiProcessController.h:1139
> #6  0x0000002a9b494d69 in
> vtkServerConnection::GatherInformationFromController
>     (this=0x11d97d0, controller=0x172fe40, info=0x1b77250, id={ID = 560})
> ---Type <return> to continue, or q <return> to quit---
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkServerConnection.cxx:341
> #7  0x0000002a9b494c5f in vtkServerConnection::GatherInformation (
>     this=0x11d97d0, serverFlags=1, info=0x1b77250, id={ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkServerConnection.cxx:311
> #8  0x0000002a9b43666b in
> vtkProcessModuleConnectionManager::GatherInformation
>     (this=0x681de0, connectionID=5, serverFlags=1, info=0x1b77250, id=
>       {ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModuleConnectionManager.cxx:565
> #9  0x0000002a9b43d311 in vtkProcessModule::GatherInformation
> (this=0x5bd330,
>     connectionID=5, serverFlags=1, info=0x1b77250, id={ID = 560})
>     at
> /users/biddisco/code/pv-meshless/Servers/Common/vtkProcessModule.cxx:293
> #10 0x0000002a986919dc in vtkSMOutputPort::GatherDataInformation (
>     this=0x1b76ec0)
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMOutputPort.cxx:233
> #11 0x0000002a98691756 in vtkSMOutputPort::GetDataInformation
> (this=0x1b76ec0)
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMOutputPort.cxx:192
> #12 0x0000002a987069a1 in vtkSMSourceProxy::GetDataInformation (
>     this=0x1b57ad0, idx=0)
> ---Type <return> to continue, or q <return> to quit---
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:615
> #13 0x0000002a95d6b1ee in pqOutputPort::getDataInformation (this=0x1b6e6f0)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqOutputPort.cxx:112
> #14 0x0000002a957f4652 in pqDataInformationModel::dataUpdated
> (this=0x11587a0,
>     changedSource=0x1b6e3b0)
>     at
> /users/biddisco/code/pv-meshless/Qt/Components/pqDataInformationModel.cxx:492
> #15 0x0000002a95966898 in pqDataInformationModel::qt_metacall
> (this=0x11587a0,
>     _c=QMetaObject::InvokeMetaMethod, _id=3, _a=0x7fbfffc940)
>     at
> /users/biddisco/build/pv-shared/Qt/Components/moc_pqDataInformationModel.cxx:77
> #16 0x0000002a9774322f in QMetaObject::activate (sender=0x1b6e3b0,
>     from_signal_index=14, to_signal_index=14, argv=Variable "argv" is not
> available.
> ) at kernel/qobject.cpp:3007
> #17 0x0000002a95de65f9 in pqPipelineSource::dataUpdated (this=0x1b6e3b0,
>     _t1=0x1b6e3b0)
>     at /users/biddisco/build/pv-shared/Qt/Core/moc_pqPipelineSource.cxx:178
> #18 0x0000002a95d74479 in pqPipelineSource::dataUpdated (this=0x1b6e3b0)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqPipelineSource.cxx:159
> #19 0x0000002a95de6303 in pqPipelineSource::qt_metacall (this=0x1b6e3b0,
>     _c=QMetaObject::InvokeMetaMethod, _id=16, _a=0x7fbfffca70)
>     at /users/biddisco/build/pv-shared/Qt/Core/moc_pqPipelineSource.cxx:118
> #20 0x0000002a9774322f in QMetaObject::activate (sender=0x1b6ec60,
> ---Type <return> to continue, or q <return> to quit---
>     from_signal_index=4, to_signal_index=4, argv=Variable "argv" is not
> available.
> ) at kernel/qobject.cpp:3007
> #21 0x0000002a97ba3850 in vtkQtConnection::EmitExecute (this=0x1b6ec60,
>     _t1=0x1b57ad0, _t2=75, _t3=0x0, _t4=0x0, _t5=0x1b6e820)
>     at
> /users/biddisco/build/pv-shared/VTK/GUISupport/Qt/moc_vtkQtConnection.cxx:77
> #22 0x0000002a97b7b395 in vtkQtConnection::Execute (this=0x1b6ec60,
>     caller=0x1b57ad0, e=75, call_data=0x0)
>     at
> /users/biddisco/code/pv-meshless/VTK/GUISupport/Qt/vtkQtConnection.cxx:72
> #23 0x0000002a97b7b327 in vtkQtConnection::DoCallback (vtk_obj=0x1b57ad0,
>     event=75, client_data=0x1b6ec60, call_data=0x0)
>     at
> /users/biddisco/code/pv-meshless/VTK/GUISupport/Qt/vtkQtConnection.cxx:62
> #24 0x0000002aa0a1ad9e in vtkCallbackCommand::Execute (this=0x1b6e820,
>     caller=0x1b57ad0, event=75, callData=0x0)
>     at /users/biddisco/code/pv-meshless/VTK/Common/vtkCallbackCommand.cxx:42
> #25 0x0000002aa0afa433 in vtkSubjectHelper::InvokeEvent (this=0x1b65de0,
>     event=75, callData=0x0, self=0x1b57ad0)
>     at /users/biddisco/code/pv-meshless/VTK/Common/vtkObject.cxx:602
> #26 0x0000002aa0afa8ea in vtkObject::InvokeEvent (this=0x1b57ad0, event=75,
>     callData=0x0)
>     at /users/biddisco/code/pv-meshless/VTK/Common/vtkObject.cxx:770
> #27 0x0000002a986b0b59 in vtkSMProxy::PostUpdateData (this=0x1b57ad0)
> ---Type <return> to continue, or q <return> to quit---
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMProxy.cxx:1726
> #28 0x0000002a987064b4 in vtkSMSourceProxy::PostUpdateData (this=0x1b57ad0)
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:521
> #29 0x0000002a98705955 in vtkSMSourceProxy::UpdatePipeline (this=0x1b57ad0,
>     time=0)
>     at
> /users/biddisco/code/pv-meshless/Servers/ServerManager/vtkSMSourceProxy.cxx:305
> #30 0x0000002a95d7445e in pqPipelineSource::updatePipeline (this=0x1b6e3b0)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqPipelineSource.cxx:153
> #31 0x0000002a95d35468 in pqDisplayPolicy::getPreferredViewType (
>     this=0xb90e10, opPort=0x1b6e6f0, update_pipeline=true)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:74
> #32 0x0000002a95d3599d in pqDisplayPolicy::getPreferredView (this=0xb90e10,
>     opPort=0x1b6e6f0, currentView=0x1994dc0)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:182
> #33 0x0000002a95d35ba6 in pqDisplayPolicy::createPreferredRepresentation (
>     this=0xb90e10, opPort=0x1b6e6f0, view=0x1994dc0, dont_create_view=false)
>     at /users/biddisco/code/pv-meshless/Qt/Core/pqDisplayPolicy.cxx:234
> #34 0x0000002a95d6c9a3 in pqPendingDisplayManager::createPendingDisplays (
>     this=0xd16110, activeview=0x1994dc0)
>     at
> /users/biddisco/code/pv-meshless/Qt/Core/pqPendingDisplayManager.cxx:178
> ---Type <return> to continue, or q <return> to quit---
> #35 0x0000002a95d6ccc1 in pqPendingDisplayManager::createPendingDisplays (
>     this=0xd16110)
>     at
> /users/biddisco/code/pv-meshless/Qt/Core/pqPendingDisplayManager.cxx:255
> #36 0x0000002a95de598b in pqPendingDisplayManager::qt_metacall
> (this=0xd16110,
>     _c=QMetaObject::InvokeMetaMethod, _id=5, _a=0x7fbfffd108)
>     at
> /users/biddisco/build/pv-shared/Qt/Core/moc_pqPendingDisplayManager.cxx:82
> #37 0x0000002a9774322f in QMetaObject::activate (sender=0x1120a90,
>     from_signal_index=28, to_signal_index=28, argv=Variable "argv" is not
> available.
> ) at kernel/qobject.cpp:3007
> #38 0x0000002a95970da6 in pqObjectInspectorWidget::accepted (this=0x1120a90)
>     at
> /users/biddisco/build/pv-shared/Qt/Components/moc_pqObjectInspectorWidget.cxx:133
> #39 0x0000002a9589ba81 in pqObjectInspectorWidget::accept (this=0x1120a90)
>     at
> /users/biddisco/code/pv-meshless/Qt/Components/pqObjectInspectorWidget.cxx:517
> #40 0x0000002a95970c78 in pqObjectInspectorWidget::qt_metacall (
>     this=0x1120a90, _c=QMetaObject::InvokeMetaMethod, _id=9,
> _a=0x7fbfffd300)
>     at
> /users/biddisco/build/pv-shared/Qt/Components/moc_pqObjectInspectorWidget.cxx:107
> #41 0x0000002a9774322f in QMetaObject::activate (sender=0x1123a20,
>     from_signal_index=29, to_signal_index=30, argv=Variable "argv" is not
> available.
> ) at kernel/qobject.cpp:3007
> #42 0x0000002a96f0e6b7 in QAbstractButton::clicked (this=Variable "this" is
> not available.
> )
>     at .moc/release-shared/moc_qabstractbutton.cpp:185
> ---Type <return> to continue, or q <return> to quit---
> #43 0x0000002a96c7bdae in QAbstractButtonPrivate::emitClicked
> (this=0x1123a50)
>     at widgets/qabstractbutton.cpp:544
> #44 0x0000002a96c7c5ba in QAbstractButtonPrivate::click (this=0x1123a50)
>     at widgets/qabstractbutton.cpp:537
> #45 0x0000002a96c7c801 in QAbstractButton::mouseReleaseEvent
> (this=0x1123a20,
>     e=0x7fbfffdad0) at widgets/qabstractbutton.cpp:1116
> #46 0x0000002a96992bfc in QWidget::event (this=0x1123a20,
> event=0x7fbfffdad0)
>     at kernel/qwidget.cpp:7021
> #47 0x0000002a96c7bcc2 in QAbstractButton::event (this=0x1123a20, e=Variable
> "e" is not available.
> )
>     at widgets/qabstractbutton.cpp:1078
> #48 0x0000002a96d1ace6 in QPushButton::event (this=0x1123a20,
> e=0x7fbfffdad0)
>     at widgets/qpushbutton.cpp:658
> #49 0x0000002a969428f0 in QApplicationPrivate::notify_helper (this=0x55b870,
>     receiver=0x1123a20, e=0x7fbfffdad0) at kernel/qapplication.cpp:3800
> #50 0x0000002a9694335e in QApplication::notify (this=Variable "this" is not
> available.
> )
>     at kernel/qapplication.cpp:3527
> #51 0x0000002a977323c7 in QCoreApplication::notifyInternal
> (this=0x7fbfffe720,
>     receiver=0x1123a20, event=0x7fbfffdad0) at
> kernel/qcoreapplication.cpp:591
> #52 0x0000002a96944afc in QApplicationPrivate::sendMouseEvent (
>     receiver=0x1123a20, event=0x7fbfffdad0, alienWidget=0x1123a20,
>     nativeWidget=0x105fbf0, buttonDown=Variable "buttonDown" is not
> available.
> )
>     at ../../include/QtCore/../../src/corelib/kernel/qcoreapplication.h:218
> #53 0x0000002a969ad76a in QETWidget::translateMouseEvent (this=0x105fbf0,
> ---Type <return> to continue, or q <return> to quit---
>     event=Variable "event" is not available.
> ) at kernel/qapplication_x11.cpp:4047
> #54 0x0000002a969ac31d in QApplication::x11ProcessEvent (this=0x7fbfffe720,
>     event=0x7fbfffe3a0) at kernel/qapplication_x11.cpp:3244
> #55 0x0000002a969d0612 in x11EventSourceDispatch (s=0x55ebe0, callback=0,
>     user_data=0x0)
>     at ../../include/QtCore/../../src/corelib/kernel/qcoreapplication.h:104
> #56 0x0000003dc0026606 in g_main_context_dispatch ()
>    from /usr/lib64/libglib-2.0.so.0
> #57 0x0000003dc002821e in g_main_context_acquire ()
>    from /usr/lib64/libglib-2.0.so.0
> #58 0x0000003dc002873f in g_main_context_iteration ()
>    from /usr/lib64/libglib-2.0.so.0
> #59 0x0000002a9775c060 in QEventDispatcherGlib::processEvents
> (this=0x55c940,
>     flags={i = 4}) at kernel/qeventdispatcher_glib.cpp:327
> #60 0x0000002a969d0009 in QGuiEventDispatcherGlib::processEvents
> (this=Variable "this" is not available.
> )
>     at ../../include/QtCore/../../src/corelib/global/qglobal.h:1915
> #61 0x0000002a97731a23 in QEventLoop::processEvents (this=Variable "this" is
> not available.
> )
>     at ../../include/QtCore/../../src/corelib/global/qglobal.h:1915
> #62 0x0000002a97731bd2 in QEventLoop::exec (this=0x7fbfffe670, flags={i =
> 0})
>     at ../../include/QtCore/../../src/corelib/global/qglobal.h:1931
> #63 0x0000002a977361d8 in QCoreApplication::exec ()
>     at ../../include/QtCore/../../src/corelib/global/qglobal.h:1916
> #64 0x0000000000404139 in main (argc=2, argv=0x7fbfffe828)
> ---Type <return> to continue, or q <return> to quit---
>     at /users/biddisco/code/pv-meshless/Applications/Client/main.cxx:80
>
>
> _______________________________________________
> ParaQ-Developer mailing list
> ParaQ-Developer at paraview.org
> http://public.kitware.com/cgi-bin/mailman/listinfo/paraq-developer
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mpifreeze.patch
Type: text/x-diff
Size: 812 bytes
Desc: not available
URL: <http://www.paraview.org/pipermail/paraview/attachments/20090210/9e5667fa/attachment-0001.patch>


More information about the ParaView mailing list