[Paraview] Connecting to pvserver

Thu Jan 24 00:10:24 EST 2013

Hello,

I have some more fundamental questions. The graphics machine that I am
planning to use has 128 processors.  I have attached the /proc/cpuinfo and
/proc/meminfo output at the end of this email. I've installed the binary
version of paraview right now for testing.

If I simply execute the command "paraview" on command line, will it not tap
the full capacity of the machine?
When I run simply "paraview", does the machine just use processor out of
the 128 available or it uses all the available resources. Will it be more
efficient to run paraview using mpi on this machine (in which case I guess
I should install paraview from source)?

My regrets, but this is a different machine than that I mentioned in my
very first email. Here I am not using any clusters.

Pradeep

Information of the last processor in /proc/cpuinfo

--------------------------------------------
processor : 127
vendor_id : GenuineIntel
cpu family : 6
model : 46
model name : Intel(R) Xeon(R) CPU           X7560  @ 2.27GHz
stepping : 6
cpu MHz : 2266.812
cache size : 24576 KB
physical id : 7
siblings : 16
core id : 11
cpu cores : 8
apicid : 247
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm
constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr
sse4_1 sse4_2 popcnt lahf_lm
bogomips : 4533.66
clflush size : 64
cache_alignment : 64
address sizes : 44 bits physical, 48 bits virtual
power management: [8]
-----------------------------------------------------------

Output of /proc/meminfo

------------------------------------------------------
MemTotal:     1054411612 kB
MemFree:      555700848 kB
Buffers:        360100 kB
Cached:       430018964 kB
SwapCached:          0 kB
Active:       24301128 kB
Inactive:     429373584 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     1054411612 kB
LowFree:      555700848 kB
SwapTotal:     2097136 kB
SwapFree:      2096068 kB
Dirty:            6252 kB
Writeback:           0 kB
AnonPages:    23296664 kB
Mapped:         222688 kB
Slab:         43752860 kB
PageTables:      56756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  529302940 kB
Committed_AS: 25295660 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    403800 kB
VmallocChunk: 34359330523 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB
--------------------------------------------------------------

2013/1/24 Pradeep Jha <pradeep.kumar.jha at gmail.com>

> Hi David,
>
> thanks for the detailed response. I am very new to using Paraview in
> parallel and still not very familiar with its terminologies. I want to make
> sure if I understood you correctly.
>
>
>    1. You are saying that I can install Paraview from source in my home
>    directory on the remote machine?
>    2. If I want to use the cluster, installing Paraview from source on
>    the remote (login) mode, such that the  computer nodes can access it,
>    should be sufficient?
>    3. If possible I would like to visualize a data of around 800 GB. A
>    machine that I can use for visualization has the following specifications:
>
>    *PRIMQUEST 1800E*
>
>    *CPU：8CPU (XeonTM X7560 2.26GHz (8core))*
>
>    *MEM：1TB*
>
>    Do you have any intuitive ideas if this will be sufficient?
>    4. What is the oldest version of Python that Paraview is compatible
>    with? Is this version fine?
>
>    *Python 2.4.3 (#1, Apr 14 2011, 20:41:59) *
>
>    *[GCC 4.1.2 20080704 (Red Hat 4.1.2-50)]*
>
>    *
>    *
>
>    I am sorry but I am very new to parallel visualization and I am having
>    a bit of a tough time putting it all together :)
>
>    Thanks
>
>    Pradeep
>
>
>
>
>
>
>
> 2013/1/17 David E DeMarle <dave.demarle at kitware.com>
>
>> On Thu, Jan 17, 2013 at 2:12 AM, Pradeep Jha
>> <pradeep.kumar.jha at gmail.com> wrote:
>> > Hello,
>> >
>> > I am trying to use PV for the first time in parallel. I have some basic
>> > questions.
>> >
>> > I have installed PV 3.98 from source on my local machine (Mac OSX). I
>> don't
>> > have the root permissions for the remote system I want to use for
>>
>> You shouldn't need root permissions. You can build paraview in your
>> home directory (or anywhere that the remote machine can read from) and
>> connect to that. You generally don't even have to run make install.
>>
>> > visaulization. So I installed the binary form of PV 3.98 on the remote
>>
>> Our binaries typically don't have an MPI in them that will work on the
>> cluster's network. What we have is more or less just for making use of
>> the cores on a single node. So you typically have to compile paraview
>> on the cluster and enable MPI to use it in distributed memory parallel
>> settings. It should work for you on the remote node, but not the
>> cluster.
>>
>> > system. I set up the server on that machine using the command:
>> >
>> > $mpiexec -n 4 pvserver --use-offscreen-rendering
>> >
>> > And then I am trying to connect to this server from the PV on my Mac.
>> But it
>> > is giving me the following error:
>> >
>> -----------------------------------------------------------------------------------------------------------------------------------------/Users/pradeep/softwares/ParaView/ParaViewCore/ClientServerCore/Core/vtkTCPNetworkAccessManager.cxx,
>> > line 332
>> > vtkTCPNetworkAccessManager (0x7f953b63aa30): Failed to connect to
>> > localhost:11150. Client-Server Handshake failed. Please verify that the
>> > client and server versions are compatible with each other
>> >
>> > Any ideas what is going wrong?
>>
>> This is most often happens when the client and server are mismatching
>> versions (3.14 connecting to 3.10 etc), but various network problems
>> can result in the same thing.
>>
>> >
>> > Also, this remote system has 16 processors. But for bigger jobs, I can
>> > submit a job on a cluster using this remote system using a shell script
>> > where it can use over 100 processors. But I cannot install anything on
>> this
>> > cluster. ...
>>
>> Same comment as before, you only have to have a paraview built
>> somewhere that the compute nodes can access, so you shouldn't have to
>> install it.
>>
>> > ... Can I use this remote cluster for using paraview faster?
>> >
>>
>> A word of caution - more nodes does not necessarily mean faster.
>> ParaView's parallel architecture allows it to process larger data and
>> larger data as more disks and memory are added - not the same sized
>> data faster and faster using more CPUs and GPUs are added (accept in
>> the infrequent case when processing and rendering are the
>> bottlenecks).
>>
>> > The structure is something like this: Mac ---> Remote system (16
>> processors)
>> > ----> Cluster with over 100 nodes.
>>
>> You'll need to set up an ssh tunnel through the remote (login) node to
>> the cluster in your job submission to do that.
>>
>> > Thanks,
>> > Pradeep
>> >
>>
>>
>> David E DeMarle
>> Kitware, Inc.
>> R&D Engineer
>> 21 Corporate Drive
>> Clifton Park, NY 12065-8662
>> Phone: 518-881-4909
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.paraview.org/pipermail/paraview/attachments/20130124/c7712154/attachment-0001.htm>