[Paraview] paraview osmesa render on supercomputer nodes

Mon Nov 20 13:41:13 EST 2017

Yes, the network environment in TianHe-2 is weird.

However, the problem can be solved manually by set ssh port forwarding like
this:

1. start pvserver on cn123 in direct connection mode and let it listen to
port 11111
2. manually modify the local port forward in my PC as: -L11111:<internal ip
of cn123>:11111
3. use paraview gui in my PC to connect to localhost:11111

I think it makes sense.

程迪
研发中心 工程师
中国航天空气动力技术研究院
电话：+86-l58Ol5949ll
地址：北京市丰台区云岗西路17号院
邮编：100074
Di Cheng
Engineer of Research Center
China Academy of Aerospace Aerodynamics
Phone: +86-l58Ol5949ll

Address: No.17, YunGang West Road, Fengtai District, Beijing, China

Zip Code：100074

On Mon, Nov 20, 2017 at 12:30 PM, David E DeMarle <dave.demarle at kitware.com>
wrote:

> ---
>
> This syntax isn't clear to me:
> > srun -n 24 pvserver -sp=15801 --mesa --use-offscreen-rendering
> --disable-xdisplay-test
> ---ssh -N -f -L15801:localhost:15801 though internal connection-->
> Where are you trying to run ssh on to open up this second (between login
> and compute) tunnel?
>
> ---
> ERROR: In /HOME/pp569/soft/ParaView-v5.4.1/VTK/Common/System/vtkSocket.cxx,
> line 206
> vtkServerSocket (0x20e9c20): Socket error in call to bind. Address already
> in use.
>
> Indicates that pvserver is trying to grab a socket that some other process
> owns. You might be competing with one of your other pvserver processes
> (from an earlier run or perhaps a misconfigured non-mpi pvserver task
> running on the same node from this srun invocation) or possibly your ssh
> tunnel process.
>
> ---
>
> Forward connections from desktop to login to compute are harder to setup
> in most cases because in general you don't know what compute node (and
> sometimes login node) you will get.
>
> ---
>
> I recommend using something simple like netcat to send and receive
> messages across each tunnel. If you can type on one side and see the text
> on the other, then paraview should be able to use the connection.
>
> ---
>
> Please let us know how it goes. We would love to see ParaView running on
> Tianhe-2!
>
> David E DeMarle
> Kitware, Inc.
> Principal Engineer
> 21 Corporate Drive
> <https://maps.google.com/?q=21+Corporate+Drive+Clifton+Park,+NY+12065&entry=gmail&source=g>
> Clifton Park, NY 12065
> <https://maps.google.com/?q=21+Corporate+Drive+Clifton+Park,+NY+12065&entry=gmail&source=g>
> -8662
> Phone: 518-881-4909 <(518)%20881-4909>
>
> On Mon, Nov 20, 2017 at 11:23 AM, Utkarsh Ayachit <
> utkarsh.ayachit at kitware.com> wrote:
>
>> Di,
>>
>> While it's not entirely obvious to me what could be going wrong, you
>> may to check these docs out instead:
>> https://www.paraview.org/Wiki/Reverse_connection_and_port_fo
>> rwarding#A_Forward_Connection_Over_an_ssh_Tunnel
>>
>> Utkarsh
>>
>> On Sat, Nov 18, 2017 at 7:04 AM, 程迪 <chengdi123000 at gmail.com> wrote:
>> > Hi everyone,
>> >
>> > I just compiled the OSMesa version of paraview 5.4.1 on Tianhe-2
>> > supercomputer. My trouble is to connect the pvserver running on
>> computing
>> > nodes while I am on login node with ssh tunnelling (-L).
>> >
>> > Here is what I did
>> >
>> > My computer (win7 64 bit)
>> > ---ssh -L15801:localhost:15801 through VPN--->
>> > LN31 (login node, RHEL maybe, using slurm)
>> >> srun -n 24 pvserver -sp=15801 --mesa --use-offscreen-rendering
>> >> --disable-xdisplay-test
>> > ---ssh -N -f -L15801:localhost:15801 though internal connection-->
>> > CNxxxx (computing node)
>> >
>> > And here is the error:
>> >
>> > ```
>> > Waiting for client...
>> > Connection URL: cs://cn10687:15801
>> > ERROR: In /HOME/pp569/soft/ParaView-v5.4.1/VTK/Common/System/vtkSocket
>> .cxx,
>> > line 206
>> > vtkServerSocket (0x20e9c20): Socket error in call to bind. Address
>> already
>> > in use.
>> >
>> > ERROR: In
>> > /HOME/pp569/soft/ParaView-v5.4.1/ParaViewCore/ClientServerCo
>> re/Core/vtkTCPNetworkAccessManager.cxx,
>> > line 349
>> > vtkTCPNetworkAccessManager (0x14ad080): Failed to set up server socket.
>> >
>> > Exiting...
>> > ```
>> >
>> > It seems not working. I am pretty sure that the PC -- ssh -L through
>> VPN -->
>> > LN works well. What happend in LN -- ssh -L --> CNxxx link?
>> >
>> > I have searched the internet for something, I found that LLNL did some
>> work
>> > on it
>> > [https://hpc.llnl.gov/data-vis/vis-software/paraview/running
>> -paraview-in-client-server-mode].
>> >
>> > They used `ssh -R` to map from LN to CN, rather than `ssh -L` and run
>> > paraview in RC mode, does it make any sense?
>> >
>> > However, in Tianhe-2, the `ssh -R` is forbidden. So I cannot use this
>> > method.
>> >
>> > Di Cheng
>> > Visting scholar at UConn ME Combustion Diagnostic Lab
>> > Engineer of Research Center of China Academy of Aerospace Aerodynamics
>> > Phone: +86-l58Ol5949ll
>> >
>> > Address: No.17, YunGang West Road, Fengtai District, Beijing, China
>> <https://maps.google.com/?q=No.17,+YunGang+West+Road,+Fengtai+District,+Beijing,+China+%0D+%3E+%0D+%3E+Zip+Code%EF%BC%9A100074&entry=gmail&source=g>
>> >
>> > Zip Code：100074
>> <https://maps.google.com/?q=No.17,+YunGang+West+Road,+Fengtai+District,+Beijing,+China+%0D+%3E+%0D+%3E+Zip+Code%EF%BC%9A100074&entry=gmail&source=g>
>> >
>> >
>> > _______________________________________________
>> > Powered by www.kitware.com
>> >
>> > Visit other Kitware open-source projects at
>> > http://www.kitware.com/opensource/opensource.html
>> >
>> > Please keep messages on-topic and check the ParaView Wiki at:
>> > http://paraview.org/Wiki/ParaView
>> >
>> > Search the list archives at: http://markmail.org/search/?q=ParaView
>> >
>> > Follow this link to subscribe/unsubscribe:
>> > http://public.kitware.com/mailman/listinfo/paraview
>> >
>> _______________________________________________
>> Powered by www.kitware.com
>>
>> Visit other Kitware open-source projects at
>> http://www.kitware.com/opensource/opensource.html
>>
>> Please keep messages on-topic and check the ParaView Wiki at:
>> http://paraview.org/Wiki/ParaView
>>
>> Search the list archives at: http://markmail.org/search/?q=ParaView
>>
>> Follow this link to subscribe/unsubscribe:
>> http://public.kitware.com/mailman/listinfo/paraview
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://public.kitware.com/pipermail/paraview/attachments/20171120/0ed399b8/attachment.html>