[Paraview] Paraview 3.6.x connection definition files
Rick Angelini
rick.angelini at us.army.mil
Tue Mar 23 12:44:55 EDT 2010
I'm thinking that this change is *almost* correct, but maybe not quite?
It looks like you appended the server resource string rather than the
server name? I'm not sure that the resource string works well in this
instance????
csrc%3A\127.0.0.1.PROJECTNUM=XYZ123ABC
csrc%3A\127.0.0.1.PV_CONNECT_ID=28594
csrc%3A\127.0.0.1.USERNAME=joeuser
csrc%3A\127.0.0.1.SERVERNAME=hostname.mil
csrc%3A\127.0.0.1.NUMPROC=2
csrc%3A\127.0.0.1.SSHLOC=/usr/local/bin/ssh
csrc%3A\127.0.0.1.PV_SERVER_PORT=22884
csrc%3A\127.0.0.1.QUEUE=debug
csrc%3A\127.0.0.1.SERVER_PORT=6879
csrc%3A\127.0.0.1.VERSION=3.6.2
csrc%3A\127.0.0.1.PTILE=1
csrc%3A\127.0.0.1.WALLTIME=5
Utkarsh Ayachit wrote:
>
> Rick,
>
> I've committed a fix for this. Feel free to give it a try.
>
> Utkarsh
>
> On Fri, Mar 19, 2010 at 11:57 AM, Utkarsh Ayachit
> <utkarsh.ayachit at kitware.com> wrote:
> > Ah...interesting thought. I'll take a look.
> >
> > On Fri, Mar 19, 2010 at 11:41 AM, Rick Angelini
> > <rick.angelini at us.army.mil> wrote:
> >> I've run into a situation where things are not yet being handled
> correctly
> >> with this issue. I'm currently testing with 3.7.x assuming
> that's the
> >> where the work is going on for the next release. The original
> issue can be
> >> found here:
> >>
> >> http://www.paraview.org/Bug/view.php?id=9866#c18827
> >>
> >>
> >> As stated in the issue resolution, the saved values are now being
> stored in
> >> the users .ini file, but they are not unique for each server.
> That is,
> >> it appears to be creating "global variables" rather than saving off
> >> variables per server. So, I have something that looks like this
> in my
> >> .ini file:
> >>
> >> [SERVER_STARUP]
> >> SSHLOC=/usr/local/bin/ssh
> >> LOGINNODE=login-node1
> >> USERNAME=user
> >> PROJECTNUM=ABC123Project
> >> PV_CONNECT_ID=13829
> >> NODES=2
> >> QUEUE=debug
> >> SERVER_PORT=55876
> >> WALLTIME=60
> >> VERSION=3.7.0
> >>
> >> If I now load up a different server which happens to use the same
> variable
> >> names, these automatically get dumped into the connection
> definition file,
> >> which is OK assuming that you have the same USERNAME, PROJECTNUM,
> etc across
> >> all systems, which is not the case. So, I have multiple connection
> >> definition files pointing to multiple machines with different
> usernames and
> >> ProjectIDs, and by default I'm getting the values from the previous
> session
> >> rather than the values from the previous session for that
> particular server.
> >> I'm wondering if the best way to save these variables is
> something more
> >> like this:
> >>
> >> hostname1.USERNAME=jimuser
> >> hostname1.PROJECTNUM=ABC123Project
> >> hostname2.USERNAME=joeuser
> >> hostname2.PROJECTNUM=XYZ789Project
> >>
> >> Where "hostname" is the Server name from the .pvsc file.
> >>
> >>
> >> Utkarsh Ayachit wrote:
> >>>
> >>> I've ensured that when "random" is specified as the default value for
> >>> any option, which is the case with --connect-id, then the value is
> >>> always regenerated, so this will be a non-issue. Also you can always
> >>> add save="false" attribute, if needed -- but not necessary in this
> >>> case.
> >>>
> >>> Utkarsh
> >>>
> >>> On Mon, Jan 11, 2010 at 8:38 PM, Scott, W Alan
> <wascott at sandia.gov> wrote:
> >>> > Am I missing something, or would we also save the --connect-id flag
> >>> > between sessions? This needs to be new, and random, each and
> every time we
> >>> > run.
> >>> >
> >>> > This was the reason that the save option was put into Paraview -
> so we
> >>> > wouldn't save the --connect-id variable.
> >>> >
> >>> > Alan
> >>> >
> >>> >> -----Original Message-----
> >>> >> From: Moreland, Kenneth
> >>> >> Sent: Monday, January 11, 2010 1:52 PM
> >>> >> To: Scott, W Alan; Utkarsh Ayachit
> >>> >> Cc: Rick Angelini; ParaView
> >>> >> Subject: Re: [Paraview] Paraview 3.6.x connection definition files
> >>> >>
> >>> >> Utkarsh,
> >>> >>
> >>> >> Is there a reason why we should not save all options as
> >>> >> opposed to just those with the "save" attribute? I cannot
> >>> >> think of a good use case to not save an option, and even if
> >>> >> there is a good use case wouldn't it be rare enough to
> >>> >> justify saving by default and having an attribute to turn off
> >>> >> saving? Furthermore, until you made that change the behavior
> >>> >> has been to save all of the options, and to my knowledge no
> >>> >> one has complained about that.
> >>> >>
> >>> >> -Ken
> >>> >>
> >>> >>
> >>> >> On 1/11/10 12:11 PM, "Scott, W Alan" <wascott at sandia.gov> wrote:
> >>> >>
> >>> >> > Thanks, you're the greatest!
> >>> >> >
> >>> >> > I think that the save attribute is necessary, since we need to
> >>> >> > --connect-id flag to not be saved between sessions - and to
> >>> >> truly be
> >>> >> > random. This is mandatory for some of our systems.
> >>> >> >
> >>> >> > Alan
> >>> >> >
> >>> >> >> -----Original Message-----
> >>> >> >> From: Utkarsh Ayachit [mailto:utkarsh.ayachit at kitware.com]
> >>> >> >> Sent: Monday, January 11, 2010 12:05 PM
> >>> >> >> To: Moreland, Kenneth
> >>> >> >> Cc: Rick Angelini; Scott, W Alan; ParaView
> >>> >> >> Subject: Re: [Paraview] Paraview 3.6.x connection definition
> files
> >>> >> >>
> >>> >> >> Folks,
> >>> >> >>
> >>> >> >> I've committed a fix for this. The updating of the user's
> >>> >> >> servers.pvsc file was totally unnecessary (there was code
> >>> >> elsewhere
> >>> >> >> that handled BUG #5487). However the user selections for
> >>> >> only those
> >>> >> >> <Option /> elements that have the "save" attribute set to
> true are
> >>> >> >> preserved across sessions.
> >>> >> >>
> >>> >> >> Refer to
> >>> >> >> http://www.paraview.org/Wiki/ParaView:Server_Configuration#Cas
> >>> >> >> e_Eight:_Starting_server_using_ssh
> >>> >> >>
> >>> >> >> for details on the "save" attribute. I am wondering if
> that's even
> >>> >> >> needed and we can always save all options i.e. assume
> >>> >> "save" is true
> >>> >> >> by default. What do you think?
> >>> >> >>
> >>> >> >> Utkarsh
> >>> >> >>
> >>> >> >> On Mon, Nov 9, 2009 at 10:45 AM, Moreland, Kenneth
> >>> >> >> <kmorel at sandia.gov> wrote:
> >>> >> >>> I've submitted a bug on this issue:
> >>> >> >>>
> >>> >> >>> http://www.paraview.org/Bug/view.php?id=9866
> >>> >> >>>
> >>> >> >>> Please take a look at it and see if it and the suggested
> solution
> >>> >> >>> addresses the problem.
> >>> >> >>>
> >>> >> >>> -Ken
> >>> >> >>>
> >>> >> >>>
> >>> >> >>> On 11/5/09 12:25 PM, "Rick Angelini" <angel at arl.army.mil>
> wrote:
> >>> >> >>>
> >>> >> >>> Alan - I think that you do want to allow the user to create
> >>> >> >> their own
> >>> >> >>> connection definitions files, so you need to maintain the
> >>> >> >>> functionality of item #2 & item #4. Maybe there's a check
> >>> >> >> to make sure
> >>> >> >>> that the user-defined connection is not the same name as
> >>> >> >>> system-defined connection (thus won't overwrite?). Or,
> >>> >> better yet,
> >>> >> >>> differentiate the connections with something like
> >>> >> >> "User:BigRedCluster"
> >>> >> >>> and "Global:BigRedCluster" depending on where the
> >>> >> >> definition was read from?
> >>> >> >>>
> >>> >> >>> Scott, W Alan wrote:
> >>> >> >>>> Seems to me that we really want ParaView to do the following:
> >>> >> >>>> * Read server connection information from a system level file.
> >>> >> >>>> * Read server connection information from a user level
> >>> >> file. This
> >>> >> >>>> information shall not override anything read in from the
> >>> >> >> system level
> >>> >> >>>> file. (Do we even need this file?)
> >>> >> >>>> * Read in the user's default connection information from a
> >>> >> >> user level
> >>> >> >>>> file.
> >>> >> >>>> * Allow the user to edit the server information. (Do we
> >>> >> even need
> >>> >> >>>> this
> >>> >> >>>> step?)
> >>> >> >>>> * When ParaView finishes, write out the current server
> >>> >> information
> >>> >> >>>> (from the system level and the user level) into a user
> >>> >> level file.
> >>> >> >>>> (Do we even need this?)
> >>> >> >>>> * Write preferences into a preferences file.
> >>> >> >>>> Thoughts?
> >>> >> >>>> Alan
> >>> >> >>>>
> >>> >> >>>>
> >>> >> >>>>
> >>> >> >>>>
> >>> >> >>
> >>> >>
> ---------------------------------------------------------------------
> >>> >> >>>> ---
> >>> >> >>>> *From:* Moreland, Kenneth
> >>> >> >>>> *Sent:* Thursday, November 05, 2009 8:02 AM
> >>> >> >>>> *To:* Rick Angelini; Scott, W Alan
> >>> >> >>>> *Cc:* ParaView
> >>> >> >>>> *Subject:* Re: [Paraview] Paraview 3.6.x connection
> >>> >> definition
> >>> >> >>>> files
> >>> >> >>>>
> >>> >> >>>> It sounds like the major problem is that ParaView is
> >>> >> taking the
> >>> >> >>>> server connection configurations from the system files and
> >>> >> >>>> writing
> >>> >> >>>> them in the servers.pvsc configuration file the first
> time it
> >>> >> >>>> encounters them, where they forever override any
> >>> >> changes to the
> >>> >> >>>> system files. I believe this behavior was introduced
> >>> >> >> to save the
> >>> >> >>>> user's last entries for the parameters as the
> >>> >> default for the
> >>> >> >>>> next
> >>> >> >>>> invocation (bug #5487).
> >>> >> >>>>
> >>> >> >>>> This is an important feature, but perhaps this is
> >>> >> not the best
> >>> >> >>>> way
> >>> >> >>>> to implement it. Perhaps ParaView should be saving the
> server
> >>> >> >>>> connection argument parameters in the regular settings
> >>> >> >> key/value
> >>> >> >>>> file. That way you could leave the system server
> >>> >> >> settings in the
> >>> >> >>>> system files and nothing would override them. Does
> >>> >> that sound
> >>> >> >>>> like
> >>> >> >>>> the right thing?
> >>> >> >>>>
> >>> >> >>>> -Ken
> >>> >> >>>>
> >>> >> >>>>
> >>> >> >>>> On 11/5/09 6:00 AM, "Rick Angelini"
> >>> >> <angel at arl.army.mil> wrote:
> >>> >> >>>>
> >>> >> >>>> Alan, yes, you've demonstrated the problem I found
> >>> >> >> with the
> >>> >> >>>> pvsc
> >>> >> >>>> files. It's a difficult problem:
> >>> >> >>>>
> >>> >> >>>> Ideally, we want to provide
> >>> >> >>>> 1. Global server connection definitions
> >>> >> >>>> 2. User-defined server connection definitions
> >>> >> >>>> 3. the ability save persistent information
> >>> >> >> (username, remote
> >>> >> >>>> shell
> >>> >> >>>> executable, ProjectID, etc, etc) as defined by the
> pvsc
> >>> >> >>>> definition
> >>> >> >>>> 4. Update the global connection definition and have it
> >>> >> >>>> override any
> >>> >> >>>> previous definition
> >>> >> >>>>
> >>> >> >>>> I think that it's a slightly larger issue than
> >>> >> >> just managing
> >>> >> >>>> variables
> >>> >> >>>> that may exist between the user copy of the
> >>> >> definition and
> >>> >> >>>> the
> >>> >> >>>> global
> >>> >> >>>> copy - we need to provide the capability to drop
> >>> >> >> in a totally
> >>> >> >>>> new global
> >>> >> >>>> pvsc file and have it override anything that may
> >>> >> have been
> >>> >> >>>> saved
> >>> >> >>>> locally. For instance, we just switched our
> >>> >> queuing system
> >>> >> >>>> from LSF to
> >>> >> >>>> PBS and the entire pvsc file changed. Ideally,
> >>> >> >> when the new
> >>> >> >>>> global
> >>> >> >>>> server definition was dropped into the place,
> >>> >> the user copy
> >>> >> >>>> for that
> >>> >> >>>> server would be totally replaced by the new
> definition.
> >>> >> >>>>
> >>> >> >>>> Scott, W Alan wrote:
> >>> >> >>>> >
> >>> >> >>>> > Rick,
> >>> >> >>>> > It sure looks wrong to me. I did as you said -
> >>> >> >>>> > * Deleted my local .config/ParaView/servers.pvsc
> file.
> >>> >> >>>> > * Ran ParaView, connected to a remote server,
> >>> >> then closed
> >>> >> >>>> ParaView.
> >>> >> >>>> > - This read in my default_servers.pvsc file
> >>> >> >>>> > - Wrote out a new local
> >>> >> >> .config/ParaView/servers.pvsc file.
> >>> >> >>>> > * I then changed one of the options to be wrong
> in the
> >>> >> >>>> users
> >>> >> >>>> > servers.pvsc file. (I used max NODES, which should
> >>> >> >>>> obviously
> >>> >> >>>> be from
> >>> >> >>>> > the system default_servers.pvsc). This
> information was
> >>> >> >>>> still
> >>> >> >>>> correct
> >>> >> >>>> > in the default_server.pvsc file.
> >>> >> >>>> > * Upon rerunning ParaView, the wrong information
> >>> >> >> was picked
> >>> >> >>>> up from
> >>> >> >>>> > the servers.pvsc file.
> >>> >> >>>> >
> >>> >> >>>> >
> >>> >> >>>> > What would be the correct behavior? We want to
> >>> >> >> always use
> >>> >> >>>> the
> >>> >> >>>> default
> >>> >> >>>> > value from the user's servers.pvsc file, but we
> >>> >> >> want to use
> >>> >> >>>> all of the
> >>> >> >>>> > other variables from the default_servers.pvsc
> >>> >> >> file. Right?
> >>> >> >>>> >
> >>> >> >>>> > Alan
> >>> >> >>>> >
> >>> >> >>>> > > -----Original Message-----
> >>> >> >>>> > > From: Rick Angelini [mailto:angel at arl.army.mil]
> >>> >> >>>> > > Sent: Monday, November 02, 2009 8:36 AM
> >>> >> >>>> > > To: Scott, W Alan
> >>> >> >>>> > > Cc: ParaView; Moreland, Kenneth
> >>> >> >>>> > > Subject: Re: [Paraview] Paraview 3.6.x connection
> >>> >> >>>> definition files
> >>> >> >>>> > >
> >>> >> >>>> > > You're correct, the FIRST place it looks is
> for the
> >>> >> >>>> system
> >>> >> >>>> default.
> >>> >> >>>> > > However, the SECOND place it looks is the
> >>> >> user's area,
> >>> >> >>>> which
> >>> >> >>>> > > OVERRIDES
> >>> >> >>>> > > the systems default, as best as I can tell.
> >>> >> If HostA is
> >>> >> >>>> defined in
> >>> >> >>>> > > the default_servers.pvsc, the first time it
> >>> >> >> gets loaded
> >>> >> >>>> it
> >>> >> >>>> is then
> >>> >> >>>> > > saved into the user's local servers.pvsc file.
> >>> >> >> I
>
More information about the ParaView
mailing list