[Paraview] Too many open files

Carolyn Stancoff cstancoff at gmail.com
Mon May 17 11:38:41 EDT 2010


Where do I put that?  I'm using Windows XP which I think allows a maximum of
2048 open files.  So I assume I need to put this in the ParaView code.  I'm
also wondering if there is a reason why the files need to stay open.  It
would be a lot nicer if I could close the files instead of leaving them
open, then it wouldn't matter how many time steps I have.

Thanks,

Carolyn

On Thu, May 13, 2010 at 9:38 AM, Robert Maynard
<robert.maynard at kitware.com>wrote:

> For windows _setmaxstdio<http://msdn.microsoft.com/en-us/library/6e3b887c(v=vs.71).aspx> could
> be the solution to allow more than 512 open files per process.
>
>
> On Thu, May 13, 2010 at 11:29 AM, Samuel Key <samuelkey at bresnan.net>wrote:
>
>> Hi Carolyn,
>>
>> I was gently suggesting that you could solve the problem of "too many open
>> files" by going to a datum format that required a smaller number of files,
>> or don't ask ParaView to load data that you don't have a requirement (at the
>> moment) to post-process.  If that is not possible, then I suggest you look
>> at your O/S.
>>
>> A long time ago (pre ParaView) I had a "too many open files" event. If I
>> recall correctly, it was MS Windows that gave the message, but it could have
>> been DEC's VMS, DEC's Ultrix, or Linux. In any event, most O/S's have a
>> limit on the number of files that can be open at any one time. The trick is
>> to locate where that number is stored and increase it. You can put "too many
>> open files" in Google and, for example, get here
>>
>> http://www.patoche.org/LTT/kernel/00000128.html
>>
>> or here
>>
>>
>> http://confluence.atlassian.com/display/CONF26/Fix+%27Too+many+open+files%27+error+on+Linux+by+increasing+filehandles
>>
>> You are probably going to learn more about System Administration than you
>> wanted to learn.
>>
>> Good luck,
>>
>>
>> Sam Key
>>
>> Carolyn Stancoff wrote:
>>
>> I can view 500 time steps.  My problem is when it goes to time step 509.
>> My guess is that there is a limit of 512 open files somewhere.
>>
>> Carolyn
>>
>> On Wed, May 12, 2010 at 1:59 PM, Samuel Key <samuelkey at bresnan.net>wrote:
>>
>>> Oops, here is the attachment.
>>>
>>>
>>> Samuel Key wrote:
>>>
>>> Carolyn,
>>>
>>> I am not sure which EnSight format you are using. I have attached an
>>> EnSight case-file that is typical for me and functions with only a small set
>>> of files, but with a large number of time steps. In this format, each
>>> cell/point variable has its own file; each file contains the data at all
>>> time steps. I have used this EnSight binary format for at least 500 time
>>> steps.
>>>
>>> Another aspect of the EnSight reader in ParaView allows you to load
>>> ("open the files") for only those cell and/or point datum arrays that you
>>> wish to view -- see the check marks just below the green "Apply" button.
>>> Only the data with a check-mark is read; one may turn-off the checks by
>>> clicking on them.
>>>
>>> Hope this helps,
>>>
>>> Sam Key
>>>
>>>
>>>
>>> Carolyn Stancoff wrote:
>>>
>>> I have data for 630 time steps in EnSight format.  When I try to play the
>>> data I get that there are too many open files (nothing after time step 509
>>> is displayed).  Is there something I can change in Windows or ParaView to
>>> allow more open files?  Since I currently have each time step data in its
>>> own file, can I write all the data to a single file?  Or do the files need
>>> to stay open after they have been read?
>>>
>>> Thanks,
>>>
>>> Carolyn
>>>
>>> ------------------------------
>>>
>>> _______________________________________________
>>> Powered by www.kitware.com
>>>
>>> Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html
>>>
>>> Please keep messages on-topic and check the ParaView Wiki at: http://paraview.org/Wiki/ParaView
>>>
>>> Follow this link to subscribe/unsubscribe:http://www.paraview.org/mailman/listinfo/paraview
>>>
>>>
>>> FORMAT
>>> type: ensight gold
>>> GEOMETRY
>>> model:                   1  1  fmaego.data.geom    change_coords_only
>>> VARIABLE
>>> vector per node:         1  1  Displacement          fmaego.data.ndis
>>> vector per node:         1  1  Velocity              fmaego.data.nvel
>>> vector per node:         1  1  Acceleration          fmaego.data.nacc
>>> scalar per element:      1  1  Material              fmaego.data.emat
>>> scalar per element:      1  1  Material-State        fmaego.data.esta
>>> scalar per element:      1  1  Pressure              fmaego.data.eprs
>>> scalar per element:      1  1  Bulk-Strain           fmaego.data.elnv
>>> scalar per element:      1  1  Strain-Energy-Density fmaego.data.esed
>>> scalar per element:      1  1  Effective-Stress      fmaego.data.edev
>>> vector per element:      1  1  Stress*Vel            fmaego.data.estv
>>> tensor symm per element: 1  1  Stress                fmaego.data.estr
>>> TIME
>>> time set:                1
>>> number of steps:       201
>>> time values:                  5.196730760241E-07      1.002968963254E-04
>>>      2.000741029179E-04      3.003708790416E-04      4.001478731634E-04
>>>      5.004445399233E-04      6.002214859248E-04      7.005181261602E-04
>>>      8.002952341828E-04      9.000724132358E-04      1.000369296886E-03
>>>      1.100146514875E-03      1.200443352457E-03      1.300220421660E-03
>>>      1.400517099910E-03      1.500294041644E-03      1.600071004277E-03
>>>      1.700367727048E-03      1.800144863650E-03      1.900441750115E-03
>>>      2.000218938720E-03      2.100515794906E-03      2.200292991238E-03
>>>      2.300070197422E-03      2.400367051387E-03      2.500144229106E-03
>>>      2.600441086479E-03      2.700218295098E-03      2.800515117326E-03
>>>      2.900292164742E-03      3.000069177668E-03      3.100365821446E-03
>>>      3.200142836239E-03      3.300439653783E-03      3.400216849596E-03
>>>      3.500513718102E-03      3.600290917459E-03      3.700068111120E-03
>>>      3.800364913407E-03      3.900141999835E-03      4.000438703894E-03
>>>      4.100215731207E-03      4.200512517403E-03      4.300289711083E-03
>>>      4.400066908828E-03      4.500363752591E-03      4.600140937096E-03
>>>      4.700437810394E-03      4.800215011644E-03      4.900511836185E-03
>>>      5.000288931712E-03      5.100066042243E-03      5.200362867868E-03
>>>      5.300140072953E-03      5.400436946040E-03      5.500214116633E-03
>>>      5.600510954474E-03      5.700288152063E-03      5.800065347829E-03
>>>      5.900362163656E-03      6.000139259510E-03      6.100436004140E-03
>>>      6.200213148723E-03      6.300510029835E-03      6.400287199732E-03
>>>      6.500064273664E-03      6.600360972689E-03      6.700138070826E-03
>>>      6.800434908687E-03      6.900212113630E-03      7.000509004257E-03
>>>      7.100286216871E-03      7.200063369915E-03      7.300360096268E-03
>>>      7.400137034301E-03      7.500433582155E-03      7.600210460185E-03
>>>      7.700507027005E-03      7.800284008849E-03      7.900061107069E-03
>>>      8.000357912640E-03      8.100135061104E-03      8.200431865296E-03
>>>      8.300208895674E-03      8.400505512643E-03      8.500282424461E-03
>>>      8.600059345256E-03      8.700356022798E-03      8.800133143587E-03
>>>      8.900430027925E-03      9.000207204519E-03      9.100504044841E-03
>>>      9.200281255239E-03      9.300058457784E-03      9.400355264674E-03
>>>      9.500132330655E-03      9.600429097241E-03      9.700206244075E-03
>>>      9.800503114836E-03      9.900280290909E-03      1.000005741673E-02
>>>      1.010035422942E-02      1.020013139809E-02      1.030042827600E-02
>>>      1.040020541528E-02      1.050050221218E-02      1.060027932137E-02
>>>      1.070005646959E-02      1.080035334544E-02      1.090013051827E-02
>>>      1.100042733019E-02      1.110020443054E-02      1.120050124054E-02
>>>      1.130027844414E-02      1.140005564148E-02      1.150035251318E-02
>>>      1.160012971438E-02      1.170042658322E-02      1.180020373272E-02
>>>      1.190050045280E-02      1.200027742511E-02      1.210005438921E-02
>>>      1.220035106839E-02      1.230012815590E-02      1.240042502046E-02
>>>      1.250020221774E-02      1.260049909022E-02      1.270027629071E-02
>>>      1.280005342482E-02      1.290035014500E-02      1.300012719102E-02
>>>      1.310042391126E-02      1.320020101052E-02      1.330049788595E-02
>>>      1.340027508749E-02      1.350005224313E-02      1.360034897969E-02
>>>      1.370012609023E-02      1.380042296449E-02      1.390020018019E-02
>>>      1.400049706763E-02      1.410027424655E-02      1.420005145602E-02
>>>      1.430034823958E-02      1.440012531690E-02      1.450042196984E-02
>>>      1.460019892685E-02      1.470049566145E-02      1.480027279565E-02
>>>      1.490004999189E-02      1.500034686208E-02      1.510012406475E-02
>>>      1.520042095940E-02      1.530019811375E-02      1.540049482781E-02
>>>      1.550027181960E-02      1.560004880256E-02      1.570034547300E-02
>>>      1.580012258155E-02      1.590041945894E-02      1.600019667267E-02
>>>      1.610049356579E-02      1.620027073971E-02      1.630004778025E-02
>>>      1.640034442828E-02      1.650012134021E-02      1.660041787724E-02
>>>      1.670019484604E-02      1.680049156964E-02      1.690026865619E-02
>>>      1.700004585962E-02      1.710034274974E-02      1.720011988040E-02
>>>      1.730041665667E-02      1.740019371103E-02      1.750049033238E-02
>>>      1.760026732293E-02      1.770004441988E-02      1.780034126212E-02
>>>      1.790011845138E-02      1.800041523239E-02      1.810019233856E-02
>>>      1.820048913913E-02      1.830026632915E-02      1.840004353665E-02
>>>      1.850034041247E-02      1.860011761471E-02      1.870041449164E-02
>>>      1.880019163406E-02      1.890048837065E-02      1.900026539316E-02
>>>      1.910004238475E-02      1.920033911476E-02      1.930011627667E-02
>>>      1.940041314536E-02      1.950019033952E-02      1.960048721190E-02
>>>      1.970026440918E-02      1.980004160732E-02      1.990033842206E-02
>>>      2.000011547959E-02
>>> FILE
>>> file set:                   1
>>> number of steps:          201
>>>
>>>
>>
>> _______________________________________________
>> Powered by www.kitware.com
>>
>> Visit other Kitware open-source projects at
>> http://www.kitware.com/opensource/opensource.html
>>
>> Please keep messages on-topic and check the ParaView Wiki at:
>> http://paraview.org/Wiki/ParaView
>>
>> Follow this link to subscribe/unsubscribe:
>> http://www.paraview.org/mailman/listinfo/paraview
>>
>>
>
>
> --
> Robert Maynard
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.paraview.org/pipermail/paraview/attachments/20100517/8dc5dc1a/attachment-0001.htm>


More information about the ParaView mailing list