<p dir="ltr">Samuel, thanks for your experiment. File with size less than 2 GiB, of course, can't expose this issue.<br>
I read a bit more about stat() and it turned out that it should work as 64bit if FILE_OFFSET_BITS is set to 64. And it is set in other ParaView sources but, IMHO, not in EnSight reader. Dear ParaView team, please, take a look at this, I need to process my big case with Python script in ParaView...</p>
<div class="gmail_quote">On Mar 1, 2016 18:52, "Samuel Key" <<a href="mailto:samuelkey@bresnan.net">samuelkey@bresnan.net</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    <tt>Andrew,<br>
      <br>
      Regarding your question, "Do you have any EnSight Gold-Format
      files greater than 4GB?" No, the largest EnSight *.geom file I
      have is 1 GB.<br>
      <br>
      I just tried it in PV v5.0.0.  Reading the datum set and running
      through 67 time steps did not cause any problems. I don't think
      this *.geom file is big enough to expose any of the PV reader
      reader problems you are experiencing.<br>
      <br>
      Sam Key<br>
      <br>
    </tt>
    <div>On 2/29/2016 10:53 PM, Andrew wrote:<br>
    </div>
    <blockquote type="cite">
      <div dir="ltr">
        <div>
          <div>
            <div>Hello <span name="Samuel Key">Samuel.<br>
                <br>
              </span></div>
            <span name="Samuel Key">Sorry, but I can't
              undersatand how can the file fragmentation affect it's
              readability and parsing. Even if the file has thousands of
              fragments and "brain-damaging" :) runlist in many extended
              FILE records on NTFS partition, your program, if it uses
              Win API, will see it like a solid file (althougt there
              will be very low performance of sequental access). So
              there should be no any faults on reading highly fragmented
              files.<br>
            </span></div>
          <span name="Samuel Key">I have checked out the
            "direct" reading of EnSight case from the cluster via samba
            with ParaView 5.0.0 on Windows machine. The same error
            appears as in my first message, although there are <b>different
              files and filesystems</b>.<br>
          </span></div>
        <span name="Samuel Key">I think the problem is not a
          fragmentation but a <b>file size</b>. Some 32-bit-like
          relicts or so in EnSight reader (it's just a guess, sorry if
          I'm wrong). But my hypothesis does not asks the question why
          does the bug affect only Windows versions... Maybe there are
          differences between versions concerning data types. Do you
          have any >4 GB binary EnSight 6 or Gold case to test? I
          can't (not allowed) to publish my case and it's also big
          enough for upload (although theoretically I can do it from my
          home PC).<br>
          <br>
        </span></div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">2016-02-29 20:27 GMT+03:00 Samuel Key <span dir="ltr"><<a href="mailto:samuelkey@bresnan.net" target="_blank">samuelkey@bresnan.net</a>></span>:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> <tt>Andrew,<br>
                <br>
                Let us focus on MS Windows for a moment. The NTS file
                system and the use of the file system by the O/S is not
                quite as it should be.<br>
                <br>
                In my experience, the above combination routinely
                creates an unbelievable number of file fragments. Think
                in terms of confetti. As time goes by, the fragmentation
                builds. Even though you have a respectable amount of
                RAM, the free space itself on the disk driver can get
                rather disorganized.<br>
                <br>
                You can start by using the MS-supplied defrager. Run
                this utility five to seven times in a row and things
                might start looking better. However the free-space can
                still remain disjointed. Personally, I prefer a 3rd
                party utility for organizing and defraging the NTS file
                system (for example, PerfectDisk from Raxco). Even this
                utility has to run a couple of times plus once during
                the O/S re-boot phase to get a decent amount of
                consolidated free space and a somewhat consolidate O/S
                paging file. All of this has to be done on the O/S
                partition (usually C:) and the partition where you read
                in the 5+ GB Ensight Geometry file. <br>
                <br>
                On my machine, the MS Win7 O/S has its own partition
                (100GB \C:) plus another smaller dedicated partition for
                a second paging file (28GB \F:). All of my simulation
                work including the EnSight results file-sets reside on
                an entirely separate disk drive (280GB \G: that now
                needs to be even larger). The 3rd party file
                consolidation software runs "day and night" on the \G:
                partition.<br>
                <br>
                Just to emphasize the point, copying the 5+ GB EnSight
                geometry file on to workstation can result in many
                scattered fragments even when the free-space starts out
                consolidated. If the free space is not consolidated, the
                file fragmentation will be even more. <br>
                <br>
                The attached screen capture, shows the O/S managed
                paging-file (brown) in the \C: partition is beginning to
                fragment.<br>
                <br>
                If you go down this path and it helps, please let me
                know the outcome.<br>
              </tt><br>
              Regards,<br>
              <br>
              Sam Key<span><br>
                <br>
                <div>On 2/29/2016 1:04 AM, Andrew wrote:<br>
                </div>
              </span>
              <blockquote type="cite"><span>
                  <div dir="ltr">
                    <div>Another "experimental data". I was able to load
                      this big case in ParaView viat the CGNS format. It
                      was neccesary to select CGNS 3.0 and HDF5 options
                      in CFX Converter. But when I apply the Extract
                      Block filter I see no any boundaries, only fluid
                      domain (that is displayed OK). So CGNS format is
                      not a wayout...<br>
                    </div>
                  </div>
                </span>
                <div class="gmail_extra"><br>
                  <div class="gmail_quote"><span>2016-02-29
                      9:00 GMT+03:00 Andrew <span dir="ltr"><<a href="mailto:antech777@gmail.com" target="_blank"><a href="mailto:antech777@gmail.com" target="_blank">antech777@gmail.com</a></a>></span>:<br>
                    </span>
                    <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                      <div dir="ltr">I performed another test with <b>EnSi.ght
                          6</b> (not Gold) format. Conversion was made
                        on Win-7 x64 machine. The same results: PV 4.3
                        crashed, PV 5.0 "cannot stat" (full error
                        message is in my first post on this topic).
                        Sorry, now I need to work on with my report...
                        <div>
                          <div>
                            <div>
                              <div><br>
                                <div class="gmail_extra"><br>
                                  <br>
                                  <br>
                                  <br>
                                  <div class="gmail_quote">2016-02-29
                                    8:47 GMT+03:00 Andrew <span dir="ltr"><<a href="mailto:antech777@gmail.com" target="_blank"><a href="mailto:antech777@gmail.com" target="_blank">antech777@gmail.com</a></a>></span>:<br>
                                    <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                      <div dir="ltr">Hello. Sorry for
                                        silence, I'm usually offline on
                                        holydays, although I have
                                        internet connection and read
                                        your mail.<br>
                                        <br>
                                        <h3><span name="Samuel Key">Samuel
                                            Key</span></h3>
                                        <p>Thanks for your attention.</p>
                                        <p>About transferring files from
                                          Linux to Windows. I use binary
                                          EnSight files because CFX
                                          converter fails to write so
                                          large files in ASCII format.
                                          But I tried to convert from
                                          CFX to EnSight (binary) on the
                                          same Win-7 x64 machine with
                                          ParaView. Both installed
                                          versions (4.3 and 5.0) failed
                                          to open the geometry (I
                                          unchecked all fields).
                                          ParaView 4.3 crashed, ParaView
                                          5.0 just cannot open file...</p>
                                        <p>I think that the root cause
                                          may be a geometry file size.
                                          It is 4.9 GiB (5.3 GB), mesh
                                          have about 150 millions of
                                          cells, not 600 thusands like
                                          in your case. Its possible
                                          that ParaView for Windows
                                          cannot process so large
                                          EnSight files, although the
                                          Linux version reads in this
                                          geometry and displays outline
                                          (swapping is so intensive so I
                                          cannot displaye something
                                          else).<br>
                                        </p>
                                        <div>
                                          <div>
                                            <div class="gmail_extra"><br>
                                              <div class="gmail_quote">2016-02-26

                                                19:31 GMT+03:00 Samuel
                                                Key <span dir="ltr"><<a href="mailto:samuelkey@bresnan.net" target="_blank"><a href="mailto:samuelkey@bresnan.net" target="_blank">samuelkey@bresnan.net</a></a>></span>:<br>
                                                <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                  <div bgcolor="#FFFFFF" text="#000000"> <tt>Andrew,<br>
                                                      <br>
                                                      For what it is
                                                      worth, I use
                                                      ParaView
                                                      (ParaView-5.0.0-Qt4-OpenGL2-Windows-64bit)
                                                      on Windows-7
                                                      64bit. I just now
                                                      tested two
                                                      medium-sized,
                                                      EnSight
                                                      Gold-formatted
                                                      simulation results
                                                      files (600,000
                                                      finite elements)
                                                      and both worked.<br>
                                                      <br>
                                                      In the past, I
                                                      have had
                                                      difficulty with
                                                      the EnSight
                                                      ASCII-formatted
                                                      *.case file when
                                                      moving the
                                                      simulation results
                                                      (*.case file and
                                                      friends) from MS
                                                      Windows to EnSight
                                                      running on a linux
                                                      platform. It was
                                                      necessary to pass
                                                      the ASCII *.case
                                                      file through a
                                                      'dos2unix' filter.
                                                      Transferring files
                                                      the other way
                                                      might have the
                                                      same problem???<br>
                                                      <br>
                                                      Hope this helps.<span><font color="#888888"><br>
                                                          <br>
                                                          Samuel Key<br>
                                                          FMA
                                                          Development,
                                                          LLC<br>
                                                          1005 39th Ave
                                                          NE<br>
                                                          Great Falls,
                                                          Montana 59404<br>
                                                          USA<br>
                                                        </font></span></tt>
                                                    <div>
                                                      <div><br>
                                                        <div>On
                                                          2/25/2016
                                                          11:26 PM,
                                                          Andrew wrote:<br>
                                                        </div>
                                                      </div>
                                                    </div>
                                                    <blockquote type="cite">
                                                      <div>
                                                        <div>
                                                          <div dir="ltr">
                                                          <div>
                                                          <div>
                                                          <div>
                                                          <div>
                                                          <div>
                                                          <div>Hello. We
                                                          use Ansys CFX
                                                          in our work
                                                          but the
                                                          standard
                                                          post-processor
                                                          CFD-Post
                                                          consumes one
                                                          of Ansys
                                                          licenses while
                                                          Paraview is
                                                          free. So I
                                                          often make
                                                          pictures for
                                                          reports with
                                                          ParaView to
                                                          preserve Ansys
                                                          license for
                                                          another
                                                          users/needs
                                                          (because other
                                                          users are not
                                                          familiar with
                                                          ParaView and
                                                          CFD-Post may
                                                          consume
                                                          general "acfd"
                                                          license
                                                          feature that
                                                          may be used
                                                          for
                                                          calculations).
                                                          I convert CFX
                                                          results to
                                                          EnSight Gold
                                                          format in CFX
                                                          Solver Manager
                                                          (Export
                                                          Results) and
                                                          then open in
                                                          ParaView. It
                                                          was working
                                                          well on Linux
                                                          (CentOS 6.7
                                                          x64, Ubuntu
                                                          12.04 x64 with
                                                          updates) but
                                                          now I work
                                                          with large
                                                          files and I
                                                          need to use
                                                          another
                                                          machine that
                                                          has 128 GB of
                                                          RAM and runs
                                                          Windows-7 x64.<br>
                                                          </div>
                                                          I downloaded
                                                          and installed
                                                          the following
                                                          version:
                                                          ParaView-5.0.0-Qt4-OpenGL2-Windows-64bit.exe<br>
                                                          </div>
                                                          When I open my
                                                          EnSight-format
                                                          file I receive
                                                          the error
                                                          message that
                                                          geometry file
                                                          cannot be
                                                          read. I tried
                                                          to move
                                                          EnSight files
                                                          to a simple
                                                          location
                                                          (D:\Temp) and
                                                          renamed them
                                                          (test.case,
                                                          test.geom +
                                                          edited the
                                                          case to change
                                                          geometry file
                                                          name to
                                                          "simple" one).
                                                          The same
                                                          result, it
                                                          cannot find
                                                          geometry
                                                          file... Full
                                                          error message
                                                          is as follows:<br>
                                                          <br>
                                                          ERROR: In
                                                          C:\bbd\df0abce0\source-paraview\VTK\IO\EnSight\vtkEnSightGoldBinaryReader.cxx,



                                                          line 114 <br>
                                                          vtkEnSightGoldBinaryReader


                                                          (0000000009451230):


                                                          stat failed. <br>
                                                           <br>
                                                           <br>
                                                          ERROR: In
                                                          C:\bbd\df0abce0\source-paraview\VTK\IO\EnSight\vtkEnSightGoldBinaryReader.cxx,



                                                          line 220 <br>
                                                          vtkEnSightGoldBinaryReader


                                                          (0000000009451230):


                                                          Unable to open
                                                          file:
D:\Storage\Media\Work\Gradirni\CFX\EnSight\C-G002L3S-R020-S000-14.5\/C-G002L3S-R020-S000.geom<br>
                                                           <br>
                                                           <br>
                                                          ERROR: In
                                                          C:\bbd\df0abce0\source-paraview\VTK\IO\EnSight\vtkEnSightReader.cxx,
                                                          line 306 <br>
                                                          vtkEnSightGoldBinaryReader


                                                          (0000000009451230):


                                                          error reading
                                                          geometry file
                                                          <br>
                                                           <br>
                                                           <br>
                                                          ERROR: In
                                                          C:\bbd\df0abce0\source-paraview\VTK\Common\ExecutionModel\vtkExecutive.cxx,



                                                          line 784 <br>
                                                          vtkCompositeDataPipeline


                                                          (0000000008E1A640):


                                                          Algorithm
                                                          vtkEnSightGoldBinaryReader(0000000009451230)
                                                          returned
                                                          failure for
                                                          request:
                                                          vtkInformation
                                                          (00000000093C3920)

                                                          <br>
                                                            Debug: Off <br>
                                                            Modified
                                                          Time: 214873 <br>
                                                            Reference
                                                          Count: 1 <br>
                                                            Registered
                                                          Events: (none)
                                                          <br>
                                                            Request:
                                                          REQUEST_DATA <br>
                                                           
                                                          ALGORITHM_AFTER_FORWARD:
                                                          1 <br>
                                                           
                                                          FORWARD_DIRECTION:
                                                          0 <br>
                                                           
                                                          FROM_OUTPUT_PORT:
                                                          0<br>
                                                          <br>
                                                          </div>
                                                          OK, I tried to
                                                          open it in
                                                          ParaView 4.3.
                                                          It says
                                                          nothing (only
                                                          border of the
                                                          message window
                                                          appears) and
                                                          crashes. At
                                                          that moment I
                                                          see in the
                                                          status bar
                                                          that EnSight
                                                          reader
                                                          progress is
                                                          100%.<br>
                                                          <br>
                                                          </div>
                                                          <div>Both
                                                          ParaView 5.0.0
                                                          and 4.3 was
                                                          tested with
                                                          EnSight files
                                                          exported on
                                                          Linux and
                                                          Windows
                                                          machine. It
                                                          didn't help.<br>
                                                          </div>
                                                          <div><br>
                                                          </div>
                                                          OK, I tried to
                                                          export CFX
                                                          results to
                                                          CGNS format.
                                                          ParaView 5.0.0
                                                          (without MPI)
                                                          cannot read
                                                          it, so I fed
                                                          it to ParaView
                                                          4.3. It says
                                                          that its
                                                          "unable to
                                                          filed any
                                                          meshes".<br>
                                                          <br>
                                                          </div>
                                                          <div>I also
                                                          performed an
                                                          experiment on
                                                          my Linux
                                                          laptop. It has
                                                          only 16 GB of
                                                          RAM so its
                                                          unreal to work
                                                          with such a
                                                          big file on
                                                          this machine
                                                          but it reads
                                                          the same
                                                          EnSight case
                                                          and displays
                                                          the domain! No
                                                          arrays
                                                          selected (mesh
                                                          only), swap
                                                          file grows up
                                                          to 8 GB but
                                                          the file opens
                                                          without errors
                                                          and crashes.
                                                          It's only a
                                                          test because I
                                                          have not any
                                                          Linux machine
                                                          with memory
                                                          large enough
                                                          (our Linux
                                                          cluster has
                                                          128 GB of RAM
                                                          on every node
                                                          including
                                                          master but it
                                                          has very poor
                                                          video).<br>
                                                          </div>
                                                          <div><br>
                                                          </div>
                                                          I switched to
                                                          CFD Post for
                                                          this case but
                                                          I want to know
                                                          are there any
                                                          workarounds to
                                                          open my
                                                          EnSight-format
                                                          results in
                                                          ParaView for
                                                          Windows.<br>
                                                          <br>
                                                          </div>
                                                          Thanks for
                                                          your
                                                          attention.<br>
                                                          </div>
                                                          <br>
                                                          <fieldset></fieldset>
                                                          <br>
                                                        </div>
                                                      </div>
                                                      <span>
                                                        <pre>_______________________________________________
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a>

Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a>

Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a>

Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" target="_blank">http://markmail.org/search/?q=ParaView</a>

Follow this link to subscribe/unsubscribe:
<a href="http://public.kitware.com/mailman/listinfo/paraview" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a>
</pre>
                                                      </span></blockquote>
                                                    <br>
                                                  </div>
                                                  <br>
_______________________________________________<br>
                                                  Powered by <a href="http://www.kitware.com" target="_blank"><a href="http://www.kitware.com" target="_blank">www.kitware.com</a></a><br>
                                                  <br>
                                                  Visit other Kitware
                                                  open-source projects
                                                  at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank"><a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a></a><br>
                                                  <br>
                                                  Please keep messages
                                                  on-topic and check the
                                                  ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank"><a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a></a><br>
                                                  <br>
                                                  Search the list
                                                  archives at: <a href="http://markmail.org/search/?q=ParaView" target="_blank"><a href="http://markmail.org/search/?q=ParaView" target="_blank">http://markmail.org/search/?q=ParaView</a></a><br>
                                                  <br>
                                                  Follow this link to
                                                  subscribe/unsubscribe:<br>
                                                  <a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank"><a href="http://public.kitware.com/mailman/listinfo/paraview" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a></a><br>
                                                  <br>
                                                </blockquote>
                                              </div>
                                              <br>
                                            </div>
                                          </div>
                                        </div>
                                      </div>
                                    </blockquote>
                                  </div>
                                  <br>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </blockquote>
                  </div>
                  <br>
                </div>
                <div>
                  <div> <br>
                    <fieldset></fieldset>
                    <br>
                    <pre>_______________________________________________
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a>

Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a>

Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a>

Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" target="_blank">http://markmail.org/search/?q=ParaView</a>

Follow this link to subscribe/unsubscribe:
<a href="http://public.kitware.com/mailman/listinfo/paraview" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a>
</pre>
                  </div>
                </div>
              </blockquote>
              <br>
            </div>
            <br>
            _______________________________________________<br>
            Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
            <br>
            Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank"><a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a></a><br>
            <br>
            Please keep messages on-topic and check the ParaView Wiki
            at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">http://paraview.org/Wiki/ParaView</a><br>
            <br>
            Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">http://markmail.org/search/?q=ParaView</a><br>
            <br>
            Follow this link to subscribe/unsubscribe:<br>
            <a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><br>
            <br>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      <pre>_______________________________________________
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a>

Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a>

Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a>

Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" target="_blank">http://markmail.org/search/?q=ParaView</a>

Follow this link to subscribe/unsubscribe:
<a href="http://public.kitware.com/mailman/listinfo/paraview" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a>
</pre>
    </blockquote>
    <br>
  </div>

<br>_______________________________________________<br>
Powered by <a href="http://www.kitware.com" rel="noreferrer" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" rel="noreferrer" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" rel="noreferrer" target="_blank">http://paraview.org/Wiki/ParaView</a><br>
<br>
Search the list archives at: <a href="http://markmail.org/search/?q=ParaView" rel="noreferrer" target="_blank">http://markmail.org/search/?q=ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://public.kitware.com/mailman/listinfo/paraview" rel="noreferrer" target="_blank">http://public.kitware.com/mailman/listinfo/paraview</a><br>
<br></blockquote></div>