[Paraview] RAW (binary) file import issues

[Burlen Loring]

I've hit that before. the RAW reader uses MPI-I/O, and MPI uses signed 
int everywhere in its API, so there are limits that you end up hitting. 
For instance to partition the data among processors one must give 
MPI-I/O the starting offset of the data in the file as a signed int, and 
that is limited to 2^31.

Burlen

On 11/22/2016 11:20 AM, Berk Geveci wrote:
> Hmmm that happens to be around 4 GB which makes me wonder if there is 
> a limit somewhere in that reader... Any chance you can try this on a 
> Linux machine?
>
> On Thu, Nov 17, 2016 at 10:30 AM, Keyes S.D. <S.D.Keyes at soton.ac.uk 
> <mailto:S.D.Keyes at soton.ac.uk>> wrote:
>
>     Dear all,
>
>     I am encountering issues when trying to import large 8 bit RAW
>     volumes to Paraview 5.1.2 (64 bit).
>
>     The file I wish to import has xyz dimensions of 2000x2000x1920
>     voxels (Unsigned char), 7.5GB.  I am running a machine with 192 GB
>     RAM and 12 CPU cores.
>
>     I can import up to a 2000x2000x1000 crop of this file, but I
>     encounter the following message when I attempt larger z dimensions:
>
>     ERROR: In
>     C:\bbd\df0abce0\source-paraview\VTK\IO\Image\vtkImageReader2.cxx,
>     line 592
>
>     vtkPVImageReader (0000000007767F90): Initialize: Could not open
>     file
>     \\cseg_2\ERC\SLS_201606\Myco_2\CT2PpR3h1_\Hyphalseg_Raw_2000_2000_1920_8bit_SKELETON_FILT_PARAVIEW_TEST.raw
>
>
>     I cannot find an obvious memory ceiling within the paraview
>     settings - any ideas as to whether there is some effective upper
>     limit to import file size?
>
>     Sam
>
>     Samuel D Keyes, MEng, PhD
>     New Frontiers Fellow
>     Bioengineering / μVIS Centre for Computed Tomography
>     University of Southampton
>     E: S.D.Keyes at soton.ac.uk
>     <mailto:S.D.Keyes at soton.ac.uk><https://www.outlook.soton.ac.uk/owa/redir.aspx?SURL=dhUg3da8XR77LeItLDzJQwhAwmH0Wx6PHrXeKfxx2tOD3LCr737TCG0AYQBpAGwAdABvADoAUwAuAEQALgBLAGUAeQBlAHMAQABzAG8AdABvAG4ALgBhAGMALgB1AGsA&URL=mailto%3aS.D.Keyes%40soton.ac.uk
>     <https://www.outlook.soton.ac.uk/owa/redir.aspx?SURL=dhUg3da8XR77LeItLDzJQwhAwmH0Wx6PHrXeKfxx2tOD3LCr737TCG0AYQBpAGwAdABvADoAUwAuAEQALgBLAGUAeQBlAHMAQABzAG8AdABvAG4ALgBhAGMALgB1AGsA&URL=mailto%3aS.D.Keyes%40soton.ac.uk>>
>     T: 07898720248
>     _______________________________________________
>     Powered by www.kitware.com <http://www.kitware.com>
>
>     Visit other Kitware open-source projects at
>     http://www.kitware.com/opensource/opensource.html
>     <http://www.kitware.com/opensource/opensource.html>
>
>     Please keep messages on-topic and check the ParaView Wiki at:
>     http://paraview.org/Wiki/ParaView <http://paraview.org/Wiki/ParaView>
>
>     Search the list archives at:
>     http://markmail.org/search/?q=ParaView
>     <http://markmail.org/search/?q=ParaView>
>
>     Follow this link to subscribe/unsubscribe:
>     http://public.kitware.com/mailman/listinfo/paraview
>     <http://public.kitware.com/mailman/listinfo/paraview>
>
>
>
>
> _______________________________________________
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the ParaView Wiki at: http://paraview.org/Wiki/ParaView
>
> Search the list archives at: http://markmail.org/search/?q=ParaView
>
> Follow this link to subscribe/unsubscribe:
> http://public.kitware.com/mailman/listinfo/paraview

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://public.kitware.com/pipermail/paraview/attachments/20161122/d1bb80f8/attachment.html>