[Paraview] Reading files in Parallel with ParaView

Chuck Atkins chuck.atkins at kitware.com
Mon Jul 24 09:34:40 EDT 2017


Hi Louis,

Does ParaView read data in parallel regardless of whether the file is
> decomposed in space and/or time?
>

Space, yes.  Time, not really, at least not without writing a custom reader.



> Would it be faster to read decomposed files vs. reading one large file?
>

This is something that will be dependent on the file format yuou're using.
It will most certainly be faster to read the data in parallel, spatially
decomposed, and most of the parallel readers support an N -> M IO mapping,
that is, using a different number of readers than there are spatial
partitions.  As to using one big file or not, well, some parallel file
formats support it, some dont.  Just make sure you use a file format that
supports the spatial decomposition, whether thats as one file per
partition-timestep, one file per-timestep with multiple partitions per
file, or everything in one file with multiple partitions adn timesteps per
file.  Your bottlenext in IO will likely be the write time anyways and as
long as the file format your using supports parallel reads then how that's
laid out, whether in a single file or multiple files, will probably not
have a significant impact.


----------
Chuck Atkins
Staff R&D Engineer, Scientific Computing
Kitware, Inc.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://public.kitware.com/pipermail/paraview/attachments/20170724/7e2feaed/attachment.html>


More information about the ParaView mailing list