ParaView/ParaView Readers and Parallel Data Distribution: Difference between revisions
No edit summary |
No edit summary |
||
(2 intermediate revisions by the same user not shown) | |||
Line 19: | Line 19: | ||
| | | | ||
Time steps may be contained in a file as long as the mesh topology does not change. Time may also be split across a file series. | Time steps may be contained in a file as long as the mesh topology does not change. Time may also be split across a file series. | ||
|- | |||
| *.pvti | |||
| Partitioned VTK XML Image Files | |||
| [http://paraview.org/OnlineHelpCurrent/XMLPImageDataReader.html XMLPartitionedImageDataReader] | |||
| | |||
This is XML-based file format for saving ASCII or binary Image data (vtkImageData). The format consists of a meta-file that describes the dataset partitions and then separate .vti files for each partition. Similar to .vti files, when loading the file in parallel, the .pvti file is opened on all processes, to read the meta-data. Then the extents of the dataset are distributed among the processes in a load-balanced way. The reader uses vtkExtentSplitter to split the input extents into non-overlapping sub-extents minimizing files needed to be read for any sub-extent. Only those .vti files that contain the extents of the data corresponding to a particular process are opened and loaded on that process. | |||
| | |||
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. | |||
|- | |||
| *.pvts | |||
| Partitioned VTK XML Structured Grid Files | |||
| [http://paraview.org/OnlineHelpCurrent/XMLPStructuredGridReader.html XMLPStructuredGridReader] | |||
| | |||
This file format is similar to *.pvti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.pvti description for details on parallelization. | |||
| | |||
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. | |||
|- | |- | ||
| *.vti | | *.vti | ||
| XML | | VTK XML Image Files | ||
| [http://paraview.org/OnlineHelpCurrent/XMLImageDataReader.html XMLImageDataReader] | | [http://paraview.org/OnlineHelpCurrent/XMLImageDataReader.html XMLImageDataReader] | ||
| | | | ||
This file format does not support saving parallel distribution of data (refer to *.pvti file format for saving partitions). When loading the dataset in parallel, the structured extent of the dataset is distributed among all processes in a load-balanced way. All processes open the data file, however only the data corresponding to the subextent corresponding to the process are read in. | This file format does not support saving parallel distribution of data (refer to *.pvti file format for saving partitions). When loading the dataset in parallel, the structured extent of the dataset is distributed among all processes in a load-balanced way. All processes open the data file, however only the data corresponding to the subextent corresponding to the process are read in. | ||
| | |||
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. | |||
|- | |||
| *.vts | |||
| VTK XML Structured Grid Files | |||
| [http://paraview.org/OnlineHelpCurrent/XMLStructuredGridReader.html XMLStructuredGridReader] | |||
| | |||
This file format is similar to *.vti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.vti description for details on parallelization. | |||
| | | | ||
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. | The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. |
Latest revision as of 05:06, 8 March 2013
File Extension | Format Description | Reader | Notes on Data Parallelism | Time Support |
*.ex2,.exo | Exodus Files | ExodusIIReader |
This file format supports parallel distribution of data by splitting data across many files. It also supports mesh adaptation by splitting files at simulation times where adaptation occurs. Hence ParaView does the following: The root node scans the directory for files in the set and reads metadata (blocks and variables defined on them) from a single file in the set. It then broadcasts this information to all processes. Each reads a different subset of files. |
Time steps may be contained in a file as long as the mesh topology does not change. Time may also be split across a file series. |
*.pvti | Partitioned VTK XML Image Files | XMLPartitionedImageDataReader |
This is XML-based file format for saving ASCII or binary Image data (vtkImageData). The format consists of a meta-file that describes the dataset partitions and then separate .vti files for each partition. Similar to .vti files, when loading the file in parallel, the .pvti file is opened on all processes, to read the meta-data. Then the extents of the dataset are distributed among the processes in a load-balanced way. The reader uses vtkExtentSplitter to split the input extents into non-overlapping sub-extents minimizing files needed to be read for any sub-extent. Only those .vti files that contain the extents of the data corresponding to a particular process are opened and loaded on that process. |
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. |
*.pvts | Partitioned VTK XML Structured Grid Files | XMLPStructuredGridReader |
This file format is similar to *.pvti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.pvti description for details on parallelization. |
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. |
*.vti | VTK XML Image Files | XMLImageDataReader |
This file format does not support saving parallel distribution of data (refer to *.pvti file format for saving partitions). When loading the dataset in parallel, the structured extent of the dataset is distributed among all processes in a load-balanced way. All processes open the data file, however only the data corresponding to the subextent corresponding to the process are read in. |
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. |
*.vts | VTK XML Structured Grid Files | XMLStructuredGridReader |
This file format is similar to *.vti, however used for saving vtkStructuredGrid aka. curvilinear grids. Refer to *.vti description for details on parallelization. |
The file format support saving timesteps in the file, however, the more common mechanism is to use a file series. |
*.vtk | Legacy VTK Files | LegacyVTKReader |
This is the Legacy VTK file format, supporting binary or ASCII, for datasets of various types including structured and unstructured. This file format, however, has no support for saving parallel distribution of data. Hence ParaView does the following: Structured Data For structured data, this reader reads the entire file on all processes and then crops the structured extents on each process so that for each process, the filters downstream process a block of the structured data alone. Unstructured Data The root node reads the entire file and then the data is distributed to all processes (using MPI) after an internal, fairly naive, partitioning algorithm (vtkTransmitUnstructuredGridPiece or vtkTransmitPolyDataPiece). |
Time supported only as a file series. |