Difference between revisions of "Advanced Data Analysis"

From KitwarePublic
Jump to navigationJump to search
 
 
(15 intermediate revisions by the same user not shown)
Line 1: Line 1:
=Introduction=
=Introduction=
This tutorial covers multiblock processing and data analysis.
This tutorial covers data analysis.


==Multiblock - Color two blocks differently==
*Color two blocks differently
*Open the dataset can.exo.  Turn on all variables.  Apply.
*Block 0
**Be sure that can.exo is selected in the Pipeline Browser.
**Filters/ Alphabetical/ Extract Block. 
**Select Dataset 0.
**Color by ACCL
*Block 1
**Be sure that can.exo is selected in the Pipeline Browser.
**Filters/ Alphabetical/ Extract Block. 
**Select Dataset 1.
**Color by Displ
*Go to the last frame.
*Select ExtractBlock1 in the Pipeline Browser.
*Rescale to dataRange
*Select ExtractBlock2 in the Pipeline Browser.
*Rescale to dataRange
*Go to the first frame, then Animate.
*Do NOT delete this state - we will use it for the next section.


==Find Data dialog==
The '''Find Data''' dialog box is used to select points or cells, to show the data for these points or cells, to control label display on your data in the 3d view, and as a shortcut to run data analysis filters.  We will explore this dialog box using an example.
*Open a dataset and the Find Data dialog.
**Open the dataset can.exo.  Turn on all variables.  '''Apply'''.
**'''Edit'''/ '''Find Data'''.  You can also open the Find Data dialog using the icon [[Image:advanced_data_analysis_1.jpg]]
*We will select a GlobalElementId.
**Find '''Cells''' from '''can.ex2'''
**Change pulldown to '''GlobalElementId'''.  Leave as '''is'''.  Enter 100.
**'''Run Selection Query'''


*We will select two GlobalElementIds.
**Find '''Cells''' from '''can.ex2'''
**Change pulldown to '''GlobalElementId'''.  Change to '''is one of'''.  Enter 100, 102.
**'''Run Selection Query'''


[[Image:advanced_multiblock_1.png|800px]]
[[Image:advanced_data_analysis_2.jpg|1000px]]
 


==Multiblock – Automate Rescale==
It is possible to change how ParaView rescales the minimum and maximum values for a variable.  The default behavior is designed for large or very large data.  For other datasets, you can either have ParaView open the dataset in the last timestep, or "grow" the minimum and maximum to fit all timesteps.


The following steps are for the "Grow Every Timestep" option.
*We will select the maximum EQPS.
*Go to '''Edit → Settings → General'''
**Move forward one timestep.  EQPS for timestep 0 is all the same - 0.
**Leave '''On File Open''' '''Goto current timestep'''
**Find '''Cells''' from '''can.ex2'''
**Change '''Rescale Data Range Mode''' to '''Grow every timestep'''.  OK.
**Change pulldown to '''EQPS'''.  Change to '''is max'''.
**Note - If you want ParaView to open in the last time step, change '''On File Open''' to '''Goto last timestep'''.
**'''Run Selection Query'''
**'''Play forward'''


*'''First Frame'''
*'''Play'''
Lets repeat, and see if the minimum and maximum were set correctly.
*'''First Frame'''
*'''Play'''


Notice that the data for the selected cell (or point) is displayed in the spreadsheet.




==Multiblock – Select a range of blocks - Object Inspector==
If desired, the maximum (or minimum) cell can be found, and this selection can be frozenThe same cell will then be selected for all timestepsUse the '''Freeze Selection''' button to freeze selections.
*Edit/ Delete All
*Open the dataset bake.exo.  Turn on all variables.  '''Apply'''.
*Hold down the control key, and '''Select Block''' for the six outside blocks of bake.
*In the Object Inspector, click on '''Uncheck Selected Blocks'''.
*Scroll down the list of blocks in the '''Blocks''' section of the '''Object Inspector'''Notice that we have turned off '''122, 123, 124, 125, 126''' and '''127'''.
*'''Apply'''.
*You can use the same technique to only turn on specific blocksAfter selecting the blocks, turn all blocks off, and then'''Check Selected Blocks'''.
*'''Apply'''.
*Notice that you can use the <ctrl> and <shift> key to turn on and off groups of blocks directly in the Object Inspector.




[[Image:advanced_multiblock_2.png|800px]]
We can also display cell or point data on the 3d view.  This is done with '''Cell Labels''' and '''Point Labels'''.
**Open the '''Cell Labels''' pulldown, and select EQPS.


==Multiblock – Select objects - Find Data==
This functionality can be used to select blocks, cells, points, etc. 
*'''Edit'''/ '''Delete All'''
*Open the dataset bake.exo.  Turn on all variables.  '''Apply'''.
*'''Edit'''/ '''Find Data'''
*Select '''Block Id''', "is", and then select the '''...'''.  At present, ParaView requires it's internal structure number.  Select block 1, then OK. (The number 2 will appear in the window.)
*'''Run Selection Query'''.
*If desired, you can '''Extract Selection''' or '''Plot Selection Over Time''' (only on single points or cells)..


[[Image:advanced_data_analysis_3.jpg|1000px]]


==Data Analysis - Point Labels==


*Open the data set can.exo.
*Change the Style Representation to Surface With Edges.
==Cell, Point and Block Selections==
*On the toolbar, push the Select Points On  icon.  This will allow you to manually select a point on your data set and have the id of those points displayed.
ParaView has a very powerful group of selection toolsSelections are found as a group of icons in the upper left corner of the 3d view.   
*Rubber band select a point (node)
*From the View menu select the menu option Selection Inspector.
*Notice that all of the point indexes are listed.
*On the Selection Inpector panel, scroll down to the bottom and click on the Point Label tabCheck the Visible check box.  This will display the point IDs on the data set.
*You can also do a lookup in the opposite direction.
*On the Selection Inspector panel, scroll to the top and enter an Index Range or Global ID Range numberOn can.exo, an example is Composite ID 2 (first generic block), and point 100.  It will display on your dataset.
*Try toggling the Select Cells that Include the Selected Point on.
*HINT – change to wireframe to find the points or cells you have selected.
*Extra Credit – Try the same selection steps with cell type data.  For a cell number, try Composite ID 2, cell 100.


*More than one selection can be active at a time.  Use the '''<CTRL>''' key.  You can also use the '''Add Selection''', '''Subtract Selection''' and '''Toggle Selection''' icons.
*Variable data can be printed on the screen for any cell that is selected.  See the section on '''Find Data'''.
*Selections can be used as input to numerous '''Data Analysis''' filters.
**'''Select Cells On'''.  Select one or more cells on the surface of your object.  Either click or rubber band select works.  Shortcut - '''s'''.
**'''Select Points On'''.  Select one or more points on the surface of your object.  Either click or rubber band select works.  Within a tolerance, the nearest point will be selected.  Shortcut - '''d'''.
**'''Select Cells Through'''.  Select cells through your dataset.  This is known as a Frustum select.  Shortcut - '''f'''.
**'''Select Points Through'''.  Select points through your dataset.  This is also known as a Frustum select.  Shortcut - '''g'''.
**'''Select Cells With Polygon'''.  Select cells on the surface of your dataset by drawing a polygon.  No shortcut.
**'''Select Points With Polygon'''.  Select points on the surface of your dataset by drawing a polygon.  No shortcut.
**'''Select Block'''.  Select one or more blocks.  Either click or rubber band select works.  Shortcut - '''b'''.
**'''Interactive Select Cells On'''.  Interactively select cells on the surface of your dataset.  If you click on a selection, it will become permanent. You can have numerous permanent selections.  No shortcut.
**'''Interactive Select Points On'''.  Interactively select points on the surface of your dataset.  If you click on a selection, it will become permanent. You can have numerous permanent selections.  No shortcut.
**'''Hover Points On'''.  This will display all of the data available on this point or cell.  Interactive.
**'''Clear Selection'''.
==Spreadsheet and histogram view==
ParaView can visualize data in a spreadsheet view.  The spreadsheet view can be configured to show all data, or only selected data.  you can also select a row in the spreadsheet view and it will be selected in the 3d view.
You can also show your data as a histogram.  This will show you how many cells have different attributes. 


[[Image:advanced_multiblock_3.png|800px]]
 
==Data Analysis - Spreadsheet and histogram view==
*Open Can.exo.
*Open Can.exo.
*Highlight the can window, and '''Select Cell''' on the can.
*Highlight the can window, and '''Select Cell''' on the can.
Line 94: Line 73:
*'''Split Vertical'''
*'''Split Vertical'''
*In the upper right window, select '''Spreadsheet View'''.
*In the upper right window, select '''Spreadsheet View'''.
*Change the '''Attributes''' to '''Cell Data'''.  Return it to '''Point Data'''.
*Select the '''Show Only Selected Elements''' check box (next to Precision).
*Select the '''Show Only Selected Elements''' check box (next to Precision).
*'''Note that the Spreadsheet can now be sorted - including in parallel.'''
*'''Note that the Spreadsheet can now be sorted - including in parallel.'''
*Select a different cell on the can.
*Select a different cell on the can.
*Highlight the lower right window.
*Highlight the lower right window.
We want magnitude of the DISPL vector. 
*Calculator.  Formula → '''mag(DISPL)'''.  Result → '''MagDispl'''.
*'''Filters'''→'''Data Analysis'''→'''Histogram'''.  '''Apply'''.
*'''Filters'''→'''Data Analysis'''→'''Histogram'''.  '''Apply'''.
*Change Scalars to DISPL.  Apply.
*Change '''Select Input Array''' to '''MagDispl'''.  Apply.
*Animate forward in time one step at a time.
*Animate forward in time one step at a time.
*Play
*Play
*If desired, freeze the X and Y axis in the Properties tab using '''Axis Use Custom Range'''


   
   
[[Image:advanced_multiblock_4.png|800px]]
[[Image:advanced_multiblock_4.png|1000px]]


==Data Analysis - Advanced Spreadsheets ==
==Advanced Spreadsheets ==
*You can either display all of your dataset's points or cells in your spreadsheet, or only those that are selected in the 3d view.  With the '''spreadsheet''' window selected, on the '''Display''' tab, click '''Show only selected elements'''.
*You can either display all of your dataset's points or cells in your spreadsheet, or only those that are selected in the 3d view.  With the '''spreadsheet''' window selected, on the '''Display''' tab, click '''Show only selected elements'''.
*When cells or points are selected in the 3d window, the appropriate row(s) in the spreadsheet view will be highlighted.
*When cells or points are selected in the 3d window, the appropriate row(s) in the spreadsheet view will be highlighted.
Line 114: Line 95:
*'''Note that the Spreadsheet can now be sorted - including in parallel.'''
*'''Note that the Spreadsheet can now be sorted - including in parallel.'''


==Frustrum tool==
*When you are using the '''Select Cells Through''' or '''Select Points Through''', it is possible to see the frustrum (the 3d space you selected).  this toggle can be found in the '''Find Data''' dialog box.


==Data Analysis - Frustrum ==
==Extract Selection==
*When you are using the '''Select Cells Through''' or '''Select Points Through''', it is possible to see the frustrum (the 3d space you selected).  Turn on '''View/ Selection Inspector''' , then '''Selection Type''' - '''Frustrum''', then click the '''Show Frustrum''' check box.
 
 
==Data Analysis - Extract Selection==
*Open can.exo.
*Open can.exo.
*On the toolbar, push the '''Select Cells On''' icon.  This will allow you to manually select a cell on your data set.  
*Using the '''Select Cells Through''' icon, select a few dozen cells.
*Click on the can in one location, turning on only one cell.
*Open the '''Find Data''' dialog, and click '''Freeze Selection'''.  That way, we don't have the can moving out of the frustum over time.
*'''Filters→Data Analysis→Extract Selections''', then click the '''Copy Active Selection''' button, and '''Apply'''.
*'''Extract Selection''' (found on the Find Data dialog), '''Apply'''.
*Split Vertical, Spreadsheet View, and turn on the eyeball in front of the '''ExtractSelection''' filter.
Note that the Extract Selection is also found under '''Filters/ Data Analysis'''.
*You can see Cell data by selecting the '''ExtractSelection→Display''' tab and changing the '''Select Attributes''' to '''Show'''.
*Try animating the data.
*Extra Credit: Turn on visibility of the can, and display it in wireframe.  Change the color of the selected cell to Red.  (The following picture is including the extra credit.)
 


[[Image:advanced_multiblock_5.png|800px]]


[[Image:advanced_multiblock_5.png|1000px]]


==Data Analysis - Spreadsheet data by time==
==Spreadsheet data by time==
*Open can.exo.
*Open can.exo.
*On the toolbar, push the '''Select Points On''' icon.  This will allow you to manually select a point on your data set.  
*On the toolbar, push the '''Select Points On''' icon.  This will allow you to manually select a point on your data set. Select a point on your dataset.
*Rubber band select a point, turning on only one point.
*'''Filters→Data Analysis→Plot Selection Over Time''', then '''Apply'''.
*'''Filters→Data Analysis→Plot Selection Over Time''', then click the '''Copy Active Selection''' button, and '''Apply'''.
*Split Vertical, Spreadsheet View, and with the Spreadsheet View highlighted, turn on the eyeball in front of the '''PlotSelectionOverTime''' filter.
*Split Vertical, Spreadsheet View, and with the Spreadsheet View highlighted, turn on the eyeball in front of the '''PlotSelectionOverTime''' filter.
*Note that you can then write this data out to a .csv file using '''File''' &rarr; '''Export'''.
*Note that you can then write this data out to a .csv file using '''File''' &rarr; '''Export'''.




[[Image:advanced_multiblock_6.png|800px]]
[[Image:advanced_multiblock_6.png|1000px]]


=Acknowledgements=
=Acknowledgements=
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear Security Administration under contract DE-AC04-94AL85000.
Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA-0003525.

Latest revision as of 20:32, 22 June 2017

Introduction

This tutorial covers data analysis.


Find Data dialog

The Find Data dialog box is used to select points or cells, to show the data for these points or cells, to control label display on your data in the 3d view, and as a shortcut to run data analysis filters. We will explore this dialog box using an example.

  • Open a dataset and the Find Data dialog.
    • Open the dataset can.exo. Turn on all variables. Apply.
    • Edit/ Find Data. You can also open the Find Data dialog using the icon Advanced data analysis 1.jpg
  • We will select a GlobalElementId.
    • Find Cells from can.ex2
    • Change pulldown to GlobalElementId. Leave as is. Enter 100.
    • Run Selection Query
  • We will select two GlobalElementIds.
    • Find Cells from can.ex2
    • Change pulldown to GlobalElementId. Change to is one of. Enter 100, 102.
    • Run Selection Query

Advanced data analysis 2.jpg


  • We will select the maximum EQPS.
    • Move forward one timestep. EQPS for timestep 0 is all the same - 0.
    • Find Cells from can.ex2
    • Change pulldown to EQPS. Change to is max.
    • Run Selection Query
    • Play forward


Notice that the data for the selected cell (or point) is displayed in the spreadsheet.


If desired, the maximum (or minimum) cell can be found, and this selection can be frozen. The same cell will then be selected for all timesteps. Use the Freeze Selection button to freeze selections.


We can also display cell or point data on the 3d view. This is done with Cell Labels and Point Labels.

    • Open the Cell Labels pulldown, and select EQPS.


Advanced data analysis 3.jpg


Cell, Point and Block Selections

ParaView has a very powerful group of selection tools. Selections are found as a group of icons in the upper left corner of the 3d view.

  • More than one selection can be active at a time. Use the <CTRL> key. You can also use the Add Selection, Subtract Selection and Toggle Selection icons.
  • Variable data can be printed on the screen for any cell that is selected. See the section on Find Data.
  • Selections can be used as input to numerous Data Analysis filters.


    • Select Cells On. Select one or more cells on the surface of your object. Either click or rubber band select works. Shortcut - s.
    • Select Points On. Select one or more points on the surface of your object. Either click or rubber band select works. Within a tolerance, the nearest point will be selected. Shortcut - d.
    • Select Cells Through. Select cells through your dataset. This is known as a Frustum select. Shortcut - f.
    • Select Points Through. Select points through your dataset. This is also known as a Frustum select. Shortcut - g.
    • Select Cells With Polygon. Select cells on the surface of your dataset by drawing a polygon. No shortcut.
    • Select Points With Polygon. Select points on the surface of your dataset by drawing a polygon. No shortcut.
    • Select Block. Select one or more blocks. Either click or rubber band select works. Shortcut - b.
    • Interactive Select Cells On. Interactively select cells on the surface of your dataset. If you click on a selection, it will become permanent. You can have numerous permanent selections. No shortcut.
    • Interactive Select Points On. Interactively select points on the surface of your dataset. If you click on a selection, it will become permanent. You can have numerous permanent selections. No shortcut.
    • Hover Points On. This will display all of the data available on this point or cell. Interactive.
    • Clear Selection.

Spreadsheet and histogram view

ParaView can visualize data in a spreadsheet view. The spreadsheet view can be configured to show all data, or only selected data. you can also select a row in the spreadsheet view and it will be selected in the 3d view.

You can also show your data as a histogram. This will show you how many cells have different attributes.

  • Open Can.exo.
  • Highlight the can window, and Select Cell on the can.
  • Split Horizontal
  • Split Vertical
  • In the upper right window, select Spreadsheet View.
  • Select the Show Only Selected Elements check box (next to Precision).
  • Note that the Spreadsheet can now be sorted - including in parallel.
  • Select a different cell on the can.
  • Highlight the lower right window.

We want magnitude of the DISPL vector.

  • Calculator. Formula → mag(DISPL). Result → MagDispl.
  • FiltersData AnalysisHistogram. Apply.
  • Change Select Input Array to MagDispl. Apply.
  • Animate forward in time one step at a time.
  • Play
  • If desired, freeze the X and Y axis in the Properties tab using Axis Use Custom Range


Advanced multiblock 4.png

Advanced Spreadsheets

  • You can either display all of your dataset's points or cells in your spreadsheet, or only those that are selected in the 3d view. With the spreadsheet window selected, on the Display tab, click Show only selected elements.
  • When cells or points are selected in the 3d window, the appropriate row(s) in the spreadsheet view will be highlighted.
  • Highlighting works both ways - if you select a row or rows in the spreadsheet view, the cell or point on your dataset will be selected.
  • You can select multiple rows in the spreadsheet by holding down the <ctrl> key, and can select ranges of rows by holding down the <shft> key.
  • Note that the Spreadsheet can now be sorted - including in parallel.

Frustrum tool

  • When you are using the Select Cells Through or Select Points Through, it is possible to see the frustrum (the 3d space you selected). this toggle can be found in the Find Data dialog box.

Extract Selection

  • Open can.exo.
  • Using the Select Cells Through icon, select a few dozen cells.
  • Open the Find Data dialog, and click Freeze Selection. That way, we don't have the can moving out of the frustum over time.
  • Extract Selection (found on the Find Data dialog), Apply.

Note that the Extract Selection is also found under Filters/ Data Analysis.


Advanced multiblock 5.png

Spreadsheet data by time

  • Open can.exo.
  • On the toolbar, push the Select Points On icon. This will allow you to manually select a point on your data set. Select a point on your dataset.
  • Filters→Data Analysis→Plot Selection Over Time, then Apply.
  • Split Vertical, Spreadsheet View, and with the Spreadsheet View highlighted, turn on the eyeball in front of the PlotSelectionOverTime filter.
  • Note that you can then write this data out to a .csv file using FileExport.


Advanced multiblock 6.png

Acknowledgements

Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA-0003525.