WMS:Datasets: Difference between revisions

From XMS Wiki
Jump to navigationJump to search
 
(37 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[File:Image330.jpg|thumb|200 px]]
[[File:DatasetsProjectExplorer.jpg|thumb|200 px]]
WMS was designed as a general purpose watershed modeling system. One of the main purposes of WMS is to provide a consistent interface for a variety of models and grid types. In order to accomplish this goal, input data for models and solution data (other than those models defined using topological trees) are handled in a simple, consistent fashion using datasets. They are accessed and managed using the ''Project Explorer'' as shown in the figure to the right.
WMS was designed as a general purpose watershed modeling system. One of the main purposes of WMS is to provide a consistent interface for a variety of models and grid types. In order to accomplish this goal, input data for models and solution data (other than those models defined using topological trees) are handled in a simple, consistent fashion using datasets. They are accessed and managed using the Project Explorer as shown in the figure to the right.


A dataset is a set of values associated with each grid cell, or scatter point. A dataset can be steady state (one value per item) or transient (one value per item per time step). The following objects in WMS each have a scalar dataset list:
A dataset is a set of values associated with each grid cell, or scatter point. A dataset can be steady state (one value per item) or transient (one value per item per time step). The following objects in WMS each have a scalar dataset list:


*TINs (elevations and solutions for flood plain delineation)
*TINs (elevations and solutions for floodplain delineation)


*2D Grids (solutions for the GSSHA model)
*2D Grids (solutions for the GSSHA model)


*2D Scatter Point Sets (could be a variety of things, but are used in WMS for storing hydraulic modeling water surface elevations that are used to delineate flood plains)
*2D Scatter Point Sets (could be a variety of things, but are used in WMS for storing hydraulic modeling water surface elevations that are used to delineate floodplains)


The commands for manipulating datasets are located in the ''Data'' menu of the respective modules, and as part of the ''Project Explorer'' where datasets are listed separately, or as part of solution folders.
The commands for manipulating datasets are located in the ''Data'' menu of the respective modules, and as part of the ''Project Explorer'' where datasets are listed separately, or as part of solution folders.
Line 16: Line 16:
==Active Dataset==
==Active Dataset==


The active dataset is specified by selecting it from the ''Project Explorer''. Datasets may be stored in individual folders. In addition, if a transient dataset is highlighted, the time steps for the dataset are listed in the text box directly beneath the ''Project Explorer'' and one of the time steps is highlighted.  
The active dataset is specified by selecting it from the Project Explorer. Datasets may be stored in individual folders. In addition, if a transient dataset is highlighted, the time steps for the dataset are listed in the text box directly beneath the Project Explorer and one of the time steps is highlighted.  


The values corresponding to the active dataset and time step are used whenever contour, or color fringe plots are generated. In addition, the entire range of time steps of the active dataset are used whenever animation film loops are generated. Whenever a new data set is created by importing from a file, interpolating, or using the data calculator, the dataset becomes the active dataset for the object.
The values corresponding to the active dataset and time step are used whenever contour, or color fringe plots are generated. In addition, the entire range of time steps of the active dataset are used whenever animation film loops are generated. Whenever a new dataset is created by importing from a file, interpolating, or using the data calculator, the dataset becomes the active dataset for the object.


==Data Calculator==
==Data Calculator==


[[Image:Data_Calculator.jpg|thumb|300px|right|Data Calculator]]
[[Image:Data_Calculator.png|thumb|375px|right|Data Calculator]]


The ''Data Calculator'' can be used to perform mathematical operations with datasets to create new datasets. The ''Data Calculator'' is accessed by selecting the '''Data Calculator''' command from the ''Data'' or ''Edit'' menu.
* Performs mathematical calculations on scalar datasets
* Performs mathematical calculations on scalar datasets
* Calculations can include any number of scalar datasets and user supplied numbers
* Calculations can include any number of scalar datasets and user supplied numbers
Line 30: Line 31:


[[Data Calculator|More on Data Calculator]]
[[Data Calculator|More on Data Calculator]]
<br style="clear:both;"/>


==Dataset Info==
==Dataset Info==


The '''Properties''' command, available when right-clicking on a dataset in the ''Project Explorer'' will bring up a dialog listing some of the main characteristics of the active scalar dataset. These include statistics such as maximum, minimum and range as well as mean and standard deviation. A histogram of the dataset is also generated and plotted in the dialog.
The '''Properties''' command, available when right-clicking on a dataset in the Project Explorer will bring up a dialog listing some of the main characteristics of the active scalar dataset. These include statistics such as maximum, minimum and range as well as mean and standard deviation. A histogram of the dataset is also generated and plotted in the dialog.
 
:[[Image:WMS Dataset Info.png|thumb|none|left|400 px|''Dataset Info'' dialog]]


==Deleting Datasets==
==Deleting Datasets==
 
Datasets can be deleted by selecting the dataset in the Project Explorer and selecting the '''Delete''' key on the keyboard. This deletes the binary copy of the dataset on disk. If the original dataset file was already in binary form, the file is not deleted.
Data sets can be deleted by selecting the dataset in the ''Project Explorer'' and selecting the '''Delete''' key on your keyboard. This deletes the binary copy of the dataset on disk. If the original dataset file was already in binary form, the file is not deleted.


Datasets that are part of solutions cannot be deleted unless the entire solution is deleted.
Datasets that are part of solutions cannot be deleted unless the entire solution is deleted.
Line 55: Line 56:


==Solutions==
==Solutions==
Because some programs produce multiple datasets as part of a model run (GSSHA, stochastic modeling with flood plain delineation) it is convenient to be able to group all of the datasets together for reading, displaying, and managing. WMS uses the concept of a solution set which is collection of datasets for TINS or GRIDs and can also include hydrographs at single points. Solutions are identified in the ''Project Explorer'' as folders, with included datasets and provide another level of management for datasets.
Because some programs produce multiple datasets as part of a model run (GSSHA, stochastic modeling with floodplain delineation) it is convenient to be able to group all of the datasets together for reading, displaying, and managing. WMS uses the concept of a solution set which is collection of datasets for TINS or GRIDs and can also include hydrographs at single points. Solutions are identified in the ''Project Explorer'' as folders, with included datasets and provide another level of management for datasets.


==Dataset Zonal Classification==
==Dataset Zonal Classification==


The '''dataset zonal classification''' function classifies one or two datasets into a single integer dataset (also known as an index map in GSSHA models).
The ''Dataset Zonal Classification'' function classifies one or two datasets into a single integer dataset (also known as an index map in GSSHA models).


Sometimes, you need to classify the results of one or two datasets to create a single index map.  For example, If you have one dataset showing sediment erosion and a second dataset showing sediment deposition, you might want to find areas with high sediment erosion and low deposition or vice versa.  The '''dataset zonal classification''' tool helps you to find these areas.  When you select the '''dataset zonal classification''' command from the ''Data'' menu, the following dialog appears:
Sometimes, it's necessary to classify the results of one or two datasets to create a single index map.  For example, if there is one dataset showing sediment erosion and a second dataset showing sediment deposition, it could be desired to find areas with high sediment erosion and low deposition or vice versa.  The ''Dataset Zonal Classification'' tool helps to find these areas.  When selecting the '''Dataset Zonal Classification''' command from the ''Data'' menu, the following dialog appears:


[[Image:DatasetZonalClassification1.jpg|600 px]]
:[[Image:DatasetZonalClassification1.png|thumb|none|left|500 px|''Dataset Zonal Classification'' dialog.]]


You can modify the parameters in this dialog to generate the type of index map you want to generate.  The ''Select Dataset'' option allows you to select a dataset on the 2D grid.  Changing the ''number of divisions'' changes the number of minimum/maximum value pairs used to setup the dataset.  After you select a dataset, you can select the '''Dataset Info''' button to show the dataset properties.  You can also edit the minimum values for each range.  You cannot set the minimum value for each range above the maximum for the current range or below the minimum for the previous range.
Modify the parameters in this dialog to generate the type of index map to be generated.  The ''Select Dataset'' option allows selecting a dataset on the 2D grid.  Changing the ''Number of divisions'' changes the number of minimum/maximum value pairs used to setup the dataset.  After selecting a dataset, select the '''Dataset Info''' button to show the dataset properties.  It is also possible edit the minimum values for each range.  The minimum value for each range cannot be set above the maximum for the current range or below the minimum for the previous range.


If you just want to classify values in a single dataset, you can turn off the ''Compare to additional dataset'' option  
If wanting to classify values in a single dataset, turn off the ''Compare to additional dataset'' option  
(this is turned off by default) and define zonal classifications and colors for 2 or more ranges of numbers.
(this is turned off by default) and define zonal classifications and colors for 2 or more ranges of numbers.


Clicking on the '''OK''' button generates a new index map with the name ''Classified'', shown below.  The colors are assigned to each grid cell in this dataset based on the colors specified in the ''Dataset Zonal Classification Display'' dialog.
Clicking on the '''OK''' button generates a new index map with the name ''Classified'', shown below.  The colors are assigned to each grid cell in this dataset based on the colors specified in the ''Dataset Zonal Classification Display'' dialog.


[[Image:DatasetZonalClassification2.jpg|300 px]]
:[[Image:DatasetZonalClassification2.jpg|thumb|none|left|300 px|]]


Clicking on the '''Display''' button allows you to view the index map values and set the colors for each set of ranges on each of the two datasets.
Clicking on the '''Display''' button allows viewing the index map values and set the colors for each set of ranges on each of the two datasets.
===Dataset Zonal Classification Display===
===Dataset Zonal Classification Display===
The '''Dataset Zonal Classification Display''' dialog is used to define the index map colors for each index map ID used when combining two datasets.
The ''Dataset Zonal Classification Display'' dialog is used to define the index map colors for each index map ID used when combining two datasets.
 
:[[Image:DatasetZonalClassificationDisplay1.png|thumb|none|left|500 px|The ''Dataset Zonal Classification Display'' dialog.]]
 
Either change individual colors or the colors for the color index values and the surrounding colors will be interpolated based on the index value colors.  To change the index value colors, select the '''Color Setup''' button and define the colors used for low and high values of combinations of the one or two datasets that are selected.
 
==Smooth Dataset==
Sometimes it is desired to smooth elevation data or another dataset associated with a TIN.  This may be because of a need to remove flat areas or other anomalies in the elevation dataset.  When smoothing a dataset on the TIN, WMS runs a single iteration with a maximum change in elevation of 0.5 units and a filter ratio of 0.8.  See [[WMS:Smoothing_DEMs|Smoothing DEMs]] for more information about these variables.
 
There is also an option to [[WMS:Vertices#Smoothing Pits|smooth pits]].  This function automatically swaps edges and and adjusts coordinates to remove low spots on the TIN.


[[Image:DatasetZonalClassificationDisplay1.jpg|500 px]]
==Edit Dataset Values==
[[File:WMS Edit Dataset Values dialog.png|thumb|right|300px|''Edit Dataset Values'' dialog.]]
The ''Edit Dataset Values'' dialog is accessible by right-clicking on a dataset in the Project Explorer and selecting '''View Values...'''. At the top of the dialog, the following non-editable items are listed:
*''Object'' &ndash; The type of object the dataset corresponds to (2D grid, scatter set, and so on).
*''Dataset'' &ndash; The name of the dataset.
*''Time step'' &ndash; The time step, if applicable.


You can either change individual colors or the colors for the color index values and the surrounding colors will be interpolated based on the index value colors. To change the index value colors, select the '''Color Setup''' button and define the colors used for low and high values of combinations of the one or two datasets that are selected.
Below that is a spreadsheet listing line items and their corresponding data. This information can vary, depending on the type of dataset selected.


At the bottom of the dialog are the following buttons:
*'''Help''' &ndash; Opens this article in a web browser.
*'''OK''' &ndash; Saves an changes made and closes the ''Edit Dataset Values'' dialog.
*'''Cancel''' &ndash; Discards and changes made and closes the ''Edit Dataset Values'' dialog.
{{-}}
==Related Topics==
==Related Topics==
* [[WMS:File I/O|File I/O]]
* [[WMS:File I/O|File I/O]]
Line 88: Line 108:


{{WMSMain}}
{{WMSMain}}
[[Category:Data Sets]]
[[Category:Datasets|W]]
[[Category:WMS Tools|D]]
[[Category:WMS General Information|D]]
[[Category:WMS Dialogs|Datasets]]
[[Category:Project Explorer]]

Latest revision as of 23:04, 4 January 2023

DatasetsProjectExplorer.jpg

WMS was designed as a general purpose watershed modeling system. One of the main purposes of WMS is to provide a consistent interface for a variety of models and grid types. In order to accomplish this goal, input data for models and solution data (other than those models defined using topological trees) are handled in a simple, consistent fashion using datasets. They are accessed and managed using the Project Explorer as shown in the figure to the right.

A dataset is a set of values associated with each grid cell, or scatter point. A dataset can be steady state (one value per item) or transient (one value per item per time step). The following objects in WMS each have a scalar dataset list:

  • TINs (elevations and solutions for floodplain delineation)
  • 2D Grids (solutions for the GSSHA model)
  • 2D Scatter Point Sets (could be a variety of things, but are used in WMS for storing hydraulic modeling water surface elevations that are used to delineate floodplains)

The commands for manipulating datasets are located in the Data menu of the respective modules, and as part of the Project Explorer where datasets are listed separately, or as part of solution folders.

Datasets are used for both pre- and post-processing of models. For example, a scalar dataset associated with a 2D grid can represent starting values of surface depth or values of hydraulic conductivity for a runoff modeling problem. Another dataset associated with the same grid may represent computed depth values. All datasets can be used to generate contours, color fringes, and animation sequences.

Active Dataset

The active dataset is specified by selecting it from the Project Explorer. Datasets may be stored in individual folders. In addition, if a transient dataset is highlighted, the time steps for the dataset are listed in the text box directly beneath the Project Explorer and one of the time steps is highlighted.

The values corresponding to the active dataset and time step are used whenever contour, or color fringe plots are generated. In addition, the entire range of time steps of the active dataset are used whenever animation film loops are generated. Whenever a new dataset is created by importing from a file, interpolating, or using the data calculator, the dataset becomes the active dataset for the object.

Data Calculator

Data Calculator

The Data Calculator can be used to perform mathematical operations with datasets to create new datasets. The Data Calculator is accessed by selecting the Data Calculator command from the Data or Edit menu.

  • Performs mathematical calculations on scalar datasets
  • Calculations can include any number of scalar datasets and user supplied numbers
  • Useful for computing derived values such as Froude numbers
  • Useful for comparing scalar datasets

More on Data Calculator

Dataset Info

The Properties command, available when right-clicking on a dataset in the Project Explorer will bring up a dialog listing some of the main characteristics of the active scalar dataset. These include statistics such as maximum, minimum and range as well as mean and standard deviation. A histogram of the dataset is also generated and plotted in the dialog.

Dataset Info dialog

Deleting Datasets

Datasets can be deleted by selecting the dataset in the Project Explorer and selecting the Delete key on the keyboard. This deletes the binary copy of the dataset on disk. If the original dataset file was already in binary form, the file is not deleted.

Datasets that are part of solutions cannot be deleted unless the entire solution is deleted.

All datasets associated with an object are automatically deleted whenever the object is deleted or whenever the number of cells or vertices in the grid or scatter dataset is changed due to an editing command.

Elevations

Whenever a grid or scatter point set is created or read from a file, a scalar dataset is created containing the elevations of the cells or data points. Thus, there is always at least one dataset associated with each grid/TIN. This dataset cannot be deleted.

Mapping Elevations

For 2D grids it is often useful to change the values used for the elevations of the objects. For example, suppose a set of data values has been interpolated to a grid. The values can be displayed using contours. Another way to display the values is to map the dataset to the mesh elevations. This option further emphasizes the variation in the data when the grid is displayed in oblique view.

Any dataset can be mapped to elevations using the Map to Elevations command in the Data menu. The original elevations are always saved as a dataset so that the original elevations can be restored at a later time.

Solutions

Because some programs produce multiple datasets as part of a model run (GSSHA, stochastic modeling with floodplain delineation) it is convenient to be able to group all of the datasets together for reading, displaying, and managing. WMS uses the concept of a solution set which is collection of datasets for TINS or GRIDs and can also include hydrographs at single points. Solutions are identified in the Project Explorer as folders, with included datasets and provide another level of management for datasets.

Dataset Zonal Classification

The Dataset Zonal Classification function classifies one or two datasets into a single integer dataset (also known as an index map in GSSHA models).

Sometimes, it's necessary to classify the results of one or two datasets to create a single index map. For example, if there is one dataset showing sediment erosion and a second dataset showing sediment deposition, it could be desired to find areas with high sediment erosion and low deposition or vice versa. The Dataset Zonal Classification tool helps to find these areas. When selecting the Dataset Zonal Classification command from the Data menu, the following dialog appears:

Dataset Zonal Classification dialog.

Modify the parameters in this dialog to generate the type of index map to be generated. The Select Dataset option allows selecting a dataset on the 2D grid. Changing the Number of divisions changes the number of minimum/maximum value pairs used to setup the dataset. After selecting a dataset, select the Dataset Info button to show the dataset properties. It is also possible edit the minimum values for each range. The minimum value for each range cannot be set above the maximum for the current range or below the minimum for the previous range.

If wanting to classify values in a single dataset, turn off the Compare to additional dataset option (this is turned off by default) and define zonal classifications and colors for 2 or more ranges of numbers.

Clicking on the OK button generates a new index map with the name Classified, shown below. The colors are assigned to each grid cell in this dataset based on the colors specified in the Dataset Zonal Classification Display dialog.

DatasetZonalClassification2.jpg

Clicking on the Display button allows viewing the index map values and set the colors for each set of ranges on each of the two datasets.

Dataset Zonal Classification Display

The Dataset Zonal Classification Display dialog is used to define the index map colors for each index map ID used when combining two datasets.

The Dataset Zonal Classification Display dialog.

Either change individual colors or the colors for the color index values and the surrounding colors will be interpolated based on the index value colors. To change the index value colors, select the Color Setup button and define the colors used for low and high values of combinations of the one or two datasets that are selected.

Smooth Dataset

Sometimes it is desired to smooth elevation data or another dataset associated with a TIN. This may be because of a need to remove flat areas or other anomalies in the elevation dataset. When smoothing a dataset on the TIN, WMS runs a single iteration with a maximum change in elevation of 0.5 units and a filter ratio of 0.8. See Smoothing DEMs for more information about these variables.

There is also an option to smooth pits. This function automatically swaps edges and and adjusts coordinates to remove low spots on the TIN.

Edit Dataset Values

Edit Dataset Values dialog.

The Edit Dataset Values dialog is accessible by right-clicking on a dataset in the Project Explorer and selecting View Values.... At the top of the dialog, the following non-editable items are listed:

  • Object – The type of object the dataset corresponds to (2D grid, scatter set, and so on).
  • Dataset – The name of the dataset.
  • Time step – The time step, if applicable.

Below that is a spreadsheet listing line items and their corresponding data. This information can vary, depending on the type of dataset selected.

At the bottom of the dialog are the following buttons:

  • Help – Opens this article in a web browser.
  • OK – Saves an changes made and closes the Edit Dataset Values dialog.
  • Cancel – Discards and changes made and closes the Edit Dataset Values dialog.


Related Topics