GMS:Risk Analysis Wizard: Difference between revisions

From XMS Wiki
Jump to navigationJump to search
 
(49 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{MODFLOW Links}}
{{MODFLOW Links}}
{{Infobox Calibration}}
{{Infobox Calibration}}
The risk analysis wizard is a tool for refining stochastic modeling results.  The Risk Analysis Wizard has two options.  You can either perform a Capture Zone Analysis or a Threshold Analysis.  Capture zone analysis requires a MODFLOW solution set, but threshold analysis can be performed on any solution set type.
The ''Risk Analysis Wizard'' is a tool for refining stochastic modeling results.  The ''Risk Analysis Wizard'' has two options.  The user can either perform a ''Capture Zone Analysis'' or a'' Threshold Analysis''''Capture zone analysis'' requires a MODFLOW solution set, but threshold analysis can be performed on any solution set type.


===Capture Zone Analysis===
===Capture Zone Analysis===
Capture zone analysis includes running [[GMS:MODPATH|MODPATH]] for each of the [[GMS:MODFLOW|MODFLOW]] solutions to generate a capture zone for each well or zone code group in the MODFLOW model.  These capture zones are combined into one probabilistic capture zone
''Capture zone analysis'' includes running [[GMS:MODPATH|MODPATH]] for each of the [[GMS:MODFLOW|MODFLOW]] solutions to generate a capture zone for each well or zone code group in the MODFLOW model.  These capture zones are combined into one probabilistic capture zone


===Threshold Analysis===
===Threshold Analysis===
Threshold analysis is similar to capture zone analysis, but threshold analysis can be performed using any type of 3d data set that has been read into the [[GMS:Project Explorer|Project Explorer]].  You first select a simulation set from the [[GMS:The GMS Screen|Project Explorer]].  Next, you set up rules for generating a probabilistic threshold data set.  For example, you might be looking at a specific contaminant and want to know what the probability is that the concentration of this contaminant will be above the EPA level for drinking water.  You would generate a rule reflecting this limit.  After processing all rules for each simulation, GMS creates a probabilistic threshold data set.
''Threshold analysis'' is similar to ''capture zone analysis'', but ''threshold analysis'' can be performed using any type of 3D dataset that has been read into the [[GMS:Project Explorer|Project Explorer]].   
#First select a simulation set from the [[GMS:The GMS Window|Project Explorer]].   
#Next, set up rules for generating a probabilistic threshold dataset.   
For example, the user might be looking at a specific contaminant and want to know what the probability is that the concentration of this contaminant will be above the EPA level for drinking water.  The user would generate a rule reflecting this limit.  After processing all rules for each simulation, GMS creates a probabilistic threshold dataset.


==Risk Analysis Wizard Dialogs==
==Risk Analysis Wizard Dialogs==
The risk analysis wizard is entered through the right-click menu for a folder in the [[GMS:Project Explorer|Project Explorer]] and choose ''Risk Analysis''... .
The ''Risk Analysis Wizard'' is entered through the right-click menu for a folder in the [[GMS:Project Explorer|Project Explorer]] and choose '''Risk Analysis...''' .


[[Image:Tree_Risk_Anaylsis.gif]]
[[Image:Tree_Risk_Anaylsis.png|230 px]]


===Choosing Between Capture Zone and Threshold Analysis===
===Choosing Between Capture Zone and Threshold Analysis===
The first step in the risk analysis wizard is to choose what type of simulations you want to process.   
The first step in the ''Risk Analysis Wizard'' is to choose what type of simulations to process.   
 
[[Image:ra_3.gif]]


[[Image:RiskAnalysisWizard.jpg|thumb|none|left|400px|''Risk Analysis Wizard'' dialog]]


The window will list all the solution types as the analysis wizard will only process solutions of the same type.  Probabilistic capture zone analysis can only be performed on MODFLOW solutions.  Probabilistic threshold analysis can be performed on any solution type.
The window will list all the solution types as the analysis wizard will only process solutions of the same type.  Probabilistic capture zone analysis can only be performed on MODFLOW solutions.  Probabilistic threshold analysis can be performed on any solution type.


===Capture Zone Analysis Dialog===
===Capture Zone Analysis Dialog===
Capture zone analysis can only be performed on MODFLOW solutions
''Capture Zone Analysis'' can only be performed on MODFLOW solutions
 
[[Image:ra_4.gif]]
 
 
'''Analysis Options - Individual wells'''
 
Choose this option to create a probabilistic capture zone for each uniquely named well in the MODFLOW model.
 
'''Analysis Options - Well groups'''
 
Choose this option to create a probabilistic capture zone for each different zone code number.
 
'''Particle Starting Locations - Distribute particles on water table surface'''
 
Choose this option to distribute particles only on the water table surface.  By default, one particle is placed at the ''xy'' center of the cell at the water table, but you can use the ''Particle placement within cells'' option to change the number of particles placed on the water table in each cell.  This option will create a 2D probabilistic capture zone representing the intersection of the entire 3d probabilistic capture zone with the water table.
 
'''Particle Starting Locations - Distribute particles within cells'''


Choose this option to distribute particles within each cell. By default, one particle is placed at the center of each cell, but you can use the ''Particle placement within cells'' option to change the number of particles placed on within each cell.  This option creates three different probabilistic capture zones.  The first represents the 3D capture zone, the other two represent different 2D projections of the 3D capture zone.
[[Image:CaptureZoneAnalysis.jpg|thumb|none|left|400px|''Capture Zone Analysis'' dialog]]


'''Tracking Duration - To end'''


This option sets MODPATH to move particles through the flow field until they exit the model.
''Analysis Options – Individual wells''
:Choose this option to create a probabilistic capture zone for each uniquely named well in the MODFLOW model.


'''Tracking Duration - Specified duration'''
''Analysis Options – Well groups''
:Choose this option to create a probabilistic capture zone for each different zone code number.


This option sets MODPATH to move particles through the flow field until they either exit the model or the time reaches the duration set, which ever comes first.
''Particle Starting Locations – Distribute particles on water table surface''
:Choose this option to distribute particles only on the water table surface.  By default, one particle is placed at the ''xy'' center of the cell at the water table, but the user can use the ''Particle placement within cells'' option to change the number of particles placed on the water table in each cell.  This option will create a 2D probabilistic capture zone representing the intersection of the entire 3D probabilistic capture zone with the water table.


'''Particle Placement Within Cells'''
''Particle Starting Locations – Distribute particles within cells''
:Choose this option to distribute particles within each cell.  By default, one particle is placed at the center of each cell, but the user can use the ''Particle placement within cells'' option to change the number of particles placed on within each cell.  This option creates three different probabilistic capture zones.  The first represents the 3D capture zone, the other two represent different 2D projections of the 3D capture zone.


This option allows you to change the number of particles per cell from the default of one.  Increase the number of particles leads to a smoother capture zone, but drastically increases the computation time.
''Tracking Duration – To end''
:This option sets MODPATH to move particles through the flow field until they exit the model.


'''Weight Results Based On Residual Error'''
''Tracking Duration – Specified duration''
:This option sets MODPATH to move particles through the flow field until they either exit the model or the time reaches the duration set, which ever comes first.


In all of the capture zone methods, the algorithms used to synthesize the probability data set can be weighted using observation data.  This makes it possible to give more weight to model instances with smaller calibration error when calculating the capture zone probabilitiesThe weighted head and flow observations can be compared to the computed values to come up with a global error norm, E, for each model run.  This error norm can be based on the root mean squared (RMS) error, the sum of the squared weighted residuals, or any other measure selected by the modeler.  For capture zone analysis, GMS uses the sum of squared weighted residuals (SSWR) for the error norm. The error norm from each MODFLOW run is used to compute a weight for the given solution using the following equation:
''Particle Placement Within Cells'''
:This option allows the user to change the number of particles per cell from the default of oneIncrease the number of particles leads to a smoother capture zone, but drastically increases the computation time.


[[Image:wt_eq.gif]]......................(1)
''Weight Results Based On Residual Error''
:In all of the capture zone methods, the algorithms used to synthesize the probability data set can be weighted using observation data. This makes it possible to give more weight to model instances with smaller calibration error when calculating the capture zone probabilities. The weighted head and flow observations can be compared to the computed values to come up with a global error norm, E, for each model run. This error norm can be based on the root mean squared (RMS) error, the sum of the squared weighted residuals, or any other measure selected by the modeler. For capture zone analysis, GMS uses the sum of squared weighted residuals (SSWR) for the error norm.  The error norm from each MODFLOW run is used to compute a weight for the given solution using the following equation:


Where W<sub>i</sub> is the weight applied to solution i, [[Image:alpha_char.gif]] is a user-defined factor, ME is the mean of the error values from all solutions, E<sub>jk</sub> is the error for solution i, and SD is the standard deviation of error values from all solutions. The weights are also normalized as follows
<!--<math>{\displaystyle w_i = \alpha ^ {\left [ \frac{ME-E_i}{SD} \right ]}}</math>-->
::[[Image:riskwizardeq1.jpg]] ......................(1)


[[Image:wt_final.gif]]......................(2)
:Where ''W<sub>i</sub>'' is the weight applied to solution ''i'', &alpha; is a user-defined factor, ''ME'' is the mean of the error values from all solutions, ''E<sub>jk</sub>'' is the error for solution ''i'', and ''SD'' is the standard deviation of error values from all solutions. The weights are also normalized as follows


so that the weights sum to unity.  Equation 1 was developed to give the greater emphasis to the lower error values and to allow the user to control the relative emphasis given to low vs. high values simply by adjusting the [[Image:alpha_char.gif]] value.  The equation also avoids problems when one of the error values is zero, since a zero error value does not result in an infinite weight.  We also wanted the equation to scale the weights according to the data being examined.  This is done by subtracting the individual SSWR from the mean error and dividing by the standard deviation.   
<!--<math>{\displaystyle w_{final} = \frac{w_i}{\sum w_i}}</math>-->
::[[Image:riskwizardeq2.jpg]] .......................(2)
:so that the weights sum to unity.  Equation 1 was developed to give the greater emphasis to the lower error values and to allow controlling the relative emphasis given to low vs. high values simply by adjusting the &alpha; value.  The equation also avoids problems when one of the error values is zero, since a zero error value does not result in an infinite weight.  The equation is also designed to allow scaling the weights according to the data being examined.  This is done by subtracting the individual SSWR from the mean error and dividing by the standard deviation.   


Equation 1 centers the weights on the mean error.  The relative weight given to values differing from the mean is biased by the factor.  This makes it possible to bias the resulting weight using knowledge of the site and the quality of the observation data.  
:Equation 1 centers the weights on the mean error.  The relative weight given to values differing from the mean is biased by the factor.  This makes it possible to bias the resulting weight using knowledge of the site and the quality of the observation data.  


The figure below shows how the [[Image:alpha_char.gif]] factor in Equation 1 affects the weight applied to a given error.  An [[Image:alpha_char.gif]] factor of 1.2 makes the contribution of each SSWR almost linear, whereas an [[Image:alpha_char.gif]] factor of ten gives most of the weight to the lowest 5-10 percent while discounting the other error values.  We typically use an [[Image:alpha_char.gif]] value of 2.0.
:The figure below shows how the &alpha; factor in Equation 1 affects the weight applied to a given error.  An &alpha; factor of 1.2 makes the contribution of each SSWR almost linear, whereas an &alpha; factor of ten gives most of the weight to the lowest 5&ndash;10 percent while discounting the other error values.  Typically use an &alpha; value of 2.0.


[[Image:wt_plot1.gif|none|frame|Weight versus Error Norm Plot]]
:[[Image:wt_plot1.png|thumb|center|475 px|''Weight versus Error Norm Plot'']]


===Threshold Analysis Dialog===
===Threshold Analysis Dialog===
Threshold analysis can be performed on any collection of 3d data sets.  The threshold analysis data set is created by using rules.  For each rule, you select a dataset (only applies to solutions with multiple data sets.), the greater or less than sign and a value.  You can have as many rules as you want.  The AND and OR logic options allow you to use - 1st rule AND 2nd rule AND 3rd rule, or - 1st rule OR 2nd rule OR 3rd rule.  Threshold analysis creates one 3D data set.
Threshold analysis can be performed on any collection of 3D datasets.  The threshold analysis dataset is created by using rules.  For each rule, select a dataset (only applies to solutions with multiple data sets.), the greater or less than sign and a value.  There is no limit to the number of rulse that can be created.  The AND and OR logic options allow the user to use: 1st rule AND 2nd rule AND 3rd rule; or 1st rule OR 2nd rule OR 3rd rule.  Threshold analysis creates one 3D dataset.


[[Image:ra_1.jpg]]
[[Image:ThresholdAnalysis.jpg|thumb|none|left|360px|''Threshold Analysis'' dialog]]


{{Navbox GMS}}
{{Navbox GMS}}
Line 83: Line 78:
[[Category:MODFLOW]]
[[Category:MODFLOW]]
[[Category:Stochastic]]
[[Category:Stochastic]]
[[Category:GMS Stochastic Modeling Dialogs]]
[[Category:Equations|Risk]]

Latest revision as of 15:15, 8 September 2017

MODFLOW
Pre-processing
MODFLOW Commands
Building a MODFLOW Model
Map to MODFLOW
Calibration
Packages Supported in GMS
Saving a MODFLOW Simulation
Importing MODFLOW Files
Unsupported MODFLOW Features
Run MODFLOW
Post-processing
MODFLOW Display Options
MODFLOW Post-Processing Viewing Options
Reading a MODFLOW Simulation
Tutorials
Packages
Flow: BCF6, HUF, LPF, UPW
Solvers:

DE4, GMG, NWT, PCG,

PCGN, LMG, SIP, SOR,

SMS
Other:

BAS6, BFH, CHD1, CLN,

DRN1, DRT1, EVT1, ETS1,

GAGE, GHB1, GNC, HFB1,

HUF, LAK3, MNW1, MNW2,

OUT1, RCH1, RIV1, SFR2,

STR1, SUB1, SWI2, WEL1,

UZF1

Calibration,
Parameters,
Stochastic Modeling
Calibration
Model Calibration
Automated Parameter Estimation
PEST Dialog
PEST
Run Options
Observations
MODFLOW-USG Observations
Plot Wizard
Calibration Targets
Parameters
Parameters
Parameter Dialog
Pilot Points
Multiplier Arrays for Parameters
Standard MODFLOW Parameters
Stochastic Modeling
Stochastic Modeling
Gaussian Field Generator
Risk Analysis Wizard
T-PROGS

The Risk Analysis Wizard is a tool for refining stochastic modeling results. The Risk Analysis Wizard has two options. The user can either perform a Capture Zone Analysis or a Threshold Analysis. Capture zone analysis requires a MODFLOW solution set, but threshold analysis can be performed on any solution set type.

Capture Zone Analysis

Capture zone analysis includes running MODPATH for each of the MODFLOW solutions to generate a capture zone for each well or zone code group in the MODFLOW model. These capture zones are combined into one probabilistic capture zone

Threshold Analysis

Threshold analysis is similar to capture zone analysis, but threshold analysis can be performed using any type of 3D dataset that has been read into the Project Explorer.

  1. First select a simulation set from the Project Explorer.
  2. Next, set up rules for generating a probabilistic threshold dataset.

For example, the user might be looking at a specific contaminant and want to know what the probability is that the concentration of this contaminant will be above the EPA level for drinking water. The user would generate a rule reflecting this limit. After processing all rules for each simulation, GMS creates a probabilistic threshold dataset.

Risk Analysis Wizard Dialogs

The Risk Analysis Wizard is entered through the right-click menu for a folder in the Project Explorer and choose Risk Analysis... .

Tree Risk Anaylsis.png

Choosing Between Capture Zone and Threshold Analysis

The first step in the Risk Analysis Wizard is to choose what type of simulations to process.

Risk Analysis Wizard dialog

The window will list all the solution types as the analysis wizard will only process solutions of the same type. Probabilistic capture zone analysis can only be performed on MODFLOW solutions. Probabilistic threshold analysis can be performed on any solution type.

Capture Zone Analysis Dialog

Capture Zone Analysis can only be performed on MODFLOW solutions

Capture Zone Analysis dialog


Analysis Options – Individual wells

Choose this option to create a probabilistic capture zone for each uniquely named well in the MODFLOW model.

Analysis Options – Well groups

Choose this option to create a probabilistic capture zone for each different zone code number.

Particle Starting Locations – Distribute particles on water table surface

Choose this option to distribute particles only on the water table surface. By default, one particle is placed at the xy center of the cell at the water table, but the user can use the Particle placement within cells option to change the number of particles placed on the water table in each cell. This option will create a 2D probabilistic capture zone representing the intersection of the entire 3D probabilistic capture zone with the water table.

Particle Starting Locations – Distribute particles within cells

Choose this option to distribute particles within each cell. By default, one particle is placed at the center of each cell, but the user can use the Particle placement within cells option to change the number of particles placed on within each cell. This option creates three different probabilistic capture zones. The first represents the 3D capture zone, the other two represent different 2D projections of the 3D capture zone.

Tracking Duration – To end

This option sets MODPATH to move particles through the flow field until they exit the model.

Tracking Duration – Specified duration

This option sets MODPATH to move particles through the flow field until they either exit the model or the time reaches the duration set, which ever comes first.

Particle Placement Within Cells'

This option allows the user to change the number of particles per cell from the default of one. Increase the number of particles leads to a smoother capture zone, but drastically increases the computation time.

Weight Results Based On Residual Error

In all of the capture zone methods, the algorithms used to synthesize the probability data set can be weighted using observation data. This makes it possible to give more weight to model instances with smaller calibration error when calculating the capture zone probabilities. The weighted head and flow observations can be compared to the computed values to come up with a global error norm, E, for each model run. This error norm can be based on the root mean squared (RMS) error, the sum of the squared weighted residuals, or any other measure selected by the modeler. For capture zone analysis, GMS uses the sum of squared weighted residuals (SSWR) for the error norm. The error norm from each MODFLOW run is used to compute a weight for the given solution using the following equation:
Riskwizardeq1.jpg ......................(1)
Where Wi is the weight applied to solution i, α is a user-defined factor, ME is the mean of the error values from all solutions, Ejk is the error for solution i, and SD is the standard deviation of error values from all solutions. The weights are also normalized as follows
Riskwizardeq2.jpg .......................(2)
so that the weights sum to unity. Equation 1 was developed to give the greater emphasis to the lower error values and to allow controlling the relative emphasis given to low vs. high values simply by adjusting the α value. The equation also avoids problems when one of the error values is zero, since a zero error value does not result in an infinite weight. The equation is also designed to allow scaling the weights according to the data being examined. This is done by subtracting the individual SSWR from the mean error and dividing by the standard deviation.
Equation 1 centers the weights on the mean error. The relative weight given to values differing from the mean is biased by the factor. This makes it possible to bias the resulting weight using knowledge of the site and the quality of the observation data.
The figure below shows how the α factor in Equation 1 affects the weight applied to a given error. An α factor of 1.2 makes the contribution of each SSWR almost linear, whereas an α factor of ten gives most of the weight to the lowest 5–10 percent while discounting the other error values. Typically use an α value of 2.0.
Weight versus Error Norm Plot

Threshold Analysis Dialog

Threshold analysis can be performed on any collection of 3D datasets. The threshold analysis dataset is created by using rules. For each rule, select a dataset (only applies to solutions with multiple data sets.), the greater or less than sign and a value. There is no limit to the number of rulse that can be created. The AND and OR logic options allow the user to use: 1st rule AND 2nd rule AND 3rd rule; or 1st rule OR 2nd rule OR 3rd rule. Threshold analysis creates one 3D dataset.

Threshold Analysis dialog