Energy Load Forecasting > Using CygNet ELF > CygNet ELF EIE Editor > Configuring System Settings > Configuring Data Validation Rules

Configuring Data Validation Rules

Before training occurs, the data that is designated as inputs to the training process must be validated. As each hour is imported into the system, filling rules are applied first, followed by validation rules.

Data validation settings must be associated with a particular Input Item Type (Ordinal or Categorical). If provided, the validation settings are used to check each input value. If a value does not comply with the validation settings, it will not be used for the corresponding hour interval. Instead, a value will be assigned for the hour based on the configured data filling settings.

To Configure Data Validation Rules

This dialog box is accessible in two ways:

  1. Click the System Settings page of the ELF Editor.
  2. Configure the system properties as described in Configuring System Settings.
  3. Click Gas Load Settings.
  4. Click … next to the Validation Rules text box to view the Data Validation Settings dialog box.
  5. Configure the rules using the properties described below.
  1. Click the Input Items page of the ELF Editor.
  2. Click Add Item or Edit Item to view the Add/Edit Input Data Item dialog box.
  3. Click … next to the Validation Rules text box to view the Data Validation Settings dialog box.
  4. Configure the rules using the properties described below.

Data Validation Rules for Ordinal Data Item Type

The available data validation methods for Ordinal data item types are Out-of-Range Validation and Deviation Validation. These methods are not mutually exclusive, and if both are enabled then the failure of either method will cause the value to be rejected.

Data Validation Settings

The properties on the Ordinal Data Validation Settings dialog box are described below.

Parameter Description

Enable Out-of-Range Validation
  • Click Enable Out-of-Range Validation to configure the allowable range for input values.
  • Enter a Minimum Value and Maximum Value.

Enable Deviation Validation

Click Enable Deviation Validation to configure the allowed deviation from the previous hour’s value in the import file. The deviation validation method can be specified as an absolute deviation value or a percentage deviation value.

  • Select either an Absolute or a Percentage deviation value.
  • Enter a Deviation Value.

Invalid Data Filling Settings

If a value does not comply with the configured validation settings, it will not be used for the corresponding hourly interval. Instead, a value will be assigned for the hour based on the following data filling settings.

Data Generation

For Ordinal data item types, the available data filling actions are the following:

Filling Action Description
No Action Take no action.
Default Value Provide a default value to be directly assigned.

Previous Value

Assign the value from the previous hour for the current point. If the previous value was filled, then that filled value will be used. This value may be used as fall-back value.

Closest Range Value

This option is available only if that Data Item Type has Out-of-Range Validation parameters configured. This action will assign the range value that is closest to the actual value. For example, if the maximum is 1,000 and the actual value is 1,500, then 1,000 will be assigned.

Default Value

Enter a Default Value.

OK

The OK button will only become enabled when valid Out-of-Range (OOR) or Deviation values are configured. See the note to the left of the OK button for user assistance.

Data Validation Rules for Categorical Data Item Type

For Categorical data item types, the possible values for each particular input type must be configured. A Categorical value must exist in the configured table, or else it will be rejected. This will be verified at the time when a categorical input is imported, so validation is not needed at this point.

Categorical Data Item Type

The properties on the Categorical Data Validation Settings dialog box are described below.

Parameter Description

Data Generation

For Categorical input data items, the available validation actions are the following:

Filling Action Description
No Action Take no action.
Default Value Provide a default value to be directly assigned.

Previous Value

Assign the value from the previous hour for the current point. If the previous value was filled, then that filled value will be used. This value may be used as fall-back value.

Default Value

Select a Default Value.
Back to top

Let us know how we can improve this topic.

CygNet at weatherford.com

© 2020 Weatherford. All rights reserved.