| Product(s): | WaterGEMS |
| Version(s): | CONNECT Edition |
| Area: | Layout and Data Input |
Problem
How can I import field data snapshots and observed targets from an external data source such as an Excel spreadsheet?
Solution
First, consider if the amount of data you want to import is reasonable. The more field data snapshots you attempt to include in a Calibration study, the longer it will take to calibrate. See the "Tips" section of this article: Using Darwin Calibrator.
If you really do need to import a large number of snapshots and observed targets, it can be done using ModelBuilder, but the source data will need to be in a specific format.
Note: you can also connect to your field data in SCADAConnect Simulator and use the import field data button in Darwin Calibrator to import field data snapshots from SCADAConnect. See the section "Importing Field Data from SCADA" in the Using Darwin Calibrator article.
Example of data format required using Microsoft Excel
- You can prepare data sheets for multiple hours of the day as seen below.
- You need to import two sheets; one for the observed data and a second to relate the snapshot labels to the observed data and the name of the Study.
- The below example shows a spreadsheet with measured flow through pipes and hydraulic grades at junctions; you can prepare a similar file for other attributes of different elements.
- For directed nodes such as PRVs and PSVs, there is a "to" and "from" HGL or pressure, which need to be mapped to their respective attributes (separate from "junction attribute", "junction pressure", etc)
- For PRVs, PSVs, FCVs, TCVs, GPVs and pumps, the correct Element Type (Label) is “Directed Node”. For pipes, it’s “Pipe” and for junctions and hydrants its “Node”.
-
For PRVs, PSVs, FCVs, TCVs, GPVs and pumps, you'll need to specify the attribute you want to import (pressure/HGL to/from or flow) by mapping to the field "Pump Attribute (Label)" (this may be changed to "Directed Node Attribute (label) in the future since it also applies to valves) Below is the exact expected values to be mapped:
- Hydraulic Grade In
- Hydraulic Grade Out
- Pressure In
- Pressure Out
- Flow
Note: the following example accompanies the Leakage Detection article.
Observed data sheet:
Snapshot sheet:
Importing field data through Modelbuilder into Darwin Calibrator
1) Go to Tools>Modelbuilder > New > Excel. Check the boxes for the sheets containing the snapshots and the observed targets.
2) Click next, change the coordinate units as per your model units.
3) Click next until mapping table; map the filed data of hydraulic grades, flows , element labels, time , owner etc. as shown in the image below. Please select Filed data snapshot, observed target as table type for observed data & Field Data Snapshot for Snapshot Labels.
4) Click next once done with the mapping of Modelbuilder, go to Calibrator to check the imported field data. It should look like this.