🛢️ Oil & Gas · Data Flow
Well Data Ingestion Pipeline
How drilling and production data from wells is collected, quality-checked, stored and shared with engineering teams.
Drawing diagram…
What this diagram shows
- Real-time drilling data uses the WITSML standard
- Data quality checks catch frozen or out-of-range sensors
- Validated data feeds the historian and data lake
Prompt used
Data flow for well data: rig sensors produce real-time drilling data as WITSML, production wells send SCADA tags, and wireline/log files arrive as LAS/DLIS. An ingestion service normalises formats and units, data quality rules flag frozen, missing or out-of-range values for a data steward, validated time-series go to the historian and all data to an OSDU-style data lake, which feeds geoscience and engineering applications.
Mermaid code
flowchart LR RIG[Rig sensors] -->|WITSML real-time| ING[Ingestion Service] SCADA[Production SCADA] -->|Tags| ING LOGS[Wireline logs] -->|LAS / DLIS files| ING ING -->|Normalised units| DQ[Data Quality Rules] DQ -->|Frozen or out-of-range| DS[Data Steward Review] DS -->|Corrected| DQ DQ -->|Validated time-series| HIS[(Historian)] DQ -->|All data| LAKE[(OSDU Data Lake)] LAKE --> GEO[Geoscience Apps] HIS --> ENG[Engineering Apps]
Related templates
SCADA Pipeline Monitoring Network
The operational network behind a pipeline SCADA system: field RTUs at pump and valve stations, the control centre, and a firewalled link to the business network.
Permit-to-Work Lifecycle
The safety permit that controls hazardous work at a refinery or rig: request, risk assessment, isolation, gas testing, work and handback.
Upstream Digital Oilfield Architecture
A digital oilfield platform: wellsite sensors and SCADA, a production data historian, and engineering applications for surveillance and optimisation.
Refinery Process Flow
A simplified crude oil refinery: desalting, distillation, conversion units and blending into finished fuels.
Compressor Predictive Maintenance
How a gas compressor station predicts failures: vibration and process data, an ML model, and maintenance work orders before a trip happens.
Pipeline Leak Detection Alert
What happens when a pipeline leak detection system spots a possible leak: confirmation, valve closure, field response and regulator notification.