Calculator D4

ROC Commissioning & Validation Protocol (FAT/SAT)

A step-by-step engineering checklist to prove a Remote Operations Center (ROC) is built right and works reliably before it starts controlling real mine sites.

Typical Scale
ROC manages 3–12 mine sites, 5,000–50,000 real-time tags, and 200+ concurrent video streams
Key Standards
ISA-18.2, IEC 62443-3-3, ISO 11064-5/6, MSHA PH19-V-1
Certification Timeline
FAT: 2–4 weeks; SAT: 6–10 weeks including shift-based endurance testing

⚠️ Why It Matters

1
Inadequate alarm prioritization
2
Operator cognitive overload during cascading failures
3
Delayed intervention at remote mine site
4
Uncontained equipment damage or safety incident
5
Regulatory non-compliance and operational shutdown

📘 Definition

The ROC Commissioning & Validation Protocol is a formalized, traceable engineering process for verifying that the hardware, software, human–machine interfaces, communications infrastructure, cybersecurity controls, and operational procedures of a centralized Remote Operations Center meet functional, safety, resilience, and regulatory requirements. It comprises Factory Acceptance Testing (FAT) — conducted at the vendor site under simulated load — and Site Acceptance Testing (SAT) — executed in situ with integrated mine-site telemetry, control loops, and shift-based operational teams. The protocol ensures deterministic response times, failover integrity, alarm fidelity, and human factors compliance across concurrent multi-site supervision.

🎨 Concept Diagram

ROC CoreMine Site AMine Site BFAT: Verified in factorySAT: Validated on-siteLatencyFailoverAlarms

AI-generated illustration for visual understanding

💡 Engineering Insight

Never conflate 'system uptime' with 'operational readiness.' A ROC can be 99.99% available yet fail SAT because its alarm suppression logic misclassifies a critical bearing temperature spike as 'low priority' due to incorrect context-aware filtering rules — a flaw only exposed during multi-shift, multi-scenario SAT. Always validate not just *what* the system does, but *how reliably the human operator can interpret and act on it* under fatigue, distraction, and degraded comms.

📖 Detailed Explanation

ROC Commissioning begins with rigorous traceability: each functional requirement — such as 'alarm acknowledgment must persist across ROC failover' — is assigned a unique ID, mapped to test scripts, and linked to evidence artifacts (e.g., Wireshark captures, video recordings, log timestamps). This ensures auditability and prevents scope creep during FAT execution.

At the SAT stage, realism replaces simulation. Testing occurs under actual network conditions — including satellite backhaul legs, legacy radio telemetry links, and intermittent 4G/LTE handovers — while operators work live shifts. Metrics like 'mean time to first correct action (MTFCA)' replace binary pass/fail outcomes, capturing cognitive workload via keystroke dynamics and gaze fixation heatmaps.

Advanced validation includes digital twin-assisted anomaly injection: synthetic sensor faults (e.g., spoofed methane readings) are introduced into the ROC data stream while monitoring whether the system correctly isolates false positives, escalates to supervisors, and preserves historical context — validating not just detection logic but decision-support fidelity across layered automation (e.g., Level 2 DCS → Level 3 MES → Level 4 ROC).

🔄 Engineering Workflow

Step 1
Step 1: Traceability Matrix Development — Map every ROC functional requirement (from ISO/IEC 27001, MSHA, and client SOPs) to FAT/SAT test cases and acceptance criteria
Step 2
Step 2: FAT Execution — Conduct controlled black-box and white-box testing on full-scale ROC mockup: latency profiling, forced failover drills, alarm flood simulation, and role-based access penetration tests
Step 3
Step 3: Cybersecurity Hardening Audit — Validate firewall rule sets, certificate lifecycle management, and OT-specific patch compliance using Tenable.ot and ICS-CERT benchmarks
Step 4
Step 4: SAT Integration Testing — Connect ROC to live mine-site telemetry (via secure DMZ), execute 72-hour continuous operation with rotating shifts, and validate human–system interaction logs
Step 5
Step 5: Contingency Drills — Simulate WAN outage, primary site evacuation, and simultaneous multi-mine emergency (e.g., fire + ventilation loss) with independent third-party observer scoring
Step 6
Step 6: Operator Certification — Administer standardized ROC task performance assessments (per ISO 11064-6) with eye-tracking and cognitive load metrics
Step 7
Step 7: Handover & Baseline Lock — Archive FAT/SAT evidence package, sign off on ROC Configuration Baseline v1.0, and activate change control governance

📋 Decision Guide

Rock/Field Condition Recommended Design Action
Multi-site ROC managing >3 active mines with >2000 I/O points/site and <50 km fiber latency to nearest hub Deploy dual-redundant, geographically separated ROC cores with deterministic SD-WAN orchestration; require SAT verification of sub-200 ms inter-core sync for alarm correlation.
ROC integrating legacy mine-site DCS via serial-to-IP gateways without native OPC UA support Mandate FAT validation of gateway firmware version ≥ v4.2.1 with timestamped buffering; enforce SAT packet-loss tolerance testing at 0.8% BER over 72-hour stress window.
ROC supporting autonomous haul truck fleet coordination (AHS) with real-time path replanning Validate SAT end-to-end latency ≤ 320 ms at 99.99th percentile; require dynamic bandwidth reservation (QoS class EF) verified via RFC 2544 throughput/burst tests.

📊 Key Properties & Parameters

End-to-End Control Latency

120–450 ms (FAT), ≤ 650 ms (SAT under worst-case WAN conditions)

Maximum time elapsed from field sensor event (e.g., conveyor stop) to actionable visual/audio alert on ROC operator console, including network transit, processing, and UI rendering.

⚡ Engineering Impact:

Exceeding 650 ms violates ISO 11064-5 human response thresholds and degrades closed-loop control fidelity for critical assets like hoists or SAG mills.

Failover Recovery Time

≤ 8 seconds (FAT), ≤ 15 seconds (SAT with geodiverse backup site)

Time required for primary ROC control systems to fully restore all active supervisory functions—including video streaming, SCADA alarms, and PLC command channels—after deliberate failure of primary servers or network paths.

⚡ Engineering Impact:

Recovery >15 s breaches IEC 62443-3-3 SL2 availability requirements and risks loss of situational awareness during transient faults.

Alarm Flood Threshold

12–18 alarms/min/operator (aligned with ISA-18.2 Annex B human attention limits)

Maximum number of new, unacknowledged alarms per operator station per minute before automated suppression, grouping, or escalation triggers.

⚡ Engineering Impact:

Failure to enforce this threshold causes alarm fatigue, missed priority events, and violates MSHA Part 46/47 training validation criteria for ROC personnel.

Cybersecurity Posture Score

≥ 92 (FAT), ≥ 88 (SAT post-patch cycle)

Quantitative score (0–100) derived from automated scanning of ROC OT/IT boundary devices against NIST SP 800-82 Rev. 2 controls, weighted by criticality of exposed services.

⚡ Engineering Impact:

Scores < 85 indicate exploitable gaps in OPC UA firewall rules or unpatched HMIs—directly enabling lateral movement from corporate IT into mine-site PLC networks.

📐 Key Formulas

Mean Time to First Correct Action (MTFCA)

MTFCA = Σ(t_action_i − t_event_i) / N_events

Average operator response latency for validated correct interventions during SAT emergency drills

Variables:
Symbol Name Unit Description
MTFCA Mean Time to First Correct Action seconds Average operator response latency for validated correct interventions during SAT emergency drills
t_action_i Time of i-th Correct Action seconds Timestamp when the i-th correct action was taken
t_event_i Time of i-th Event Initiation seconds Timestamp when the i-th simulated event began
N_events Number of Events dimensionless Total count of validated events in the drill
Typical Ranges:
Non-critical alarm (e.g., belt misalignment)
8–22 s
Critical alarm (e.g., SAG mill bearing temp >115°C)
2.1–4.8 s
⚠️ ≤ 5.0 s for critical alarms per ISO 11064-6 Table C.2

ROC Resilience Index (RRI)

RRI = (1 − (T_recovery / T_max)) × (A_alarm_fidelity / 100) × (S_cyber_score / 100)

Composite metric quantifying ROC operational resilience across failover, alarm integrity, and cyber posture

Variables:
Symbol Name Unit Description
RRI ROC Resilience Index dimensionless Composite metric quantifying ROC operational resilience across failover, alarm integrity, and cyber posture
T_recovery Recovery Time time Time taken for system to recover operational capability after disruption
T_max Maximum Allowable Recovery Time time Upper time threshold for acceptable recovery
A_alarm_fidelity Alarm Fidelity % Percentage measure of accuracy and reliability of alarm system (e.g., true positive rate minus false alarm rate)
S_cyber_score Cyber Posture Score % Quantitative assessment of cybersecurity readiness and compliance
Typical Ranges:
Pre-FAT baseline
0.45–0.62
Post-SAT certified ROC
0.83–0.94
⚠️ ≥ 0.80 required for MSHA/DMR operational approval

🏭 Engineering Example

Rio Tinto Koodaideri Phase 1 (Western Australia)

Not applicable — ROC-focused system validation
Alarm Flood Threshold
15.2 alarms/min/operator (validated)
Failover Recovery Time
11.3 s (geodiverse SAT)
End-to-End Control Latency
294 ms (99.9th %ile)
Cybersecurity Posture Score
90.7 (post-SAT patch cycle)

🏗️ Applications

  • Centralized supervision of autonomous haul fleets across 5+ remote iron ore mines
  • Cross-site power & water resource optimization for regional mining clusters
  • Regulatory-compliant remote oversight of tailings storage facilities (TSFs)

📋 Real Project Case

Iron Ore Mine ROC Consolidation in Western Australia

Rio Tinto’s Pilbara ROC consolidation across 8 open pit sites

Challenge: Fragmented legacy SCADA systems with inconsistent alarm protocols and manual handovers
Iron Ore Mine ROC Consolidation Western Australia • IIoT Platform Integration Legacy SCADA (Fragmented) A B C • Inconsistent alarm protocols • Manual handovers (avg 22 min) Unified IIoT Platform OPC UA Standardized Interfaces ISA-18.2 Alarm Management ROC Output Alarm Flood ↓ 82% (Pre−Post ROC) Handover Time ↓ 18 min (per shift)
Read full case study →

🎨 Technical Diagrams

FAT: Factory Acceptance TestingSAT: Site Acceptance TestingTraceability Bridge
ROC CoreMine AMine BWAN Failover Path

📚 References