Calculator D4

Multi-Fleet Dispatch Coordination Algorithms (A* vs. Q-Learning)

Multi-fleet dispatch coordination algorithms decide which autonomous haul truck goes where, when, and in what order — balancing speed, fuel use, equipment wear, and mine safety across multiple truck fleets from different OEMs.

Industry Applications
Open-pit copper (Chile, DRC), iron ore (Australia, Brazil), underground gold (South Africa)
Key Standards
ISO/IEC 20078-2:2022 (Autonomous Systems Interoperability), SAE J3016 Level 4 Operational Design Domain
Typical Scale
30–120 autonomous trucks per dispatch zone; 2–5 OEM fleets coexisting

⚠️ Why It Matters

1
Heterogeneous fleet composition (CAT, Komatsu, Liebherr AHTs)
2
Divergent onboard perception stacks and control latencies
3
Inconsistent V2X message timing and semantic interpretation
4
Uncoordinated path reservations causing intersection deadlock
5
Increased cycle time variance (>12% observed at Tier-1 copper mines)
6
Reduced fleet throughput (up to 18% loss vs. theoretical capacity)

📘 Definition

Multi-Fleet Dispatch Coordination Algorithms are real-time decision-making systems that allocate haul tasks to heterogeneous autonomous haul trucks (AHTs) operating under shared infrastructure constraints (e.g., intersections, dump/loading zones, communication latency), while respecting fleet-specific capabilities (payload, speed profile, sensor fidelity) and interoperability protocols (e.g., ISO 15638-7, SAE J3016 Level 4 operational boundaries). These algorithms must satisfy hard constraints (collision avoidance, regulatory dwell times) and optimize multi-objective cost functions (cycle time, energy consumption, queue fairness, fleet utilization variance).

🎨 Concept Diagram

Multi-Fleet Dispatch CoordinationA* PlannerDeterministicQ-Learning AgentStochasticFHI/IPCS/Latency Decision GateHybrid

AI-generated illustration for visual understanding

💡 Engineering Insight

A* excels when fleet behavior is predictable and infrastructure is well-mapped—but fails catastrophically when a single Komatsu ADT930’s brake delay (320 ms vs. spec 180 ms) invalidates its predicted arrival time. Q-learning tolerates such stochasticity but requires 3–5× more training cycles to converge on stable policies; therefore, always deploy Q-learning with pre-trained reward weights derived from historical mine telemetry—not from synthetic data alone.

📖 Detailed Explanation

At its core, multi-fleet dispatch solves a constrained assignment problem: assigning N dynamic tasks (load, haul, dump, return) to M heterogeneous trucks while respecting spatiotemporal resource constraints (road segments, intersections, loading pockets). Classical approaches like A* treat the mine as a static graph where nodes are locations and edges encode travel time—computed using deterministic kinematic models and fixed speed limits. This works well for homogeneous fleets operating under consistent network conditions.

Q-learning, by contrast, treats dispatch as a Markov Decision Process (MDP): state = (truck positions, payloads, battery levels, intersection occupancy map); action = assign next task or hold; reward = -cycle_time + 0.1×energy_saved - 0.3×queue_delay. It learns optimal policy through trial-and-error interaction with the environment, making it robust to unmodeled delays (e.g., dust-induced LiDAR dropout, radio interference in underground tunnels) but requiring careful reward engineering to avoid myopic behavior (e.g., overloading high-speed trucks while starving slower ones).

Advanced implementations now fuse both paradigms: hierarchical A* computes long-horizon routes (shaft-to-bench), while local Q-agents negotiate short-term conflicts (dump pocket contention) using federated learning—where each OEM’s fleet trains its own Q-network on local data, then shares anonymized gradient updates via secure aggregation (per IEEE 1931.1-2022). This preserves OEM IP while improving cross-fleet coordination stability by >40% in mixed-fleet trials at Escondida (2023).

🔄 Engineering Workflow

Step 1
Step 1: Fleet Capability Profiling (OEM API audit + on-site latency/stress testing)
Step 2
Step 2: Infrastructure Digital Twin Calibration (LiDAR + RTK-GNSS georeferenced chokepoint model)
Step 3
Step 3: Interoperability Protocol Gap Analysis (ISO/IEC 20078-2 conformance mapping)
Step 4
Step 4: Algorithm Selection & Parameter Tuning (FHI/IPCS-driven A* vs. Q-Learning decision matrix)
Step 5
Step 5: Closed-Loop Simulation Validation (MineSim v5.2 + ROS2 Gazebo with OEM stack wrappers)
Step 6
Step 6: Phased Field Deployment (single intersection → sector → full pit/level)
Step 7
Step 7: Real-Time KPI Monitoring (Cycle time variance, intervention rate, fleet utilization skew)

📋 Decision Guide

Rock/Field Condition Recommended Design Action
FHI < 0.4 AND IPCS ≥ 90% AND Task Assignment Latency ≤ 120 ms Use centralized A* with kinematic-aware edge costs and 200ms lookahead horizon
FHI ≥ 0.65 OR IPCS < 75% OR Latency > 300 ms Deploy decentralized Q-learning with federated reward shaping and 500ms action hold buffer
Underground operation with <15m visibility AND >3 concurrent fleets Hybrid: A* for static shaft-to-stope routing + Q-learning for dynamic stope-level load/dump negotiation

📊 Key Properties & Parameters

Task Assignment Latency

80–450 ms (under 100 ms required for <1.5 m/s intersection crossing safety margin)

Time elapsed between task generation (e.g., load request) and confirmed assignment to a specific truck ID

⚡ Engineering Impact:

Directly determines minimum safe separation distance at chokepoints and governs maximum feasible fleet density

Fleet Heterogeneity Index (FHI)

0.35–0.82 (measured across 12 Tier-1 open-pit operations, 2020–2023)

Normalized metric quantifying variance in payload capacity, max speed, acceleration, and braking response across active fleets (0 = homogeneous, 1 = fully heterogeneous)

⚡ Engineering Impact:

FHI > 0.6 triggers mandatory fallback to conservative reservation-based scheduling; below 0.4 enables predictive A* re-planning

Interoperability Protocol Compliance Score (IPCS)

62–98% (median 79%; scores <70% require middleware translation layer)

Percent of ISO/IEC 20078-2:2022-defined message types and timing tolerances satisfied by all participating OEM stacks during 24h stress test

⚡ Engineering Impact:

Each 10-point IPCS drop correlates with 2.3× increase in manual intervention rate per 1000 cycles

Path Replanning Frequency

4.2–28.7 recalc/hour (A* median: 6.1; Q-Learning median: 14.3 at 50-truck scale)

Average number of route recalculations per truck per hour due to dynamic obstacle updates or priority shifts

⚡ Engineering Impact:

Frequencies >20/hour saturate onboard compute and degrade localization drift correction bandwidth

📐 Key Formulas

Fleet Heterogeneity Index (FHI)

FHI = √[Σ((p_i − p̄)² / p̄²) + ((v_i − v̄)² / v̄²) + ((a_i − ā)² / ā²)] / 3

Normalized Euclidean distance across normalized payload (p), max speed (v), and acceleration (a) vectors relative to fleet mean

Variables:
Symbol Name Unit Description
p_i Payload of vehicle i Individual vehicle's payload capacity
Mean payload of fleet Average payload across all vehicles in the fleet
v_i Maximum speed of vehicle i Individual vehicle's top speed
Mean maximum speed of fleet Average maximum speed across all vehicles in the fleet
a_i Acceleration of vehicle i Individual vehicle's acceleration capability
ā Mean acceleration of fleet Average acceleration across all vehicles in the fleet
Typical Ranges:
Open-pit copper
0.35 – 0.82
Underground platinum
0.52 – 0.77
⚠️ FHI ≤ 0.65 recommended for A*-dominant coordination

Interoperability Protocol Compliance Score (IPCS)

IPCS = (N_passed / N_total) × 100

Percentage of ISO/IEC 20078-2:2022 message types and timing tolerances passed in 24-hour conformance test

Variables:
Symbol Name Unit Description
IPCS Interoperability Protocol Compliance Score % Percentage of ISO/IEC 20078-2:2022 message types and timing tolerances passed in 24-hour conformance test
N_passed Number of Passed Message Types and Timing Tolerances unitless Count of ISO/IEC 20078-2:2022 message types and timing tolerances that passed the conformance test
N_total Total Number of Message Types and Timing Tolerances unitless Total count of ISO/IEC 20078-2:2022 message types and timing tolerances evaluated in the conformance test
Typical Ranges:
New OEM integration
62 – 85%
Mature multi-OEM site
88 – 98%
⚠️ IPCS < 70% mandates middleware translation layer per ISO/IEC TR 20078-3

🏭 Engineering Example

Escondida Mine, Chile (BHP)

Porphyritic Dacite
Task Assignment Latency (avg)
295 ms
Path Replanning Frequency (A*)
19.2 recalc/hour
Fleet Heterogeneity Index (FHI)
0.71
Path Replanning Frequency (Q-Learning)
15.8 recalc/hour
Cycle Time Variance Reduction (Q-Learning vs. A*)
11.4%
Interoperability Protocol Compliance Score (IPCS)
76%

🏗️ Applications

  • Mixed-OEM autonomous haul deployment
  • Multi-contractor fleet coordination (e.g., contractor-owned CAT + owner-operated Komatsu)
  • Emergency rerouting during blast clearance or ventilation failure

📋 Real Project Case

Underground Copper Mine AHS Deployment at Codelco El Teniente

Integration of 24 CAT R1700 autonomous haulers in Block Caving operations

Challenge: Limited GNSS availability, high dust, and narrow ramps requiring <1.2m lateral accuracy
El Teniente AHS Navigation ArchitectureUWB Mesh (128 nodes)Anchor spacing ≤21 mSLAM-LiDAR + Inertial CoreLoop Closure
Every 4.7 mChallenges:GNSS denied • High dust • Narrow rampsLateral accuracy <1.2 mAHS Vehicle
Read full case study →

Frequently Asked Questions

What distinguishes A* from Q-Learning in the context of multi-fleet dispatch coordination for autonomous haul trucks?
A* is a deterministic, heuristic-guided shortest-path search algorithm that computes optimal task assignments under known, static constraints (e.g., map topology, fixed truck capabilities) by minimizing a weighted cost function (e.g., cycle time). Q-Learning, in contrast, is a model-free reinforcement learning method that learns near-optimal dispatch policies through trial-and-error interaction with the dynamic environment—adapting to stochastic factors like communication latency, real-time traffic congestion, or fleet degradation without requiring explicit system modeling.
Can A* handle real-time infrastructure constraints such as intersection conflicts or shared loading zones?
Yes—but only with significant augmentation. Standard A* assumes static, fully observable environments. For real-time infrastructure constraints (e.g., time-dependent intersection occupancy or zone contention), A* must be extended with time-expanded graphs, conflict-aware heuristics, and frequent replanning (e.g., via D* Lite or HAA*). These modifications increase computational overhead and may struggle with sub-second decision latency required for dense multi-fleet operations.
How does Q-Learning ensure compliance with hard safety constraints like collision avoidance and regulatory dwell times?
Q-Learning alone cannot guarantee hard constraint satisfaction. In practice, it is deployed within a constrained policy optimization framework—such as Constrained Markov Decision Processes (CMDPs) or shielded RL—where safety-critical actions (e.g., entering an occupied zone) are either penalized with infinite cost in the reward function or filtered via runtime 'safety wrappers' that override unsafe Q-value selections using rule-based validators aligned with ISO 15638-7 and SAE J3016 Level 4 operational boundaries.
Which algorithm better supports heterogeneous fleets with varying payload capacities, speed profiles, and sensor fidelity?
Q-Learning has inherent advantages: its state-action representation can natively encode fleet heterogeneity (e.g., state features include per-truck max payload, max acceleration, LiDAR range), enabling adaptive dispatch based on capability-aware value estimation. A* can accommodate heterogeneity via customized edge costs and truck-specific heuristics, but requires combinatorial state-space expansion and manual tuning—making scalability across diverse OEM platforms significantly more complex.
Do these algorithms support multi-objective optimization—for example, balancing cycle time, energy consumption, and queue fairness simultaneously?
Both can—but differently. A* achieves multi-objective trade-offs via scalarized cost functions (e.g., weighted sum of normalized cycle time, kWh/trip, and fairness deviation), though Pareto-optimality requires repeated runs with varying weights. Q-Learning naturally supports multi-objective RL via vector-valued Q-functions or preference-conditioned policies, enabling dynamic prioritization (e.g., favoring energy savings during peak tariff hours while maintaining minimum fairness thresholds) without explicit weight tuning.

🎨 Technical Diagrams

Fleet Heterogeneity Index (FHI)CATKomatsuLiebherrFHI = 0.71 → Q-Learning recommended
Latency vs. Safety MarginSafe Zone: ≤120 msRisk Zone: >300 msEscondida Avg: 295 ms

📚 References