Skip to Content
Version 26.1 by Rosa Van Tuijn on 2026/02/23 13:11
Show last authors
1 |=**Objective**|=[[OB01: Increase effectiveness through exploration, sensing and communication means>>path:#]]
2 [[OB04: Improve safety by providing overviews and warnings of environment conditions>>path:#]]
3 |=Description|=(((
4 Enable safe, data‑driven interior reconnaissance and victim triage **before** human entry, with continuous **FR health/location monitoring** informing decisions, rotations, and evacuation.
5 )))
6 |**TDP**|1a: Pattern: “Robots first, then humans.”, 2c: IDP "role-based, context-specific views",
7 |**IDP**|
8 |**Actors**|Team leader, Robot operator, Analyst, Safety officer (at HQ), Entry Team (FRs) (described at [[4. Personas & Problem Scenarios>>path:/bin/view/Main/sdf/4.%20Scenarios%20%26%20Personas/]] and [[Direct Stakeholders>>path:/bin/view/Main/sdf/Stakeholders/Direct/]])
9 |**Pre-Condition**|(((
10 * Structure is flagged as **unsafe for direct human entry**; sector/ worksite allocated.
11 * **ANYmal **is mission-ready (battery, controls, and payload checked).
12 * **FRs wearables** distributed, connected, and calibrated.
13 * **C3I is online**, role-based views are configurated (Operator/ Analyst/ Team leader/ Safety officer); **5G pods** are installed for connection.
14 )))
15 |**Post-Condition**|(((
16 *
17 * Health alerts handled; intervention performed if needed.
18 )))
19 |**Status**|Hazards marked and/or victims detected; team proceeds with increased safety.
20
21 === **Action Sequence** ===
22
23 ===== Deployment and Startup =====
24
25  a. **Squad leader** labels the target building as **robot exploration needed **(no human entry until internal reconnaissance is completed and reviewed).
26  b. **Robot operator** stages ANYmal at the safest entry point (door/window/breach) while the **robot operator** opens the robot control and the analyst opens the image analysis. 
27  c. **First responders** check and calibrate wearable sensors (health + localization); the squad leader confirms **team baseline status** are “green/ready” on the squad dashboard; **base of operations** sees the same status across all teams.
28  d. **Comms/network check**: verify stable uplink for robot video/LiDAR + wearable streams between worksite and base of operations; confirm fallback mode (degraded bandwidth / store-and-forward markers).
29
30 ===== Interior Exploration with robot =====
31
32  a. ANYmal enters via the safest viable opening; **robot operator** tele-operates for tight passages, stairs, and unstable thresholds.
33  b. ANYmal produces a live **3D map (LiDAR)** + video (and thermal if available); the **information analyst** interprets map + feeds for hazards, access constraints, and points of interest.
34  c. Feeds stream into **C3I**: analyst places structured markers (e.g., **blocked corridors, collapse risk, gas/smoke pockets, heat zones, viable routes, possible victims**) and flags confidence/uncertainty.
35
36 ===== Squad-Leader Decisionmaking =====
37
38  a. **Squad leader** reviews the updated interior picture on a tablet (route options + hazards + task-relevant markers) and **actively questions** the analyst/operator to resolve uncertainties (“Can we confirm that corridor is passable?”, “What’s the safest approach to that room?”).
39  b. Squad leader selects an **entry decision** (go / no-go / partial entry) and makes decisions regarding: entry team composition, route, objectives, time limits, and abort criteria. The location its labels are logged in C3I via standard forms and visible to base of operations.
40  c. **Base of operations** views the squad’s status in the context of **other teams** (parallel buildings/sectors) and may re-task assets (e.g., allocate another drone/robot, redirect a medical team, delay entry) based on overall operational priorities.
41
42 ===== Human Entry with Health + Location Tracking =====
43
44  a. First responders enter along the squad leader’s chosen route; wearables are used for **continuous tracking** (location + vitals) and display their status and location on squad leader dashboard.
45  b. Squad leader uses the live map + responder locations to **direct movement** (e.g., reroute around a newly identified hazard, assign room-clearing sequence, keep separation distances, enforce time-on-task).
46
47 ===== Remote Monitoring, Alerts, and Coordinated Escalation =====
48
49  a. **Base of operations** monitors the squads active in the operation; squad leader monitors his own team at higher level detail (individual vitals + track quality + last-known positions).
50  b. If a responder crosses a threshold (e.g., heart rate spike, heat stress indicator, immobility, rapid elevation change, loss of signal), an **alert** is generated simultaneously:
51   • Squad leader receives a **critical on-dashboard alert** tied to the responder’s last-known location + nearby hazards/egress routes.
52   • Base of operations receives the same alert in the multi-team view (for cross-team support decisions).
53  c. **Escalation policy (two-level response)**:
54   1) **Squad leader action**: immediate check-in (voice), buddy-check instruction, micro-reroute to nearest safe point / egress, or pause task.
55   2) **Base of operations action**: dispatch medical support / reallocate teams / request additional sensing (robot reposition, drone overwatch), and initiate comms contingency if signal degradation persists.
56  d. If readings normalize, event is closed with a short note; if abnormal readings persist, the squad leader executes abort criteria (partial withdrawal / full extraction) while base coordinates site-level support and deconfliction with other teams.
57
58
59 == Open questions on technology capabilities ==
60
61 1. Anymal:
62 11. What sensors does the Anymal have? LiDAR, day-light camera, depth-camera, thermal camera, microphones, speakers, GPS?
63 11. How many of these sensors are available to the operator/analyst?
64 11. Is the operator UI connected with C3I?
65 11. Can the operator share information via the operator UI connected to C3I to the command center? If so, in what form? Photo with image and text? A short video? A livestream? Live location of the robot? 
66 11. Can the operator place a marker on the C3I map with a detection (e.g. hazard or victim)? Can information be attached to that marker? Can that marker be confirmed / prioritized / further specified with constraints (e.g. access constraints)?
67 11. Can the robot do object detection for finding victims? If so, how are results presented to the operator/analyst?
68 1. C3I:
69 11. What information can be logged in C3I on the teamleaders tablet? Can suggested routes and no-go zones also be specified?
70
71 == Open questions on user needs ==
72
73 1. HQ
74 11. At what level of detail do they require Situation Awareness? Does this differ per situation?
75 11. Does HQ communicate always via the teamlead, or also directly with the robot operator/analyst? As in, does the teamleader "confirm" new markers etc in C3I before they become visible to HQ?
76 11. In what way does HQ want to maintain SA? Markers on C3I map with text description, with image and description, only image with category, multiple images, short video, livestream, live 3D map, live thermal camera stream, audio recordings.
77 11. Does HQ need to know where the teammembers AND robots are currently?
78 11. What are the tasks of HQ?
79 11. How many teams typically are coordinated by HQ?
80 11. How much time does HQ have available for maintaining SA and communicating with the teamlead etc on this part of the mission?
81 1. Teamlead
82 11. At what level of detail does the teamlead require Situation Awareness? Which info do they need? Does this differ per situation?
83 11. In what way does teamlead want to maintain SA? Should they have enough info from inspecting the C3I map, do they require talking with the analyst, or do they require looking along to inspect the robot sensors?
84 11. Does the Teamlead need to know where the teammembers AND robots are currently?What other tasks does the teamlead have? How much time do they have available for maintaining SA on the mission / talking with the analyst / talking with HQ / making plans, etc.
85 11. How many teams does the teamlead have? Are they always close to the operator/analyst (shouting distance), or not?
86 11. How do the analyst and teamlead communicate? Via talking in person, or via radio?
87 11. What are the needs of the teamlead, given their tasks?
88 1. Operator/Analyst
89 11. What tasks does the Analyst have: analysing the robot sensor streams, instructing operator for where to go, updating the teamlead, updating the C3I interface, other tasks?
90 11. How does the Analyst communicate with others, via speech in person, via radio, via C3I?
91 11. What are the needs of the Analyst, given their tasks?
92 11. What are the tasks of the operator? Manage robot condition (battery, connectivity, damage)?
93 11. What are the needs from the operator, given their tasks?
94
95
96
97 (% class="box warningmessage" %)
98 (((
99 Table below need to be updated
100 )))
101
102 |=Claims (title)|=Function|=Effect(s)|=Action Sequence Step(s)
103 |CL1 Improve safety for responders|Robot enters unsafe or blocked zones|EFXX: Improves safety of responder by having robot explore unsafe or blocked zones instead 
104 → Measured with FR path logs or near-incident reports.|2a
105 |CL2 Improved FR SA |SNAKE camera visual confirmation|EFXX: Improves SA of FR by inspecting small spaces 
106 → Measure with NASA TLX? |4b
107 |CL2 Improved victim detection rate in small spaces|SNAKE camera visual confirmation|EFXX: Victim discovery rate increased
108 → Measured with number of victims detected & time to victim detection, compared to manual entry.|2b, 2c
109 |CL3 Safer responder routing|Hazard identification via robot|EFXX: First responder safety increased
110 → Measured with map updates and avoided hazards.|2c, 3a
111 |CL4 Trustworthy SA|Operator-validated visuals|EFXX: Trust in robot findings increased by operator confirmation
112 → Measured with trust survey or follow-up interviews.|4a
113 |CL5 Operational speed improved|Robot scouts ahead of team|EFXX: Operational speed improved
114 → Measured with time-per-room metrics.|2a, 3c