j. SFT1 evaluation templates
General

| Baseline phases | Who fills it | Main purpose |
| Briefing | - | - |
| Estimate building integrity | - | - |
| Shoring | Particpants | (make estimation about shoring time) |
| Before sending in FRs (DM) | Participant | Ground truth/ baseline SA |
| Send in FRs, identify voids, DM | Evaluation leader | Objective performance, safety, timing, decision making |
| FRs exit building | Participant | Subjective SA, trust, workload, decision making |
| Hotwash |
| SYNERGISE phases | Who fills it | Main purpose |
| Briefing | - | - |
| Estimate building integrity | - | - |
| Send in robots, identify voids with robots | - | - |
| Decision Making (DM) | Participants (Squad/ team leader) | Ground truth/ baseline SA |
| Send in FRs ? | Evaluation leader | Objective performance, safety, timing, decision making |
| After test | Paricipant | Subjective SA, trust, workload, decision making |
| Hotwash |
List of ground truths needed for comparison:
- Health ranges
- hazards/ victims in buildings
- Safest path within buildings
- State of automation (tech question)
Before
| Role | What needs to be filled in it | Main purpose |
| Base of Operations | Initial situation awareness (layout building and hazards) | SA comparison |
| Squad/ Team leader | Initial situation awareness (layout building and hazards) | SA comparison |
| Robot operator | Initial situation awareness (layout building and hazards) | SA comparison |
| Robot analyst | Initial situation awareness (layout building and hazards) | SA comparison |
| Entry team | Initial situation awareness (layout building and hazards) | SA comparison |
| Evaluation leader (BoO) | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness** | - |
| Evaluation leader (Field; indoor exploration) | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness** | - |
| Evaluation leader (Field: ...) | - | - |
During
| Role | What needs to be filled in it | Main purpose |
| Base of Operations | ||
| Squad/ Team leader | ||
| Robot operator | ||
| Robot analyst | ||
| Entry team | ||
| Evaluation leader (BoO) | Threshold breached, alert and intervention record* | |
| Evaluation leader (Field; indoor exploration) | Safety observation** Path deviations observed*** Safety observations*** | |
| Evaluation leader (Field: ...) | - | - |
Safety observations (evaluation leader)**
☐ No unsafe situations observed
☐ Unsafe / near‑incident observed → describe:
Path deviations observed***
(Check if the entry team takes the route that is discussed before entering)
☐ None ☐ Minor ☐ Major
Safety observations****
After
Template: Base of Operations (BoO/ HQ)
Template: Evaluation leader (BoO/ HQ)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)
Template: Evaluation leader (Field) | |
General: Participants roles (encircle): BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team | Trial type/ Building/ scenario: ............................................ | Date/ Time: .......................................... | |
System & mission readiness (Tick list based on predefined acceptable ranges. Cross out if not applicable.) | ☐ C3I operational, describe: ................................................................................................................................... ☐ Health & location sensors connected, describe: ................................................................................................. ☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe: ................................................. ☐ OWL operational, describe: ................................................................................................................................. ☐ ANYmal operational, describe: ............................................................................................................................ ☐ ANYmal with robot arm operational, describe: .................................................................................................... ☐ ANYmal with SNAKE, describe: .......................................................................................................................... |
| During | |
Threshold breached, alert and intervention record | Health threshold breached (timestamp + action taken) Alert detection by system (timestamp + action taken) Intervention started (timestamp + action taken) |
Template: Squad/ Team leader (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them. Predict victims, triage.
(Sketch space)
Template: Robot operator (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)
Template: Robot analyst (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)
Template: Entry team (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)