j. SFT1 evaluation templates

Version 9.3 by Rosa Van Tuijn on 2026/04/15 12:17

General

Baseline phases	Who fills it	Main purpose
Briefing	-	-
Estimate building integrity	-	-
Shoring	Particpants	(make estimation about shoring time)
Before sending in FRs (DM)	Participant	Ground truth/ baseline SA
Send in FRs, identify voids, DM	Evaluation leader	Objective performance, safety, timing, decision making
FRs exit building	Participant	Subjective SA, trust, workload, decision making
Hotwash

SYNERGISE phases	Who fills it	Main purpose
Briefing	-	-
Estimate building integrity	-	-
Send in robots, identify voids with robots	-	-
Decision Making (DM)	Participants (Squad/ team leader)	Ground truth/ baseline SA
Send in FRs ?	Evaluation leader	Objective performance, safety, timing, decision making
After test	Paricipant	Subjective SA, trust, workload, decision making
Hotwash

List of ground truths needed for comparison:

Role	What needs to be filled in it	Main purpose
Base of Operations	Initial situation awareness (layout building and hazards)	SA comparison
Squad/ Team leader	Initial situation awareness (layout building and hazards)	SA comparison
Robot operator	Initial situation awareness (layout building and hazards)	SA comparison
Robot analyst	Initial situation awareness (layout building and hazards)	SA comparison
Entry team	Initial situation awareness (layout building and hazards)	SA comparison
Evaluation leader (BoO)	Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness**	-
Evaluation leader (Field; indoor exploration)	Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness**	-
Evaluation leader (Field: ...)	-	-

Participant/ scenario information (evaluation leader)*

Role:

Trial type/ Building/ scenario:

Date/ Time:

System & mission readiness (evaluation leader)**

(Tick list based on predefined acceptable ranges. Cross out if not applicable.)

☐ C3I operational, describe:

☐ Health & location sensors connected, describe:

☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe:

☐ OWL operational, describe:

☐ ANYmal operational, describe:

☐ ANYmal with robot arm operational, describe:

☐ ANYmal with SNAKE, describe:

Role	What needs to be filled in it	Main purpose
Base of Operations
Squad/ Team leader
Robot operator
Robot analyst
Entry team
Evaluation leader (BoO)	Threshold breached, alert and intervention record*
Evaluation leader (Field; indoor exploration)	Safety observation Path deviations observed* Safety observations***
Evaluation leader (Field: ...)	-	-

Threshold breached, alert and intervention record (evaluation leader)*

Health threshold breached (timestamp + action taken)

Alert detection by system (timestamp + action taken)

Intervention started (timestamp + action taken)

Safety observations (evaluation leader)**

☐ No unsafe situations observed
☐ Unsafe / near‑incident observed → describe:

Path deviations observed***

(Check if the entry team takes the route that is discussed before entering)

☐ None ☐ Minor ☐ Major

Safety observations****