Skip to Content

Wiki source code of j. SFT1 evaluation templates

Version 13.3 by Rosa Van Tuijn on 2026/04/15 13:09
Show last authors
1 = General =
2
3 [[image:1776255113603-367.png]]
4
5
6 |**Baseline phases**|**Who fills it**|**Main purpose**
7 |//Briefing//|-|-
8 |//Estimate building integrity//|-|-
9 |//Shoring//|Particpants|(make estimation about shoring time)
10 |//Before sending in FRs (DM)//|Participant|Ground truth/ baseline SA
11 |//Send in FRs, identify voids, DM//|Evaluation leader|Objective performance, safety, timing, decision making
12 |//FRs exit building//|Participant|Subjective SA, trust, workload, decision making
13 |//Hotwash//| |
14
15 |(% style="width:414px" %)**SYNERGISE phases**|(% style="width:245px" %)**Who fills it**|(% style="width:690px" %)**Main purpose**
16 |(% style="width:414px" %)//Briefing//|(% style="width:245px" %)-|(% style="width:690px" %)-
17 |(% style="width:414px" %)//Estimate building integrity//|(% style="width:245px" %)-|(% style="width:690px" %)-
18 |(% style="width:414px" %)//Send in robots, identify voids with robots//|(% style="width:245px" %)-|(% style="width:690px" %)-
19 |(% style="width:414px" %)//Decision Making (DM)//|(% style="width:245px" %)Participants (Squad/ team leader)|(% style="width:690px" %)Ground truth/ baseline SA
20 |(% style="width:414px" %)//Send in FRs ?//|(% style="width:245px" %)Evaluation leader|(% style="width:690px" %)Objective performance, safety, timing, decision making
21 |(% style="width:414px" %)//After test//|(% style="width:245px" %)Paricipant|(% style="width:690px" %)Subjective SA, trust, workload, decision making
22 |(% style="width:414px" %)//Hotwash//|(% style="width:245px" %) |(% style="width:690px" %)
23
24 (% class="wikigeneratedid" %)
25 List of ground truths needed for comparison:
26
27 * Health ranges
28 * hazards/ victims in buildings
29 * Safest path within buildings
30 * State of automation (tech question)
31
32
33
34 === Before ===
35
36 |**Role**|**What needs to be filled in it**|**Main purpose**
37 |//Base of Operations//|Initial situation awareness (layout building and hazards)|SA comparison
38 |//Squad/ Team leader//|Initial situation awareness (layout building and hazards)|SA comparison
39 |//Robot operator//|Initial situation awareness (layout building and hazards)|SA comparison
40 |//Robot analyst//|Initial situation awareness (layout building and hazards)|SA comparison
41 |//Entry team//|Initial situation awareness (layout building and hazards)|SA comparison
42 |//Evaluation leader (BoO)//|(((
43 Record: amount partipicpants, participant roles, type trial/ buidling, date/ time*
44
45 Record: System & mission readiness~*~*
46 )))|-
47 |//Evaluation leader (Field; indoor exploration)//|(((
48 Record: amount partipicpants, participant roles, type trial/ buidling, date/ time*
49
50 Record: System & mission readiness~*~*
51 )))|-
52 |//Evaluation leader (Field: ...)//|(((
53 -
54 )))|-
55
56
57
58 === During ===
59
60 |**Role**|**What needs to be filled in it**|**Main purpose**
61 |//Base of Operations//| |
62 |//Squad/ Team leader//| |
63 |//Robot operator//| |
64 |//Robot analyst//| |
65 |//Entry team//| |
66 |//Evaluation leader (BoO)//|(((
67 Threshold breached, alert and intervention record*
68 )))|
69 |//Evaluation leader (Field; indoor exploration)//|(((
70 Safety observation~*~*
71
72 Path deviations observed~*~**
73
74 Safety observations~*~**
75 )))|
76 |//Evaluation leader (Field: ...)//|-|-
77
78
79
80 === After ===
81
82
83 = Templates per role =
84
85
86 (% class="table-bordered" %)
87 |(% colspan="2" %)(((
88 == Template: Base of Operations LEMA (BoO/ HQ) ==
89 )))
90 |(% colspan="2" %)(((
91 **General: **
92
93
94 //Participants roles (encircle)//: BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team  |  //Trial type/ Building/ scenario//: ............................................  |  //Date/ Time//: ..........................................
95 )))
96 |(% style="width:296px" %)(((
97
98 )))|(% style="width:1053px" %)(((
99
100 )))
101
102 (% class="table-bordered" %)
103 |(% colspan="2" %)(((
104 == Template: Evaluation leader (Field) ==
105 )))
106 |(% colspan="2" %)**Before start scenario**
107 |(% colspan="2" %)(((
108 **General: **
109
110
111 //Participants roles (encircle)//: BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team  |  //Trial type/ Building/ scenario//: ............................................  |  //Date/ Time//: ..........................................
112 )))
113 |(% style="width:296px" %)(((
114 **System & mission readiness**
115
116 //(Tick list based on predefined acceptable ranges. Cross out if not applicable.)//
117 )))|(% style="width:1053px" %)(((
118 ☐ C3I operational, describe: .......................................................................................................................................................................................................................
119
120 ☐ Health & location sensors connected, describe: .....................................................................................................................................................................................
121
122 ☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe: .....................................................................................................................................
123
124 ☐ OWL operational, describe: .....................................................................................................................................................................................................................
125
126 ☐ ANYmal operational, describe: ................................................................................................................................................................................................................
127
128 ☐ ANYmal with robot arm operational, describe: ........................................................................................................................................................................................
129
130 ☐ ANYmal with SNAKE, describe: ..............................................................................................................................................................................................................
131 )))
132 |(% colspan="2" %)**During start scenario:**
133 |(% style="width:296px" %)**Let Team leader (and entry team?) sketch/ describe hazard, victims, layout**|(% style="width:1053px" %)(((
134 Notes:
135
136
137
138 )))
139 |(% style="width:296px" %)(((
140 **Threshold breached, alert and intervention record **
141 )))|(% style="width:1053px" %)(((
142 Health threshold breached (timestamp + action taken)
143
144 Alert detection by system (timestamp + action taken)
145
146 Intervention started (timestamp + action taken)
147 )))
148 |(% colspan="2" style="width:296px" %)**When humans enter a building/ hazard zone**
149 |(% style="width:296px" %)(((
150 **Time within building/ hazard zone**
151 )))|(% style="width:1053px" %)(((
152 Timestamp of entering:..................................................................................... | Timestamp of exiting:...........................................................................................................
153 )))
154 |(% style="width:296px" %)(((
155 **Safety observations **
156 )))|(% style="width:1053px" %)(((
157 ☐ No unsafe situations observed
158 ☐ Unsafe / near‑incident observed, describe (amount and type) :..................................................................................................................................................................
159
160 .........................................................................................................................................................................................................................................................................
161 )))
162 |(% style="width:296px" %)(((
163 **Path deviations observed**
164
165 //(Check if the entry team takes the route that is discussed before entering)//
166 )))|(% style="width:1053px" %)(((
167 ☐ None ☐ Minor ☐ Major
168
169 notes:
170 )))
171
172 (% class="table-bordered" %)
173 |(% colspan="2" %)(((
174 == Template: Squad/ Team leader (Field) ==
175 )))
176 |(% colspan="2" %)(((
177 **General: **
178
179
180 //Participants roles (encircle)//: BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team  |  //Trial type/ Building/ scenario//: ............................................  |  //Date/ Time//: ..........................................
181 )))
182 |(% style="width:296px" %)(((
183 **Pre-entry situation awareness sketch (participant)**
184
185 Sketch or describe //hazards, victims, layout// as you currently understand them. Predict victims, triage.
186 )))|(% style="width:1053px" %)(((
187 //(Sketch space)//
188
189
190
191
192
193 )))
194
195 == ==
196
197 == Template: Robot operator (Field) ==
198
199 **Pre-entry situation awareness sketch (participant)**
200
201 Sketch or describe //hazards, victims, layout// as you currently understand them.
202
203 //(Sketch space)//
204
205
206 == Template: Robot analyst (Field) ==
207
208 **Pre-entry situation awareness sketch (participant)**
209
210 Sketch or describe //hazards, victims, layout// as you currently understand them.
211
212 //(Sketch space)//
213
214
215 == Template: Entry team (Field) ==
216
217 **Pre-entry situation awareness sketch (participant)**
218
219 Sketch or describe //hazards, victims, layout// as you currently understand them.
220
221 //(Sketch space)//
222
223