Skip to Content
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 6.1
edited by Rosa Van Tuijn
on 2026/04/13 12:47
Change comment: There is no comment for this version
To version 2.1
edited by Rosa Van Tuijn
on 2026/03/24 15:44
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -106,9 +106,9 @@
106 106  
107 107  **9. Measurements**
108 108  
109 -See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]]. Compare outcomes between the two conditions teams if applicable. See [[j. SFT1 evaluation templates >>3\. Evaluation.g\. Prototype .WebHome]] for more details about the measurements during a test.
109 +See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]]
110 110  
111 -|**Claim: Safety [CL01]**|**Measurment(s)**|**How to test **
111 +|**Claim: Saftey**|**Measurment(s)**|**How to test **
112 112  |Safer decision before entry|Safe path chosen|(((
113 113  * Define ground-truth safe path(s) beforehand so that they can be compared to chosen entry path during the trial
114 114  * Score paths beforehand: safe/ suboptimal/ unsafe
... ... @@ -115,96 +115,12 @@
115 115  )))
116 116  |Better decision overall|"How good were you decisions looking back?"|(((
117 117  * Hotwash reflection question (likert + open)
118 -* Observations of errors (e.g. near-incidents, unsafe choices)
119 -)))
120 -|Fewer dangerous situations|Near-incident reports|(((
121 -* Define hazards in buildings beforehand and check (with observations of during hotwash) if these hazards are avoided or not
122 -)))
123 -
124 -|**Claim: Situation Awareness [CL02]**|**Measurment(s)**|**How to test **
125 -|Before entry |(((
126 -Correctness of reported hazards, victims, layout
127 -)))|(((
128 -* Before entry let squad leader and entry team (seperatly) sketch/map or describe inside of building (harzards, victims, layout) > compare these with the ground-truth
129 -
130 -(((
131 -
132 -)))
133 -)))
134 -|During entry|(((
135 -FR path logs
136 -)))|(((
137 -* Compare plannend vs. executed path (how many or how big were the deviations? and were they acceptable?) and identify detours caused by misjudgment or new information
138 -
139 -(((
140 -
141 -)))
142 -)))
143 -|After mission|(((
144 -Correctness of reported hazards, victims, layout
145 -)))|(((
146 -* Repeat sketching/mapping or descriptive task and compare the outcomes (improvement/ deterioration vs pre-entry)
147 -)))
148 -
149 -|**Claim: Mission effectiveness [CL03] [CL04] [CL05]**|**Measurment(s)**|**How to test **
150 -|(((
151 -Acceptable workload
152 -)))|(((
153 -
154 -
155 -NASA-TLX
156 -)))|(((
157 -* Shortened post-trial NASA-TLX questionnaire and analyze score (discuss if these with experts to check if these are "acceptable")
158 -
159 -(((
160 -
161 -)))
162 -)))
163 -|(((
164 -Appropriate trust
165 -)))|(((
166 -
167 -
168 -Trust survey / interviews
169 -)))|(((
170 170  *
171 171  )))
172 -|(((
173 -Decision confidence
174 -)))|(((
175 -
120 +| | |
176 176  
177 -Retrospective decision quality rating
178 -)))|
179 179  
180 -|**Claim: Health [CL06]**|**Measurment(s)**|**How to test **
181 -|(((
182 -Health remains acceptable
183 -)))|(((
184 -
185 185  
186 -Health indicators
187 -)))|(((
188 -* Define acceptable ranges (e.g. HR, temperature, etc.) beforehand and log these ranges
189 -)))
190 -|(((
191 -Issues handled in time
192 -)))|(((
193 -
194 -
195 -Health issues tackled in acceptable time
196 -)))|(((
197 -* Timestamp when acceptable ranges are breached till moment detection and intervention moment (compare this with predefined response thresholds)
198 -)))
199 -
200 -|**Claim: Mission Efficiency [CL07]**|**Measurment(s)**|**How to test **
201 -|Faster mission execution|Total mission completion time|(((
202 -* Timestamp of start (after briefing) till all located victims have been extracted
203 -)))
204 -|Faster inside performance|First responder time inside|(((
205 -* Timestamp of entry building till exist building (last located victim is exstracted)
206 -)))
207 -
208 208  **10. Procedure (Step-by-Step)**
209 209  
210 210  1. __Team preparation__: