Changes for page h. Test SFT1: System baseline test
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 6.1
edited by Rosa Van Tuijn
on 2026/04/13 12:47
on 2026/04/13 12:47
Change comment:
There is no comment for this version
To version 2.3
edited by Rosa Van Tuijn
on 2026/03/24 16:12
on 2026/03/24 16:12
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -106,9 +106,9 @@ 106 106 107 107 **9. Measurements** 108 108 109 -See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]]. Compare outcomes between the two conditions teams if applicable. See [[j. SFT1 evaluation templates >>3\. Evaluation.g\. Prototype .WebHome]] for more details about the measurements during a test.109 +See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]]. Compare outcomes between the two conditions teams if applicable. 110 110 111 -|**Claim: Safety [CL01]**|**Measurment(s)**|**How to test **111 +|**Claim: Safety**|**Measurment(s)**|**How to test ** 112 112 |Safer decision before entry|Safe path chosen|((( 113 113 * Define ground-truth safe path(s) beforehand so that they can be compared to chosen entry path during the trial 114 114 * Score paths beforehand: safe/ suboptimal/ unsafe ... ... @@ -121,7 +121,15 @@ 121 121 * Define hazards in buildings beforehand and check (with observations of during hotwash) if these hazards are avoided or not 122 122 ))) 123 123 124 -|**Claim: Situation Awareness [CL02]**|**Measurment(s)**|**How to test ** 124 +|**Claim: Efficiency**|**Measurment(s)**|**How to test ** 125 +|Faster mission execution|Total mission completion time|((( 126 +* Timestamp of start (after briefing) till all located victims have been extracted 127 +))) 128 +|Faster inside performance|First responder time inside|((( 129 +* Timestamp of entry building till exist building (last located victim is exstracted) 130 +))) 131 + 132 +|**Claim: Situation Awareness**|**Measurment(s)**|**How to test ** 125 125 |Before entry |((( 126 126 Correctness of reported hazards, victims, layout 127 127 )))|((( ... ... @@ -146,65 +146,23 @@ 146 146 * Repeat sketching/mapping or descriptive task and compare the outcomes (improvement/ deterioration vs pre-entry) 147 147 ))) 148 148 149 -|**Claim: Mission effectiveness [CL03] [CL04] [CL05]**|**Measurment(s)**|**How to test ** 150 -|((( 151 -Acceptable workload 152 -)))|((( 157 +|**Claim: Situation Awareness**|**Measurment(s)**|**How to test ** 158 +| |((( 153 153 154 - 155 -NASA-TLX 156 156 )))|((( 157 -* Shortened post-trial NASA-TLX questionnaire and analyze score (discuss if these with experts to check if these are "acceptable") 158 - 159 -((( 160 160 161 161 ))) 162 -))) 163 -|((( 164 -Appropriate trust 165 -)))|((( 163 +| |((( 166 166 167 - 168 -Trust survey / interviews 169 169 )))|((( 170 - *166 + 171 171 ))) 172 -|((( 173 -Decision confidence 174 -)))|((( 168 +| |((( 175 175 176 - 177 -Retrospective decision quality rating 178 178 )))| 179 179 180 -|**Claim: Health [CL06]**|**Measurment(s)**|**How to test ** 181 -|((( 182 -Health remains acceptable 183 -)))|((( 184 - 185 185 186 -Health indicators 187 -)))|((( 188 -* Define acceptable ranges (e.g. HR, temperature, etc.) beforehand and log these ranges 189 -))) 190 -|((( 191 -Issues handled in time 192 -)))|((( 193 - 194 194 195 -Health issues tackled in acceptable time 196 -)))|((( 197 -* Timestamp when acceptable ranges are breached till moment detection and intervention moment (compare this with predefined response thresholds) 198 -))) 199 - 200 -|**Claim: Mission Efficiency [CL07]**|**Measurment(s)**|**How to test ** 201 -|Faster mission execution|Total mission completion time|((( 202 -* Timestamp of start (after briefing) till all located victims have been extracted 203 -))) 204 -|Faster inside performance|First responder time inside|((( 205 -* Timestamp of entry building till exist building (last located victim is exstracted) 206 -))) 207 - 208 208 **10. Procedure (Step-by-Step)** 209 209 210 210 1. __Team preparation__: