Changes for page h. Test SFT1: System baseline test
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 3.2
edited by Rosa Van Tuijn
on 2026/03/25 14:29
on 2026/03/25 14:29
Change comment:
There is no comment for this version
To version 2.2
edited by Rosa Van Tuijn
on 2026/03/24 16:00
on 2026/03/24 16:00
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -108,7 +108,7 @@ 108 108 109 109 See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]]. Compare outcomes between the two conditions teams if applicable. 110 110 111 -|**Claim: Safety [CL01]**|**Measurment(s)**|**How to test **111 +|**Claim: Safety**|**Measurment(s)**|**How to test ** 112 112 |Safer decision before entry|Safe path chosen|((( 113 113 * Define ground-truth safe path(s) beforehand so that they can be compared to chosen entry path during the trial 114 114 * Score paths beforehand: safe/ suboptimal/ unsafe ... ... @@ -121,90 +121,31 @@ 121 121 * Define hazards in buildings beforehand and check (with observations of during hotwash) if these hazards are avoided or not 122 122 ))) 123 123 124 -|**Claim: Situation Awareness [CL02]**|**Measurment(s)**|**How to test ** 124 +|**Claim: Efficiency**|**Measurment(s)**|**How to test ** 125 +|Faster mission execution|Total mission completion time|((( 126 +* Timestamp of start (after briefing) till all located victims have been extracted 127 +))) 128 +|Faster inside performance|First responder time inside|((( 129 +* Timestamp of entry building till exist building (last located victim is exstracted) 130 +))) 131 + 132 +|**Claim: Situation Awareness**|**Measurment(s)**|**How to test ** 125 125 |Before entry |((( 126 126 Correctness of reported hazards, victims, layout 127 127 )))|((( 128 -* Before entry let squad leader and entry team (seperatly) sketch/map or describe inside of building (harzards, victims, layout) > compare these with the ground-truth 129 - 130 -((( 131 131 132 132 ))) 133 -))) 134 134 |During entry|((( 135 135 FR path logs 136 136 )))|((( 137 -* Compare plannend vs. executed path (how many or how big were the deviations? and were they acceptable?) and identify detours caused by misjudgment or new information 138 - 139 -((( 140 140 141 141 ))) 142 -))) 143 143 |After mission|((( 144 144 Correctness of reported hazards, victims, layout 145 -)))|((( 146 -* Repeat sketching/mapping or descriptive task and compare the outcomes (improvement/ deterioration vs pre-entry) 147 -))) 148 - 149 -|**Claim: Mission effectiveness [CL03] [CL04] [CL05]**|**Measurment(s)**|**How to test ** 150 -|((( 151 -Acceptable workload 152 -)))|((( 153 - 154 - 155 -NASA-TLX 156 -)))|((( 157 -* Shortened post-trial NASA-TLX questionnaire and analyze score (discuss if these with experts to check if these are "acceptable") 158 - 159 -((( 160 - 161 -))) 162 -))) 163 -|((( 164 -Appropriate trust 165 -)))|((( 166 - 167 - 168 -Trust survey / interviews 169 -)))|((( 170 -* 171 -))) 172 -|((( 173 -Decision confidence 174 -)))|((( 175 - 176 - 177 -Retrospective decision quality rating 178 178 )))| 179 179 180 -|**Claim: Health [CL06]**|**Measurment(s)**|**How to test ** 181 -|((( 182 -Health remains acceptable 183 -)))|((( 184 - 185 185 186 -Health indicators 187 -)))|((( 188 -* Define acceptable ranges (e.g. HR, temperature, etc.) beforehand and log these ranges 189 -))) 190 -|((( 191 -Issues handled in time 192 -)))|((( 193 - 194 194 195 -Health issues tackled in acceptable time 196 -)))|((( 197 -* Timestamp when acceptable ranges are breached till moment detection and intervention moment (compare this with predefined response thresholds) 198 -))) 199 - 200 -|**Claim: Mission Efficiency [CL07]**|**Measurment(s)**|**How to test ** 201 -|Faster mission execution|Total mission completion time|((( 202 -* Timestamp of start (after briefing) till all located victims have been extracted 203 -))) 204 -|Faster inside performance|First responder time inside|((( 205 -* Timestamp of entry building till exist building (last located victim is exstracted) 206 -))) 207 - 208 208 **10. Procedure (Step-by-Step)** 209 209 210 210 1. __Team preparation__: