Changes for page h. Test SFT1: System baseline test
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 2.4
edited by Rosa Van Tuijn
on 2026/03/24 16:16
on 2026/03/24 16:16
Change comment:
There is no comment for this version
To version 1.20
edited by Tjalling Haije
on 2026/03/24 09:20
on 2026/03/24 09:20
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. RosaVanTuijn1 +XWiki.TjallingHaije - Content
-
... ... @@ -106,76 +106,9 @@ 106 106 107 107 **9. Measurements** 108 108 109 -See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] .Compare outcomes between the two conditions teams if applicable.109 +See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 110 110 111 -|**Claim: Safety**|**Measurment(s)**|**How to test ** 112 -|Safer decision before entry|Safe path chosen|((( 113 -* Define ground-truth safe path(s) beforehand so that they can be compared to chosen entry path during the trial 114 -* Score paths beforehand: safe/ suboptimal/ unsafe 115 -))) 116 -|Better decision overall|"How good were you decisions looking back?"|((( 117 -* Hotwash reflection question (likert + open) 118 -* Observations of errors (e.g. near-incidents, unsafe choices) 119 -))) 120 -|Fewer dangerous situations|Near-incident reports|((( 121 -* Define hazards in buildings beforehand and check (with observations of during hotwash) if these hazards are avoided or not 122 -))) 123 123 124 -|**Claim: Efficiency**|**Measurment(s)**|**How to test ** 125 -|Faster mission execution|Total mission completion time|((( 126 -* Timestamp of start (after briefing) till all located victims have been extracted 127 -))) 128 -|Faster inside performance|First responder time inside|((( 129 -* Timestamp of entry building till exist building (last located victim is exstracted) 130 -))) 131 - 132 -|**Claim: Situation Awareness**|**Measurment(s)**|**How to test ** 133 -|Before entry |((( 134 -Correctness of reported hazards, victims, layout 135 -)))|((( 136 -* Before entry let squad leader and entry team (seperatly) sketch/map or describe inside of building (harzards, victims, layout) > compare these with the ground-truth 137 - 138 -((( 139 - 140 -))) 141 -))) 142 -|During entry|((( 143 -FR path logs 144 -)))|((( 145 -* Compare plannend vs. executed path (how many or how big were the deviations? and were they acceptable?) and identify detours caused by misjudgment or new information 146 - 147 -((( 148 - 149 -))) 150 -))) 151 -|After mission|((( 152 -Correctness of reported hazards, victims, layout 153 -)))|((( 154 -* Repeat sketching/mapping or descriptive task and compare the outcomes (improvement/ deterioration vs pre-entry) 155 -))) 156 - 157 -|**Claim: Health**|**Measurment(s)**|**How to test ** 158 -|((( 159 -Health remains acceptable 160 -)))|((( 161 - 162 - 163 -Health indicators 164 -)))|((( 165 -* Define acceptable ranges (e.g. HR, temperature, etc.) beforehand and log these parapeter ranges 166 -))) 167 -|((( 168 -Issues handled in time 169 -)))|((( 170 - 171 - 172 -Health issues tackled in acceptable time 173 -)))|((( 174 -* Log when 175 -))) 176 - 177 - 178 - 179 179 **10. Procedure (Step-by-Step)** 180 180 181 181 1. __Team preparation__: ... ... @@ -197,11 +197,11 @@ 197 197 111. Time for tackling any health alerts 198 198 111. Track FR path 199 199 1. __Hotwash__: 200 -11. Questions (specified per role , couple questions per topic) on:133 +11. Questions (specified per role) on: 201 201 111. Near-incident report 202 202 111. Path inside 203 203 111. FR location and status of hazards, victims, and layout 204 -111. Mission effectiveness :e.g.self reportedeffectivenessof decisions137 +111. Mission effectiveness ? Decision Making effectiveness? 205 205 111. Self-reported workload 206 206 111. Trust survey 207 207 11. Group discussion with feedback ... ... @@ -210,20 +210,20 @@ 210 210 211 211 * Team preparation: Day before. 1 hour. 212 212 * Trial 1: 213 -** Setup s cenario: Test day 1. 09:00 - 09:30146 +** Setup usecase: Test day 1. 09:00 - 09:30 214 214 ** Setup tech and perform checks: Test day 1. 09:00 - 09:30 215 215 ** Briefing of each team individually (outside building): Test day 1: 09:00 - 09:30 216 216 ** Mission execution: Test day 1. 09:30 - 10:30 217 217 ** Hot wash: Test day 1. 10:30-11:00 218 -** Scenarioreset: test day 1. 10:30-11:00151 +** Usecase reset: test day 1. 10:30-11:00 219 219 * Teams switch location: Test day 1. 11:00-11:15 220 220 * Trial 2: 221 -** (Setup scenario: Test day 1. 12:30 - 13:00)154 +** Setup usecase: Test day 1. 12:30 - 13:00 222 222 ** Setup tech and perform checks: Test day 1. 12:30 - 13:00 223 223 ** Briefing of each team individually (outside building): Test day 1: 12:30 - 13:00 224 224 ** Mission execution: Test day 1. 13:00 - 14:00 225 225 ** Hot wash: Test day 1. 14:00-14:30 226 -* Cleanup area and store tech. 14:00-14:30 159 +** Cleanup area and store tech. 14:00-14:30 227 227 228 228 229 229