Changes for page h. Test SFT1: System baseline test
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 1.17
edited by Tjalling Haije
on 2026/03/23 15:26
on 2026/03/23 15:26
Change comment:
There is no comment for this version
To version 1.7
edited by Tjalling Haije
on 2026/03/23 14:15
on 2026/03/23 14:15
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 -h. Test SFT1 : System baseline test1 +h. Test SFT1 - Content
-
... ... @@ -1,9 +1,9 @@ 1 1 **Experiment title** 2 -S ystembaseline test2 +[Short, descriptive title] 3 3 4 4 5 5 **2. Objective / Research Question** 6 -Do the SYNERGISE technologies together improve the SYNERGISE [[Objectives>>2\. Specification.Objectives.WebHome]] (stated below) without negative effects?6 +Do the SYNERGISE technologies together improve the below SYNERGISE [[Objectives>>2\. Specification.Objectives.WebHome]] without negative effects? 7 7 8 8 1. Mission effectiveness 9 9 1. Mission efficiency ... ... @@ -94,104 +94,59 @@ 94 94 95 95 Two buildings: 96 96 97 -* Building A: Easierlocation, obstacles and environmental conditions.(clearvisibility,..)98 -* Building B: Challenginglocation, obstacles and environmental conditionsforhumansand robots(e.g.smoke and obstacles).97 +* Building A: Challenging location, obstacles and environmental conditions for humans and robots (e.g. smoke and obstacles). 98 +* Building B: Easier location, obstacles and environmental conditions. (clear visibility, ..) 99 99 100 -Trial 1: 101 101 102 -* FR Team ROBOT does Building A 103 -* FR team HUMAN does Building B 104 104 105 -Trial 2:102 +Trial1: 106 106 107 -* FR Team ROBOT does Building B 108 -* FR team HUMAN does Building A 104 +* FR Team ROBOT does easy 109 109 106 +Team A does first [[UC04.3>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 110 110 108 +[Condition A vs B, baseline vs intervention, with/without transparency, etc.] 109 + 110 + 111 111 **9. Measurements** 112 112 113 -See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 113 +* Objective measures: [E.g., task completion time, errors, navigation metrics] 114 +* Subjective measures: [E.g., trust, workload, clarity, usability questionnaires] 115 +* Logs / sensors: [E.g., robot logs, video, physiological sensors] 114 114 115 115 116 116 **10. Procedure (Step-by-Step)** 117 117 118 -1. __Team preparation__: 119 -11. FR team ROBOT is trained in operating the robot, analysing the camera stream, and pinning information on C3I 120 -11. Squad leader and BoO are trained for both teams in interpreting the health and location sensor data. 121 -11. Experiment leader knows where hazards and victims are in both buildings. 122 -11. Anymal robot is tested with network in target buildings for experiment (without FR themselves seeing building!) 123 -1. __Experiment preparation:__ 124 -11. Building is prepped with victims, hazards, etc. 125 -1. __Briefing:__ 126 -11. Same for both teams for both building types: Building has been inspected from outside and is estimated safe for entry. Situation inside unknown. Victims possibly present. Goal: find, assess, and extract victims while avoiding and mapping hazards. 127 -11. One person is notified that their health sensor will be triggered during the Building B (difficult building) situation. 128 -1. __Execution:__ 129 -11. For FR team ROBOT, see: [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 130 -11. For FR team HUMAN, see: [[UC04.4: Detailed indoor exploration without ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYmal (USAR).WebHome]] 131 -11. During execution of both teams, performance will be measured by experiment leader: 132 -111. Mission completion time 133 -111. Health indicators stay within acceptable range 134 -111. Time for tackling any health alerts 135 -111. Track FR path 136 -1. __Hotwash__: 137 -11. Questions on: 138 -111. Near-incident report 139 -111. Path inside 140 -111. FR location and status of hazards, victims, and layout 141 -111. Mission effectiveness 142 -111. Self-reported workload 143 -111. Trust survey 120 +1. [Describe preparation] 121 +1. [Briefing] 122 +1. [Execution] 123 +1. [Debrief / Hotwash] 144 144 145 -**~11. Planning:** 146 146 147 -* Team preparation: Day before. 1 hour. 148 -* Trial 1: 149 -** Setup usecase: Test day 1. 09:00 - 09:30 150 -** Setup tech and perform checks: Test day 1. 09:00 - 09:30 151 -** Briefing of each team individually (outside building): Test day 1: 09:00 - 09:30 152 -** Mission execution: Test day 1. 09:30 - 10:30 153 -** Hot wash: Test day 1. 10:30-11:00 154 -** Usecase reset: test day 1. 10:30-11:00 155 -* Teams switch location: Test day 1. 11:00-11:15 156 -* Trial 2: 157 -** Setup usecase: Test day 1. 12:30 - 13:00 158 -** Setup tech and perform checks: Test day 1. 12:30 - 13:00 159 -** Briefing of each team individually (outside building): Test day 1: 12:30 - 13:00 160 -** Mission execution: Test day 1. 13:00 - 14:00 161 -** Hot wash: Test day 1. 14:00-14:30 162 -** Cleanup area and store tech. 14:00-14:30 126 +**~11. Materials / Setup Components** 127 +[List equipment, environment layout, props, simulation assets] 163 163 164 164 130 +**12. Safety & Ethical Considerations** 165 165 166 -**12. Materials** 132 +* Risks: [Describe] 133 +* Mitigations: [Describe] 134 +* Informed consent: [Yes/No + method] 135 +* Data handling: [Describe] 167 167 168 -* For FRs: 169 -** 1x Anymal with teleop setup and networking 170 -** 2x Tablet with C3I for squad leader (one spare) 171 -** 1x Base of Operations with computer with C3I 172 -** 4x Health sensors 173 -** 4x Location sensors 174 -** 8x walky talky with two channels (?) (for FR team and BoO). 175 -* For usecase: 176 -** 2x training building (~~100m2?) 177 -** Enviromental challenges: smoke machine, obstacles, etc. 178 -** ~~8x Actors or dummies for victims. 179 -* 8x Clipboards with papers and pens for hotwash and questionnaires 180 180 138 +**13. Location & Duration** 181 181 182 -**13. Dependencies** 140 +* Location: [Where does it take place?] 141 +* Duration: [Total time per run + preparation] 183 183 184 -* Availability of materials 185 -* Availability and functioning of ANYmal robot with teleoperation and network in target buildings 186 -* Availability of functioning network between robot, FRs, and BoO. 187 -* Availability of: 188 -** Experiment participants 189 -** People willing to play victim 190 -** Experiment leaders 191 191 144 +**14. Dependencies** 145 +[Other WPs, required assets, system availability, permissions] 192 192 193 -**14. Success Criteria** 194 -When mission(s) completed by both teams, and we can compare their performance using the metrics. 195 195 148 +**15. Success Criteria** 149 +[How do you know the experiment worked as intended?] 196 196 151 + 197 197