Changes for page h. Test SFT1: System baseline test
Last modified by Rosa Van Tuijn on 2026/04/13 12:47
From version 1.6
edited by Tjalling Haije
on 2026/03/23 13:57
on 2026/03/23 13:57
Change comment:
There is no comment for this version
To version 1.17
edited by Tjalling Haije
on 2026/03/23 15:26
on 2026/03/23 15:26
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 -h. Test SFT1 1 +h. Test SFT1: System baseline test - Content
-
... ... @@ -1,9 +1,9 @@ 1 1 **Experiment title** 2 - [Short, descriptive title]2 +System baseline test 3 3 4 4 5 5 **2. Objective / Research Question** 6 -Do the SYNERGISE technologies together improve the belowSYNERGISE [[Objectives>>2\. Specification.Objectives.WebHome]] without negative effects?6 +Do the SYNERGISE technologies together improve the SYNERGISE [[Objectives>>2\. Specification.Objectives.WebHome]] (stated below) without negative effects? 7 7 8 8 1. Mission effectiveness 9 9 1. Mission efficiency ... ... @@ -24,17 +24,25 @@ 24 24 25 25 26 26 **4. Scenario / Context** 27 -[Short description of the operational or simulated scenario in which the experiment runs] 28 - 27 +ASR3: Detailed indoor exploration 29 29 29 +Preconditions from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] : 30 + 31 +* Structure is flagged as (relatively?) **safe for direct human entry**; sector/ worksite allocated. 32 +* **FRs wearables** distributed, connected, and calibrated. 33 +* Specific to scenario with ANYmal: 34 +** **ANYmal **is mission-ready (battery, controls, and payload checked). 35 +** **C3I is online**, role-based views are configurated (Operator/ Analyst/ Team leader/ Safety officer); **5G pods** are installed for connection. 36 + 37 + 30 30 **5. Participants** 31 31 32 -* FR team 1:40 +* FR team ROBOT: 33 33 ** 1x Squad leaders 34 34 ** 1x Robot operator 35 35 ** 1x Robot analyst 36 36 ** 2x First responder 37 -* FR team 2:45 +* FR team HUMAN: 38 38 ** 1x Squad leaders 39 39 ** 2x First reponder 40 40 * Base of Operations: ... ... @@ -46,11 +46,35 @@ 46 46 47 47 **6. System(s) Under Test** 48 48 49 -* Hardware / robot / software: [Describe system(s)] 50 -* Version / configuration: [Describe] 51 -* Relevant capabilities and limitations: [Overview] 52 - 57 +|(% style="width:267px" %)Technology|(% style="width:1250px" %)Description 58 +|(% style="width:267px" %)ANYmal|(% style="width:1250px" %)((( 59 +* Robust mobility over uneven terrain (stairs, debris, slopes). 60 +* Multi-sensor payload (video, LIDAR, thermal??) 61 +* Reliable wireless communication/ connection in degraded environments. 62 +* Support for tele‑operation with clear operator feedback. 63 +* Link with C3I, such as adding victims as pin on map. 64 +* NO autonomy. 65 +))) 66 +|(% style="width:267px" %)C3I (BoO and tablet version)|(% style="width:1250px" %)((( 67 +* Interoperability with health and location sensors. 68 +* Robust operation under limited connectivity (sync when possible). 69 +* Usable tablet interface for field conditions (gloves, stress, time pressure). 70 +))) 71 +|(% style="width:267px" %)Health sensors|(% style="width:1250px" %)((( 72 +* Accurate and reliable physiological sensing (e.g. heart rate, exertion proxies). 73 +* Comfortable, non‑intrusive form factor suitable for long missions. 74 +* Secure wireless data transmission to C3I systems. 75 +* Real‑time alerting and trend monitoring. 76 +))) 77 +|(% style="width:267px" %)Location sensors|(% style="width:1250px" %)((( 78 +* Indoor and outdoor localisation capability. 79 +* Sufficient accuracy and update rate for safety‑critical use. 80 +* Integration with C3I and mapping systems. 81 +* Robustness to environmental interference (dust, debris, structures, height differences). 82 +))) 53 53 84 + 85 + 54 54 **7. Tasks** 55 55 56 56 [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] ... ... @@ -59,48 +59,107 @@ 59 59 60 60 61 61 **8. Experimental Conditions / Variants** 62 -[Condition A vs B, baseline vs intervention, with/without transparency, etc.] 63 63 95 +Two buildings: 64 64 97 +* Building A: Easier location, obstacles and environmental conditions. (clear visibility, ..) 98 +* Building B: Challenging location, obstacles and environmental conditions for humans and robots (e.g. smoke and obstacles). 99 + 100 +Trial 1: 101 + 102 +* FR Team ROBOT does Building A 103 +* FR team HUMAN does Building B 104 + 105 +Trial 2: 106 + 107 +* FR Team ROBOT does Building B 108 +* FR team HUMAN does Building A 109 + 110 + 65 65 **9. Measurements** 66 66 67 -* Objective measures: [E.g., task completion time, errors, navigation metrics] 68 -* Subjective measures: [E.g., trust, workload, clarity, usability questionnaires] 69 -* Logs / sensors: [E.g., robot logs, video, physiological sensors] 113 +See the measurements from [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 70 70 71 71 72 72 **10. Procedure (Step-by-Step)** 73 73 74 -1. [Describe preparation] 75 -1. [Briefing] 76 -1. [Execution] 77 -1. [Debrief / Hotwash] 118 +1. __Team preparation__: 119 +11. FR team ROBOT is trained in operating the robot, analysing the camera stream, and pinning information on C3I 120 +11. Squad leader and BoO are trained for both teams in interpreting the health and location sensor data. 121 +11. Experiment leader knows where hazards and victims are in both buildings. 122 +11. Anymal robot is tested with network in target buildings for experiment (without FR themselves seeing building!) 123 +1. __Experiment preparation:__ 124 +11. Building is prepped with victims, hazards, etc. 125 +1. __Briefing:__ 126 +11. Same for both teams for both building types: Building has been inspected from outside and is estimated safe for entry. Situation inside unknown. Victims possibly present. Goal: find, assess, and extract victims while avoiding and mapping hazards. 127 +11. One person is notified that their health sensor will be triggered during the Building B (difficult building) situation. 128 +1. __Execution:__ 129 +11. For FR team ROBOT, see: [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 130 +11. For FR team HUMAN, see: [[UC04.4: Detailed indoor exploration without ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYmal (USAR).WebHome]] 131 +11. During execution of both teams, performance will be measured by experiment leader: 132 +111. Mission completion time 133 +111. Health indicators stay within acceptable range 134 +111. Time for tackling any health alerts 135 +111. Track FR path 136 +1. __Hotwash__: 137 +11. Questions on: 138 +111. Near-incident report 139 +111. Path inside 140 +111. FR location and status of hazards, victims, and layout 141 +111. Mission effectiveness 142 +111. Self-reported workload 143 +111. Trust survey 78 78 145 +**~11. Planning:** 79 79 80 -**~11. Materials / Setup Components** 81 -[List equipment, environment layout, props, simulation assets] 147 +* Team preparation: Day before. 1 hour. 148 +* Trial 1: 149 +** Setup usecase: Test day 1. 09:00 - 09:30 150 +** Setup tech and perform checks: Test day 1. 09:00 - 09:30 151 +** Briefing of each team individually (outside building): Test day 1: 09:00 - 09:30 152 +** Mission execution: Test day 1. 09:30 - 10:30 153 +** Hot wash: Test day 1. 10:30-11:00 154 +** Usecase reset: test day 1. 10:30-11:00 155 +* Teams switch location: Test day 1. 11:00-11:15 156 +* Trial 2: 157 +** Setup usecase: Test day 1. 12:30 - 13:00 158 +** Setup tech and perform checks: Test day 1. 12:30 - 13:00 159 +** Briefing of each team individually (outside building): Test day 1: 12:30 - 13:00 160 +** Mission execution: Test day 1. 13:00 - 14:00 161 +** Hot wash: Test day 1. 14:00-14:30 162 +** Cleanup area and store tech. 14:00-14:30 82 82 83 83 84 -**12. Safety & Ethical Considerations** 85 85 86 -* Risks: [Describe] 87 -* Mitigations: [Describe] 88 -* Informed consent: [Yes/No + method] 89 -* Data handling: [Describe] 166 +**12. Materials** 90 90 168 +* For FRs: 169 +** 1x Anymal with teleop setup and networking 170 +** 2x Tablet with C3I for squad leader (one spare) 171 +** 1x Base of Operations with computer with C3I 172 +** 4x Health sensors 173 +** 4x Location sensors 174 +** 8x walky talky with two channels (?) (for FR team and BoO). 175 +* For usecase: 176 +** 2x training building (~~100m2?) 177 +** Enviromental challenges: smoke machine, obstacles, etc. 178 +** ~~8x Actors or dummies for victims. 179 +* 8x Clipboards with papers and pens for hotwash and questionnaires 91 91 92 -**13. Location & Duration** 93 93 94 -* Location: [Where does it take place?] 95 -* Duration: [Total time per run + preparation] 182 +**13. Dependencies** 96 96 184 +* Availability of materials 185 +* Availability and functioning of ANYmal robot with teleoperation and network in target buildings 186 +* Availability of functioning network between robot, FRs, and BoO. 187 +* Availability of: 188 +** Experiment participants 189 +** People willing to play victim 190 +** Experiment leaders 97 97 98 -**14. Dependencies** 99 -[Other WPs, required assets, system availability, permissions] 100 100 193 +**14. Success Criteria** 194 +When mission(s) completed by both teams, and we can compare their performance using the metrics. 101 101 102 -**15. Success Criteria** 103 -[How do you know the experiment worked as intended?] 104 104 105 - 106 106