Changes for page k. Design Patterns Evaluation SFT1
Last modified by Tjalling Haije on 2026/07/27 16:18
From version 4.4
edited by Tjalling Haije
on 2026/07/27 15:03
on 2026/07/27 15:03
Change comment:
There is no comment for this version
To version 2.21
edited by Tjalling Haije
on 2026/07/27 13:24
on 2026/07/27 13:24
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
-
Attachments (0 modified, 0 added, 3 removed)
Details
- Page properties
-
- Content
-
... ... @@ -65,13 +65,7 @@ 65 65 === 2. Incident 2 tech evaluation === 66 66 67 67 |(% style="width:247px" %)**Tech**|(% style="width:319px" %)**How was it used**|(% style="width:329px" %)**Issues**|(% style="width:329px" %)**Did it work sufficiently?** 68 -|(% style="width:247px" %)[[ASTRAL RTK Drone>>Main.c\. Technology.ASTRAL RTK Drone.WebHome]] (outdoor)|(% style="width:319px" %)Baseline & Run 1-3: The drone team conducts an aerial assessment of the collapsed buildings, identifying structural risks, access points, and possible victim locations. |(% style="width:329px" %)((( 69 -Run 1 USAR 1: Drone had connection issues which delayed its deployment. 70 - 71 -{{warning}} 72 -TODO: expand these issues with questionnaire answers 73 -{{/warning}} 74 -)))|(% style="width:329px" %)Yes 68 +|(% style="width:247px" %)[[ASTRAL RTK Drone>>Main.c\. Technology.ASTRAL RTK Drone.WebHome]] (outdoor)|(% style="width:319px" %)Baseline & Run 1-3: The drone team conducts an aerial assessment of the collapsed buildings, identifying structural risks, access points, and possible victim locations. |(% style="width:329px" %)Run 1 USAR 1: Drone had connection issues which delayed its deployment.|(% style="width:329px" %)Yes 75 75 |(% style="width:247px" %)[[OWL Indoor Drone>>Main.c\. Technology.OWL Indoor Drone.WebHome]] |(% style="width:319px" %)((( 76 76 Run 2 USAR 2: used to explore building and search for objects and victims 77 77 ... ... @@ -79,9 +79,7 @@ 79 79 )))|(% style="width:329px" %)((( 80 80 Run 2 USAR 1: OWL missed victim and entire floor. Object detection initially disabled. 81 81 82 -{{warning}} 83 -TODO: expand these issues with questionnaire answers 84 -{{/warning}} 76 + 85 85 )))|(% style="width:329px" %)Unreliable 86 86 |(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[Robot Arm (for ANYmal)>>Main.c\. Technology.Robot Arm (for ANYmal).WebHome]] |(% style="width:319px" %)((( 87 87 Run 1 USAR 1: remove beam blocking door ... ... @@ -89,10 +89,8 @@ 89 89 Run 3 USAR 1: Used to close a valve 90 90 91 91 92 -)))|(% style="width:329px" %){{warning}}TODO: expand these issues with questionnaire answers{{/warning}}((( 93 - 94 -)))|(% style="width:329px" %)Yes 95 -|(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[SNAKE>>Main.c\. Technology.SNAKE.WebHome]] |(% style="width:319px" %)Run 3 USAR 1: Used to search for victims in a narrow space|(% style="width:329px" %){{warning}}TODO: expand these issues with questionnaire answers{{/warning}}|(% style="width:329px" %)? 84 +)))|(% style="width:329px" %) |(% style="width:329px" %)Yes 85 +|(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[SNAKE>>Main.c\. Technology.SNAKE.WebHome]] |(% style="width:319px" %)Run 3 USAR 1: Used to search for victims in a narrow space|(% style="width:329px" %) |(% style="width:329px" %)? 96 96 97 97 === 3. Incident 2 way of working === 98 98 ... ... @@ -100,45 +100,27 @@ 100 100 |(% style="width:166px" %)Run 1, USAR team 1|(% style="width:442px" %)((( 101 101 The outdoor drone provides the Team Leader with an initial assessment of the incident scene. The Team Leader uses this information to deploy USAR teams and robotic assets; ANYmal supports by investigating and clearing hazards, after which the USAR teams gain access, stabilize the structure, locate victims, and perform rescues while continuously reporting progress to the Team Leader. 102 102 )))|(% style="width:238px" %)[[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 103 -Although the robot didn 't exploreinside.93 +Although the robot seems to have had a very limited role here and not have explored much. 104 104 |(% style="width:166px" %)Run 2, USAR team 2|(% style="width:442px" %)((( 105 105 The OWL indoor drone first explores the collapsed structure and streams its findings to the Team Leader. Based on this reconnaissance, the USAR team enters, searches for victims, responds to emergencies, and conducts rescues while the Team Leader maintains situational awareness through the digital support system. 106 106 )))|(% style="width:238px" %)[[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 107 107 |(% style="width:166px" %)Run 3, USAR team 1|(% style="width:442px" %)((( 108 108 The outdoor drone assesses the scene, SNAKE inspects the interior, and ANYmal handles hazardous intervention tasks. Using the information gathered by these robotic systems, the USAR team enters, locates victims, and performs the rescue while the Team Leader maintains overall situational awareness and coordination. 109 -)))|(% style="width:238px" %)[[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 110 -Although the robot didn't explore inside. 99 +)))|(% style="width:238px" %)[[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] 111 111 112 112 == 4. Raw results == 113 113 114 - ===Results for Incident 2, Run3, USAR team 1VS baseline USAR team 1 ===103 +**Results for Incident 2, Run 1, USAR team 1** 115 115 116 -Analysis of questionnaire results for members with ID: UT13, UT11, UT12, UTL1 117 - 118 - 119 -|=Scenario|=Role|=Participants 120 -|Baseline|USAR Team Member|3 121 -|Baseline|USAR Team Leader|1 122 -|Run 3|USAR Team Member|3 123 -|Run 3|USAR Team Leader|1 124 - 125 -[[image:1785164456543-963.png||height="376" width="752"]] 126 - 127 -[[image:1785164494950-855.png||height="348" width="756"]] 128 - 129 -[[image:1785164507435-933.png||height="253" width="745"]] 130 - 131 - 132 132 Note: The measures are defined in [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] and [[x. Measures>>3\. Evaluation.Measures.WebHome]] 133 133 134 134 |(% style="width:376px" %)**Measure**|(% style="width:225px" %)**Results**|**Connected Claim**|**Claim proven?** 135 135 |(% style="width:376px" %)Safe path chosen|(% style="width:225px" %) |CL01 Improve safety for responders | 136 136 |(% style="width:376px" %)Decision quality|(% style="width:225px" %) |CL01 Improve safety for responders | 137 -|(% style="width:376px" %)Near-incident and incident reports|(% style="width:225px" %)No incidents in baseline or run. 138 -No near-incidents data available.|CL01 Improve safety for responders |Unknown 139 -|(% style="width:376px" %)Reported hazards, victims, layout correctness, based on robot intel before FR entry|(% style="width:225px" %)No ground truth data available.|CL02 Increased SA|Unknown 140 -|(% style="width:376px" %)How optimal was the FR path|(% style="width:225px" %)No FR path or ground truth data available.|CL02 Increased SA|Unknown 141 -|(% style="width:376px" %)Reported hazards, victims, layout correctness, after FR entry|(% style="width:225px" %)No FR path or ground truth data available.|CL02 Increased SA|Unknown 110 +|(% style="width:376px" %)Near-incident and incident reports|(% style="width:225px" %) |CL01 Improve safety for responders | 111 +|(% style="width:376px" %)Reported hazards, victims, layout correctness, based on robot intel before FR entry|(% style="width:225px" %) |CL02 Increased SA| 112 +|(% style="width:376px" %)How optimal was the FR path|(% style="width:225px" %) |CL02 Increased SA| 113 +|(% style="width:376px" %)Reported hazards, victims, layout correctness, after FR entry|(% style="width:225px" %) |CL02 Increased SA| 142 142 |(% style="width:376px" %)Workload: e.g. NASA-TLX|(% style="width:225px" %) |CL03 improved mission effectiveness| 143 143 |(% style="width:376px" %)Appropriate trust in technology: e.g. trust survey|(% style="width:225px" %) |CL04 acceptable workload| 144 144 |(% style="width:376px" %)Decision confidence: e.g. Retrospective decision quality rating|(% style="width:225px" %) |CL04 acceptable workload|
- 1785164456543-963.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -146.4 KB - Content
- 1785164494950-855.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -162.9 KB - Content
- 1785164507435-933.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -108.5 KB - Content