Changes for page k. Design Patterns Evaluation SFT1
Last modified by Tjalling Haije on 2026/07/27 16:18
From version 4.4
edited by Tjalling Haije
on 2026/07/27 15:03
on 2026/07/27 15:03
Change comment:
There is no comment for this version
To version 3.1
edited by Tjalling Haije
on 2026/07/27 13:37
on 2026/07/27 13:37
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
-
Attachments (0 modified, 0 added, 3 removed)
Details
- Page properties
-
- Content
-
... ... @@ -65,13 +65,7 @@ 65 65 === 2. Incident 2 tech evaluation === 66 66 67 67 |(% style="width:247px" %)**Tech**|(% style="width:319px" %)**How was it used**|(% style="width:329px" %)**Issues**|(% style="width:329px" %)**Did it work sufficiently?** 68 -|(% style="width:247px" %)[[ASTRAL RTK Drone>>Main.c\. Technology.ASTRAL RTK Drone.WebHome]] (outdoor)|(% style="width:319px" %)Baseline & Run 1-3: The drone team conducts an aerial assessment of the collapsed buildings, identifying structural risks, access points, and possible victim locations. |(% style="width:329px" %)((( 69 -Run 1 USAR 1: Drone had connection issues which delayed its deployment. 70 - 71 -{{warning}} 72 -TODO: expand these issues with questionnaire answers 73 -{{/warning}} 74 -)))|(% style="width:329px" %)Yes 68 +|(% style="width:247px" %)[[ASTRAL RTK Drone>>Main.c\. Technology.ASTRAL RTK Drone.WebHome]] (outdoor)|(% style="width:319px" %)Baseline & Run 1-3: The drone team conducts an aerial assessment of the collapsed buildings, identifying structural risks, access points, and possible victim locations. |(% style="width:329px" %)Run 1 USAR 1: Drone had connection issues which delayed its deployment.|(% style="width:329px" %)Yes 75 75 |(% style="width:247px" %)[[OWL Indoor Drone>>Main.c\. Technology.OWL Indoor Drone.WebHome]] |(% style="width:319px" %)((( 76 76 Run 2 USAR 2: used to explore building and search for objects and victims 77 77 ... ... @@ -79,9 +79,7 @@ 79 79 )))|(% style="width:329px" %)((( 80 80 Run 2 USAR 1: OWL missed victim and entire floor. Object detection initially disabled. 81 81 82 -{{warning}} 83 -TODO: expand these issues with questionnaire answers 84 -{{/warning}} 76 + 85 85 )))|(% style="width:329px" %)Unreliable 86 86 |(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[Robot Arm (for ANYmal)>>Main.c\. Technology.Robot Arm (for ANYmal).WebHome]] |(% style="width:319px" %)((( 87 87 Run 1 USAR 1: remove beam blocking door ... ... @@ -89,10 +89,8 @@ 89 89 Run 3 USAR 1: Used to close a valve 90 90 91 91 92 -)))|(% style="width:329px" %){{warning}}TODO: expand these issues with questionnaire answers{{/warning}}((( 93 - 94 -)))|(% style="width:329px" %)Yes 95 -|(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[SNAKE>>Main.c\. Technology.SNAKE.WebHome]] |(% style="width:319px" %)Run 3 USAR 1: Used to search for victims in a narrow space|(% style="width:329px" %){{warning}}TODO: expand these issues with questionnaire answers{{/warning}}|(% style="width:329px" %)? 84 +)))|(% style="width:329px" %) |(% style="width:329px" %)Yes 85 +|(% style="width:247px" %)[[ANYmal Robot>>Main.c\. Technology.Humanoid Robot.WebHome]] with [[SNAKE>>Main.c\. Technology.SNAKE.WebHome]] |(% style="width:319px" %)Run 3 USAR 1: Used to search for victims in a narrow space|(% style="width:329px" %) |(% style="width:329px" %)? 96 96 97 97 === 3. Incident 2 way of working === 98 98 ... ... @@ -111,34 +111,17 @@ 111 111 112 112 == 4. Raw results == 113 113 114 - ===Results for Incident 2, Run3, USAR team 1VS baseline USAR team 1 ===104 +**Results for Incident 2, Run 1, USAR team 1** 115 115 116 -Analysis of questionnaire results for members with ID: UT13, UT11, UT12, UTL1 117 - 118 - 119 -|=Scenario|=Role|=Participants 120 -|Baseline|USAR Team Member|3 121 -|Baseline|USAR Team Leader|1 122 -|Run 3|USAR Team Member|3 123 -|Run 3|USAR Team Leader|1 124 - 125 -[[image:1785164456543-963.png||height="376" width="752"]] 126 - 127 -[[image:1785164494950-855.png||height="348" width="756"]] 128 - 129 -[[image:1785164507435-933.png||height="253" width="745"]] 130 - 131 - 132 132 Note: The measures are defined in [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] and [[x. Measures>>3\. Evaluation.Measures.WebHome]] 133 133 134 134 |(% style="width:376px" %)**Measure**|(% style="width:225px" %)**Results**|**Connected Claim**|**Claim proven?** 135 135 |(% style="width:376px" %)Safe path chosen|(% style="width:225px" %) |CL01 Improve safety for responders | 136 136 |(% style="width:376px" %)Decision quality|(% style="width:225px" %) |CL01 Improve safety for responders | 137 -|(% style="width:376px" %)Near-incident and incident reports|(% style="width:225px" %)No incidents in baseline or run. 138 -No near-incidents data available.|CL01 Improve safety for responders |Unknown 139 -|(% style="width:376px" %)Reported hazards, victims, layout correctness, based on robot intel before FR entry|(% style="width:225px" %)No ground truth data available.|CL02 Increased SA|Unknown 140 -|(% style="width:376px" %)How optimal was the FR path|(% style="width:225px" %)No FR path or ground truth data available.|CL02 Increased SA|Unknown 141 -|(% style="width:376px" %)Reported hazards, victims, layout correctness, after FR entry|(% style="width:225px" %)No FR path or ground truth data available.|CL02 Increased SA|Unknown 111 +|(% style="width:376px" %)Near-incident and incident reports|(% style="width:225px" %) |CL01 Improve safety for responders | 112 +|(% style="width:376px" %)Reported hazards, victims, layout correctness, based on robot intel before FR entry|(% style="width:225px" %) |CL02 Increased SA| 113 +|(% style="width:376px" %)How optimal was the FR path|(% style="width:225px" %) |CL02 Increased SA| 114 +|(% style="width:376px" %)Reported hazards, victims, layout correctness, after FR entry|(% style="width:225px" %) |CL02 Increased SA| 142 142 |(% style="width:376px" %)Workload: e.g. NASA-TLX|(% style="width:225px" %) |CL03 improved mission effectiveness| 143 143 |(% style="width:376px" %)Appropriate trust in technology: e.g. trust survey|(% style="width:225px" %) |CL04 acceptable workload| 144 144 |(% style="width:376px" %)Decision confidence: e.g. Retrospective decision quality rating|(% style="width:225px" %) |CL04 acceptable workload|
- 1785164456543-963.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -146.4 KB - Content
- 1785164494950-855.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -162.9 KB - Content
- 1785164507435-933.png
-
- Author
-
... ... @@ -1,1 +1,0 @@ 1 -XWiki.TjallingHaije - Size
-
... ... @@ -1,1 +1,0 @@ 1 -108.5 KB - Content