Changes for page f. Test CFT3: Two Detailed Use Cases

Summary

• Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Title

...	...	@@ -1,1 +1,1 @@
1		-f. Test CFT3: Two Detailed Use Cases
	1	+d. Test

Content

...	...	@@ -2,7 +2,6 @@
2	2
3	3	//<include a short summary of the claims to be tested, i.e., the effects of the functions in a specfic use case>//
4	4
5		-This study evaluates the operational impact and user acceptance of two technological interventions in emergency response: (1) autonomous indoor drones for victim detection and (2) physiological and environmental sensor systems for monitoring first responder health. The primary claims tested are whether these technologies can enhance situational awareness, improve safety, and integrate seamlessly into existing workflows without overburdening personnel. The analysis focuses on stakeholder feedback from first responders, drone operators, and medics, emphasizing usability, trust, and coordination in high-stress environments.
6	6
7	7	= 2. Method =
8	8
...	...	@@ -9,56 +9,28 @@
9	9
10	10	== 2.1 Participants ==
11	11
12		-Three evaluation sessions were conducted. The first session focused on Use Case 2 (physiological and environmental sensors) and included 10 participants, including: firefighters, USAR personnel, and team leaders. The second and third sessions addressed Use Case 1 (autonomous indoor drones). The second session involved 6 participants, primarily general first responders, while the third session included 2 experienced drone pilots who provided technical and operational insights into drone deployment and navigation.
13	13
14	14	== 2.2 Experimental design ==
15	15
16		-Each use case was presented through a structured action sequence, simulating realistic operational steps. For every step in the sequence, participants were asked targeted questions using polls. Each sequence included between 2 to 5 questions, designed to elicit feedback on usability, trust, and integration of the proposed technologies. After each participant submitted their poll response, the aggregated results were displayed on screen, prompting open discussion. While not every question led to extended dialogue, many sparked valuable exchanges that clarified user expectations and concerns. At the end of each session, participants were asked two closing questions: (1) their overall impression of the use case, and (2) their expectations for how such technologies might evolve over the next 10 years. These questions helped contextualize the feedback within both current and future operational realities.
17	17
18	18	== 2.3 Tasks ==
19	19
20		-Participants evaluated the deployment, operation, and integration of the drone and sensor systems in simulated mission phases. Tasks included assessing drone startup, autonomous navigation, victim detection, and the use of health monitoring dashboards during live operations.
21	21
22	22	== 2.4 Measures ==
23	23
24		-Feedback was captured through qualitative observations, direct quotes, and Likert-scale agreement ratings on key usability and trust dimensions. Measures focused on perceived usefulness, cognitive load, trust in automation, and integration with team workflows.
25	25
26	26	== 2.5 Procedure ==
27	27
28		-Each session began with a scenario briefing and a walkthrough of the proposed technology in action. Participants were guided through a detailed action sequence representing a typical mission phase. At each step, they responded to poll questions, which were then visualized and discussed in real time. This format allowed for both quantitative and qualitative feedback. The sessions concluded with reflective questions about the overall use case and long-term expectations, encouraging participants to think beyond the immediate implementation and consider future developments.
29	29
30	30	== 2.6 Material ==
31	31
32		-Materials included scenario descriptions, interface mockups (e.g., traffic-light health dashboards), and conceptual visualisations Use case flows. They were shown in the program Mentimeter, to create an interactive session. These were used to prompt discussion and elicit targeted feedback on system behavior and user interaction.
33	33
34	34	= 3. Results =
35	35
36		-Across the three sessions, participants expressed strong interest in the potential of both technologies, while also identifying critical usability and integration challenges.
37	37
38		-**Use Case 1 (Autonomous indoor drones):**
39		-
40		-Feedback centered on the need for **rapid drone deployment**, **minimal interference with human responders**, and **reliable victim detection**. First responders highlighted the importance of **parallel deployment protocols** and **geofencing** to avoid human-drone conflicts. Drone pilots emphasized the value of having **dedicated operators and analysts**, and supported the integration of **friend-or-foe identification** to improve AI recognition.
41		-
42		-Participants agreed that drones are a valuable **additional tool**, not a replacement for dogs or human responders. Deployment timing depends on the situation: in urgent cases, responders may enter without waiting for a drone; in international USAR missions, there is more time to prepare and deploy drones. Regulations were a recurring theme—drones are not allowed to fly near personnel, requiring coordination and certification.
43		-
44		-Participants noted that **drone teams are often separate from firefighting teams** and may not fit into standard vehicle deployments. In USAR, drone operation could be an **additional role** for technical search specialists. There was consensus that drones should **continue scanning after detecting a victim**, unless they can provide direct aid. Drone pilots highlighted technical preferences, such as combining **RGB and LIDAR feeds**, and noted that **indoor noise and sensor interference** are real concerns.
45		-
46		-Trust in the drone team varied, especially among participants unfamiliar with previous CFTs. Some responders were initially skeptical but acknowledged that **standard operating procedures (SOPs)** could help integrate drone teams more effectively. Participants also emphasized the need for **flexible information filtering**, allowing HQ to suppress irrelevant data and team leaders to focus on their operational area.
47		-
48		-**Use Case 2 (Physiological and environmental sensors​​​​​​​):**
49		-
50		-Participants emphasized the importance of **minimal setup time**, especially for firefighters who need to deploy immediately. USAR personnel, operating in longer shifts, were more tolerant of a 10–15 minute setup window. There was strong support for **default configurations**, **discreet personal alerts**, and **role-based interfaces**. Firefighters preferred simple, glanceable indicators (e.g., traffic-light status), while USAR medics wanted access to more detailed data.
51		-
52		-Participants stressed that **not everyone needs to see everything**—information should be filtered based on role and task. For example, a smoke director or safety officer might monitor vitals instead of the team leader. The system should provide **yes/no answers** to task-relevant questions rather than raw data. There was consensus that **team leaders must retain control**, including the ability to mute alerts when needed to maintain situational awareness.
53		-
54		-Views on escalation varied: some (e.g., Polish participants) preferred **automatic escalation to HQ**, while others (e.g., Dutch participants) favored **team leader confirmation first**. Participants also supported the idea of a **dedicated tech or medic role** to manage sensor readiness and monitoring. The system was seen as a way to **increase resilience**, but participants warned against over-reliance or information overload.
55		-
56	56	= 4. Discussion =
57	57
58		-The feedback underscores a central theme: technology must adapt to the tempo and structure of emergency response, not the other way around. Both systems were seen as valuable additions, but only if they respect the cognitive and operational constraints of their users. For drones, this means fast, autonomous reconnaissance that complements rather than delays human action. For sensors, it means providing actionable insights without overwhelming users or requiring excessive configuration.
59	59
60		-Trust emerged as a critical factor in both cases. For drones, trust was built through consistent team assignments and the ability to intervene in autonomous behavior. For sensors, trust depended on discreet, accurate alerts and the assurance that human judgment remained central. The feedback also highlighted the importance of role clarity—who monitors what, when, and how—and the need for flexible system configurations to match different team structures and national protocols.
61		-
62	62	= 5. Conclusions =
63	63
64		-Stakeholders view autonomous drones and health sensor systems as promising tools to enhance safety, speed, and situational awareness in emergency response. However, their success hinges on thoughtful integration into existing workflows, minimal disruption to frontline operations, and clear human oversight. Design priorities should include rapid deployment, intuitive interfaces, role-based alerting, and mechanisms that reinforce trust and coordination. By aligning system behavior with user expectations and operational realities, these technologies can become trusted assets in high-stakes environments.
	35	+