Skip to Content
Last modified by Tjalling Haije on 2025/09/15 08:49
From version 4.1
edited by Rosa Van Tuijn
on 2025/07/08 11:04
Change comment: There is no comment for this version
To version 10.1
edited by Tjalling Haije
on 2025/09/15 08:49
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.RosaVanTuijn
1 +XWiki.TjallingHaije
Content
... ... @@ -1,7 +1,5 @@
1 1  = 1. Introduction =
2 2  
3 -//<include a short summary of the claims to be tested, i.e., the effects of the functions in a specfic use case>//
4 -
5 5  The goal of this test was to understand what type of information would support each role at different levels (strategic, tactical, operational) in performing their tasks, particularly in decision-making. We focused mainly on the tactical and operational levels.
6 6  
7 7  = 2. Method =
... ... @@ -18,32 +18,193 @@
18 18  
19 19  == 2.2 Experimental design ==
20 20  
19 +The study used a role-based, exploratory design to assess how different types of sensor data (health, communication, location) support decision-making at tactical and operational levels. Five tailored questionnaires were developed, each focusing on a specific technology. The design emphasized gathering qualitative insights through open-ended questions and evaluating visualization preferences using example formats. An example of the question that were asked can be found below. The table below shows the start questions of every questionnaire:
21 21  
21 +|(% colspan="2" %)Participant information
22 +|Q: What type of partner are you?|(((
23 +Answer options:
24 +
25 +* First responder (USAR)
26 +* First responder Team Lead (USAR)
27 +* First responder Paramedic (USAR)
28 +* Firefighter
29 +* Firefighter Team Lead
30 +* Tech partner
31 +* Other:
32 +)))
33 +
34 +The questionnaire for the WEARIN’ body sensor data is detailed in the table below. It also shows the interface sketches that were made for this technology. The sketches for the other design can be found in: [[a. Prototype CFT1: Data visualization examples>>doc:3\. Evaluation.a\. Prototype.WebHome]].
35 +
36 +|(% colspan="2" %)WEARIN’ health data
37 +|Q: What types of health data do you think helps determines the status of a First responder?|Open answer
38 +|Q: Which data should have the highest priority? (and how should it be communicated?)|Open answer
39 +|Q: How is health data currently communicated within an USAR operation?|Open answer
40 +|Q: How can we display health data in a helpful manner?|Open answer
41 +|(% colspan="2" %)(((
42 +
43 +
44 +|
45 +| |[[image:1751972821005-693.png]]
46 +
47 +This visualization that is presented during the next two questions.
48 +Visual description: What types of medical data do you think is useful for people at the USAR Basecamp (tactical), and what kind of data is useful for people that work in the field (operational)?
49 +)))
50 +|Q: What medical data would be useful for the people at USAR basecamp? (tactical)|Open answer
51 +|Q: What medical data would be useful for the people at the operational worksite? (operational)|Open answer
52 +|(% colspan="2" %)(((
53 +[[image:1751972821009-634.png]]
54 +This visualization is presented during the next ten questions.
55 +
56 +
57 +Visual description: We have selected these roles that could benefit from seeing medical data, divided again in tactical and operational roles. What type of information should each role see according to you? And why?
58 +)))
59 +|Q: How important is seeing medical data to the Team Lead role? (Tactical)|Likert scale
60 +|Q: Why? What type of information would be relevant?|Open answer
61 +|Q: How important is seeing medical data to the Medical staff? (Tactical)|Likert scale
62 +|Q: Why? What type of information would be relevant?|Open answer
63 +|Q: How important is seeing medical data to the Squad leader role? (Operational)|Likert scale
64 +|Q: Why? What type of information would be relevant?|Open answer
65 +|Q: How important is seeing medical data to the Paramedic? (Operational)|Likert scale
66 +|Why? What type of information would be relevant?|Open answer
67 +|Q: How important is seeing medical data to the First responder itself? (Operational)|Likert scale
68 +|Q: Why? What type of information would be relevant?|Open answer
69 +|(% colspan="2" %)(((
70 +
71 +
72 +|
73 +| |[[image:1751972821011-457.png]]
74 +
75 +This visualization is presented during the next questions.
76 +Visualization description: Which roles do you think might also need some type of access to medical information? Why?
77 +)))
78 +|Q: Fill in which other roles could be relevant and why|Open answer
79 +|(% colspan="2" %)(((
80 +
81 +
82 +| | | |
83 +| |[[image:1751972821013-625.png]]| |[[image:1751972821015-169.png]]
84 +
85 +These visualizations is presented during the next ten questions.
86 +Visualization description: We have created sketches of possibilities to display the health data. The first screen shows the health status of all teams, while the second screen is zoomed in on one team and its members. How important is it to see these screens for the following roles?
87 +)))
88 +|Q: How important is the first screen for the Team Lead?|Likert scale
89 +|Q: How important is the first screen for the Medical Staff?|Likert scale
90 +|Q: How important is the first screen for the Squad leader?|Likert scale
91 +|Q: How important is the first screen for the Paramedic?|Likert scale
92 +|Q: How important is the first screen for the First Responder itself?|Likert scale
93 +|Q: How important is the second screen for the Team Lead?|Likert scale
94 +|Q: How important is the second screen for the Medical Staff?|Likert scale
95 +|Q: How important is the second screen for the Squad leader?|Likert scale
96 +|Q: How important is the second screen for the Paramedic?|Likert scale
97 +|Q: How important is the second screen for the First Responder itself?|Likert scale
98 +|(% colspan="2" %)(((
99 +
100 +
101 +|
102 +| |[[image:1751972821015-618.png]]
103 +
104 +This visualization is presented during the next seven questions.
105 +Visualization description: This screen shows a **summarized status view** of the medical data. The square with the cross icon shows the current status of the first responder and can turn green to indicate that the status is good and can turn orange to indicate that the status is not good. An alert can also be presented with the red triangle, this indicates an upcoming (predicted) or a large change in status.
106 +)))
107 +|Q: How important is the second screen for the Team Lead?|Likert scale
108 +|Q: How important is the second screen for the Medical Staff?|Likert scale
109 +|Q: How important is the second screen for the Squad leader?|Likert scale
110 +|Q: How important is the second screen for the Paramedic?|Likert scale
111 +|Q: How important is this screen for the First Responder itself?|Likert scale
112 +|Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
113 +|Q: Is there something missing from this view?|Open answer
114 +|(% colspan="2" %)(((
115 +
116 +
117 +|
118 +| |[[image:1751972821016-346.png]]
119 +
120 +This visualization is presented during the next questions.
121 +Visualization description: This screen shows **detailed raw health data** of different team members. It shows it both in a graphs as in data points.
122 +)))
123 +|Q: How important is the second screen for the Team Lead?|Likert scale
124 +|Q: How important is the second screen for the Medical Staff?|Likert scale
125 +|Q: How important is the second screen for the Squad leader?|Likert scale
126 +|Q: How important is the second screen for the Paramedic?|Likert scale
127 +|Q: How important is this screen for the First Responder itself?|Likert scale
128 +|Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
129 +|Q: Is there something missing from this view?|Open answer
130 +|(% colspan="2" %)(((
131 +
132 +
133 +|
134 +| |[[image:1751972821017-499.png]]
135 +
136 +This visualization is presented during the next questions.
137 +Visualization description: This screen shows **Aggregated health data** of different team members, combined in a way to show.
138 +)))
139 +|Q: How important is the second screen for the Team Lead?|Likert scale
140 +|Q: How important is the second screen for the Medical Staff?|Likert scale
141 +|Q: How important is the second screen for the Squad leader?|Likert scale
142 +|Q: How important is the second screen for the Paramedic?|Likert scale
143 +|Q: How important is this screen for the First Responder itself?|Likert scale
144 +|Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
145 +|Q: Is there something missing from this view?|Open answer
146 +|(% colspan="2" %)(((
147 +
148 +
149 +|
150 +| |[[image:1751972821017-270.png]]
151 +
152 +This visualization is presented during the next questions.
153 +Visualization description: This screen shows **Predicted health data** of the possible future health status of team members, including advice about future actions that should be taken to keep the First Responders safe.
154 +)))
155 +|Q: How important is the second screen for the Team Lead?|Likert scale
156 +|Q: How important is the second screen for the Medical Staff?|Likert scale
157 +|Q: How important is the second screen for the Squad leader?|Likert scale
158 +|Q: How important is the second screen for the Paramedic?|Likert scale
159 +|Q: How important is this screen for the First Responder itself?|Likert scale
160 +|Q: Do you think this is a good way to display the predictions about the first responder's health? Why or why not?|Open answer
161 +|Q: What do you think of this advice function, does it explain enough? What else would you want to know when making a decision?|Open answer
162 +
22 22  == 2.3 Tasks ==
23 23  
165 +Participants were asked to:
24 24  
167 +* Describe how sensor data could support their role.
168 +* Identify specific data needs relevant to their operational or tactical responsibilities.
169 +* Evaluate various visualization formats (e.g., traffic lights, raw data, predictions).
170 +* Provide feedback on the clarity and usefulness of each visualization type.
171 +
25 25  == 2.4 Measures ==
26 26  
174 +The study measured:
27 27  
176 +* **Perceived usefulness** of different data types (e.g., heart rate, GPS).
177 +* **Role-specific data needs**, categorized by tactical, and operational levels.
178 +* **Visualization preferences**, including simplicity, detail, and trust in predictive models.
179 +* **Qualitative feedback** on visualization examples and their applicability in field scenarios.
180 +
28 28  == 2.5 Procedure ==
29 29  
183 +During the field test in Greece:
30 30  
185 +1. Participants were briefed on the goal of the study.
186 +1. Each participant received a questionnaire about one of the technologies that they could fill in with their role in mind.
187 +1. They completed the questionnaire individually, providing both structured and open-ended responses.
188 +1. During the questionnaire they could ask questions to the researchers for extra clarity.
189 +1. Visualization examples were shown to elicit preferences and feedback.
190 +1. Responses were collected and analyzed to identify patterns across roles and technologies.
191 +
31 31  == 2.6 Material ==
32 32  
194 +* **Five questionnaires made** created in Survalyzer and presented on a tablet.
195 +* **Visualization examples** included traffic light indicators, raw and aggregated data, predictive analytics, and advisory outputs.
33 33  
34 34  = 3. Results =
35 35  
199 +A total of 12 partners completed questionnaires during the field test in Athens. The health questionnaire was filled out by 5 partners, the communication questionnaire by 2 partners, and the location questionnaire by 4 participants. Although a questionnaire for the gas sensors (also by WEARIN’) was prepared, we decided not to focus on it in Athens since the gas sensor was not used during the exercises. The questionnaires were completed by individuals in various roles, including researchers, drone pilots, paramedics, incident commanders, chief SAR, and firefighters.
36 36  
37 -= 4. Discussion =
38 -
39 -
40 -= 5. Conclusions =
41 -
42 42  **Health data**
43 43  
44 44  Types of health data: heart rate, respiratory rate, body temperature, blood pressure, and mental health were frequently mentioned as essential.
45 45  
46 -Reasoning given for roles
205 +Reasoning given for how this information is important for a specific role:
47 47  
48 48  * Team Lead - Important for monitoring the overall safety of teams.
49 49  * Medical Personnel - Essential for making critical decisions.
... ... @@ -50,7 +50,7 @@
50 50  * Paramedic (Operational) - Necessary for directly treating team members.
51 51  * First Responder - Relevant for personal health and well-being.
52 52  
53 -Conclusion: Health data is essential for a wide range of roles, but the requirements vary greatly. Medical personnel and paramedics request detailed and contextual data, while team leaders and first responders value summaries and simple alerts more. Transparency in predictive models is necessary to build trust.
212 +Highlight: Health data is essential for a wide range of roles, but the requirements vary greatly. Medical personnel and paramedics request detailed and contextual data, while team leaders and first responders value summaries and simple alerts more. Transparency in predictive models is necessary to build trust.
54 54  
55 55  
56 56  **Location data**
... ... @@ -57,13 +57,13 @@
57 57  
58 58  Types of Location data: Location data such as GPS coordinates, building heights, and paths to victims were frequently mentioned.
59 59  
60 -Reasoning given for roles
219 +Reasoning given for how this information is important for a specific role:
61 61  
62 62  * Team Lead - Essential for team coordination.
63 63  * Squad leader (Operational) - Necessary for instructing team members.
64 64  * First Responder - Helps with orientation and finding victims.
65 65  
66 -Conclusion: Location data plays a crucial role in both tactical and operational decisions. Tactical team leaders want aggregated and sector-based data, while operational roles such as squad leaders and first responders need detailed and real-time information. 3D maps and interactive elements are valuable tools to improve navigation and coordination.
225 +Highlight: Location data plays a crucial role in both tactical and operational decisions. Tactical team leaders want aggregated and sector-based data, while operational roles such as squad leaders and first responders need detailed and real-time information. 3D maps and interactive elements are valuable tools to improve navigation and coordination.
67 67  
68 68  
69 69  **Communication data**
... ... @@ -70,7 +70,7 @@
70 70  
71 71  Types of communication data: Respondents emphasized the importance of RSSI (signal strength), signal speed, and interference detection.
72 72  
73 -Reasoning given for roles
232 +Reasoning given for how this information is important for a specific role:
74 74  
75 75  * Team Lead - Important for monitoring team connectivity.
76 76  * IT Specialist - Crucial for troubleshooting.
... ... @@ -77,4 +77,18 @@
77 77  * Squad leader (Operational) - Relevant for field communication.
78 78  * First Responder - Only needed for personal connectivity.
79 79  
80 -Conclusion: Communication plays a central role at all levels of USAR operations. Tactical users need extensive analyses to monitor team status, while operational roles such as IT specialists focus on technical troubleshooting. Advisory functions and visual simplicity could contribute to effectiveness in the field.
239 +Highlight: Communication plays a central role at all levels of USAR operations. Tactical users need extensive analyses to monitor team status, while operational roles such as IT specialists focus on technical troubleshooting. Advisory functions and visual simplicity could contribute to effectiveness in the field.
240 +
241 += 4. Discussion =
242 +
243 +The study highlights the importance of tailoring sensor data visualization to user roles. Tactical users benefit from aggregated, strategic overviews, while operational users require detailed, real-time data. Visualization design must balance simplicity with informativeness, and predictive models must be transparent to build trust. These insights can guide future development of adaptive interfaces for USAR operations.
244 +
245 += 5. Conclusions =
246 +
247 +The field test demonstrated that sensor data—when tailored to user roles and operational contexts—can significantly enhance decision-making in USAR operations. However, the type, granularity, and presentation of data must align with the specific needs of tactical and operational users.
248 +
249 +* **Health data** is universally valued but interpreted differently across roles. Medical personnel and paramedics require detailed, contextual information to make clinical decisions, while team leaders and first responders benefit more from simplified summaries and alerts. Trust in predictive health models hinges on transparency and clarity.
250 +* **Location data** is essential for both coordination and navigation. Tactical users prefer aggregated, sector-based overviews to manage teams, whereas operational users such as squad leaders and first responders need real-time, detailed data to orient themselves and locate victims. Tools like 3D maps and interactive visualizations are especially helpful.
251 +* **Communication data** supports both strategic oversight and technical troubleshooting. Tactical roles benefit from system-wide connectivity insights, while operational roles focus on individual and team-level communication. Simplicity in visualization and advisory features can improve usability and effectiveness in the field.
252 +
253 +Overall, the study underscores the importance of **role-specific data visualization** and the need for **adaptive interfaces** that balance detail with usability. Future developments should prioritize **clarity, trust, and contextual relevance** to ensure sensor data truly supports the diverse needs of USAR personnel.
1751972821005-693.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +54.1 KB
Content
1751972821009-634.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +55.4 KB
Content
1751972821011-457.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +66.8 KB
Content
1751972821013-625.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +19.6 KB
Content
1751972821015-169.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +14.4 KB
Content
1751972821015-618.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +14.2 KB
Content
1751972821016-346.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +8.7 KB
Content
1751972821017-270.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +9.6 KB
Content
1751972821017-499.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.RosaVanTuijn
Size
... ... @@ -1,0 +1,1 @@
1 +8.3 KB
Content