Skip to Content
Version 5.1 by Rosa Van Tuijn on 2025/07/08 11:09
Hide last authors
Tjalling Haije 1.1 1 = 1. Introduction =
2
3 //<include a short summary of the claims to be tested, i.e., the effects of the functions in a specfic use case>//
4
Rosa Van Tuijn 2.1 5 The goal of this test was to understand what type of information would support each role at different levels (strategic, tactical, operational) in performing their tasks, particularly in decision-making. We focused mainly on the tactical and operational levels.
Tjalling Haije 1.1 6
7 = 2. Method =
8
Rosa Van Tuijn 2.1 9 For each technology, a separate questionnaire was prepared. In total, five distinct questionnaires were created in Survalyzer. All the questionnaires included the same types of questions:
Tjalling Haije 1.1 10
Rosa Van Tuijn 2.1 11 1. **General Open Questions**: Firstly, the participants were asked how they thought data could be helpful and how it should be visualized to be useful.
12 1. **Information Needs**: Next, the questions focused on the different information needs of tactical and operational roles, asking participants which data they would want and need for their roles.
13 1. **Visualization Examples**: Lastly, various examples of data visualizations were shown to get an indication of which role would want to see what type of data visualization. The examples included basic traffic lights, raw data, aggregated data, predictions, and advice. See appendix B for all the designs that have been made.
14
Tjalling Haije 1.1 15 == 2.1 Participants ==
16
Rosa Van Tuijn 2.1 17 A total of 12 partners completed questionnaires during the field test in Athens. The health questionnaire was filled out by 5 partners, the communication questionnaire by 2 partners, and the location questionnaire by 4 participants. Although a questionnaire for the gas sensors (also by WEARIN’) was prepared, we decided not to focus on it in Athens since the gas sensor was not used during the exercises. The questionnaires were completed by individuals in various roles, including researchers, drone pilots, paramedics, incident commanders, chief SAR, and firefighters.
Tjalling Haije 1.1 18
19 == 2.2 Experimental design ==
20
Rosa Van Tuijn 5.1 21 The table below shows the start questions of every questionnaire:
Tjalling Haije 1.1 22
Rosa Van Tuijn 5.1 23 |(% colspan="2" %)Participant information
24 |Q: What type of partner are you?|(((
25 Answer options:
26
27 * First responder (USAR)
28 * First responder Team Lead (USAR)
29 * First responder Paramedic (USAR)
30 * Firefighter
31 * Firefighter Team Lead
32 * Tech partner
33 * Other:
34 )))
35
36 The questionnaire for the WEARIN’ body sensor data is detailed in the table below.
37
38 |(% colspan="2" %)WEARIN’ health data
39 |Q: What types of health data do you think helps determines the status of a First responder?|Open answer
40 |Q: Which data should have the highest priority? (and how should it be communicated?)|Open answer
41 |Q: How is health data currently communicated within an USAR operation?|Open answer
42 |Q: How can we display health data in a helpful manner?|Open answer
43 |(% colspan="2" %)(((
44
45
46 |
47 | |[[image:1751972821005-693.png]]
48
49
50 This visualization that is presented during the next two questions.
51 Visual description: What types of medical data do you think is useful for people at the USAR Basecamp (tactical), and what kind of data is useful for people that work in the field (operational)?
52 )))
53 |Q: What medical data would be useful for the people at USAR basecamp? (tactical)|Open answer
54 |Q: What medical data would be useful for the people at the operational worksite? (operational)|Open answer
55 |(% colspan="2" %)(((
56 [[image:1751972821009-634.png]]
57 This visualization is presented during the next ten questions.
58
59
60 Visual description: We have selected these roles that could benefit from seeing medical data, divided again in tactical and operational roles. What type of information should each role see according to you? And why?
61 )))
62 |Q: How important is seeing medical data to the Team Lead role? (Tactical)|Likert scale
63 |Q: Why? What type of information would be relevant?|Open answer
64 |Q: How important is seeing medical data to the Medical staff? (Tactical)|Likert scale
65 |Q: Why? What type of information would be relevant?|Open answer
66 |Q: How important is seeing medical data to the Squad leader role? (Operational)|Likert scale
67 |Q: Why? What type of information would be relevant?|Open answer
68 |Q: How important is seeing medical data to the Paramedic? (Operational)|Likert scale
69 |Why? What type of information would be relevant?|Open answer
70 |Q: How important is seeing medical data to the First responder itself? (Operational)|Likert scale
71 |Q: Why? What type of information would be relevant?|Open answer
72 |(% colspan="2" %)(((
73
74
75 |
76 | |[[image:1751972821011-457.png]]
77
78
79 This visualization is presented during the next questions.
80 Visualization description: Which roles do you think might also need some type of access to medical information? Why?
81 )))
82 |Q: Fill in which other roles could be relevant and why|Open answer
83 |(% colspan="2" %)(((
84
85
86 | | | |
87 | |[[image:1751972821013-625.png]]| |[[image:1751972821015-169.png]]
88
89
90 These visualizations is presented during the next ten questions.
91 Visualization description: We have created sketches of possibilities to display the health data. The first screen shows the health status of all teams, while the second screen is zoomed in on one team and its members. How important is it to see these screens for the following roles?
92 )))
93 |Q: How important is the first screen for the Team Lead?|Likert scale
94 |Q: How important is the first screen for the Medical Staff?|Likert scale
95 |Q: How important is the first screen for the Squad leader?|Likert scale
96 |Q: How important is the first screen for the Paramedic?|Likert scale
97 |Q: How important is the first screen for the First Responder itself?|Likert scale
98 |Q: How important is the second screen for the Team Lead?|Likert scale
99 |Q: How important is the second screen for the Medical Staff?|Likert scale
100 |Q: How important is the second screen for the Squad leader?|Likert scale
101 |Q: How important is the second screen for the Paramedic?|Likert scale
102 |Q: How important is the second screen for the First Responder itself?|Likert scale
103 |(% colspan="2" %)(((
104
105
106 |
107 | |[[image:1751972821015-618.png]]
108
109
110 This visualization is presented during the next seven questions.
111 Visualization description: This screen shows a **summarized status view** of the medical data. The square with the cross icon shows the current status of the first responder and can turn green to indicate that the status is good and can turn orange to indicate that the status is not good. An alert can also be presented with the red triangle, this indicates an upcoming (predicted) or a large change in status.
112 )))
113 |Q: How important is the second screen for the Team Lead?|Likert scale
114 |Q: How important is the second screen for the Medical Staff?|Likert scale
115 |Q: How important is the second screen for the Squad leader?|Likert scale
116 |Q: How important is the second screen for the Paramedic?|Likert scale
117 |Q: How important is this screen for the First Responder itself?|Likert scale
118 |Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
119 |Q: Is there something missing from this view?|Open answer
120 |(% colspan="2" %)(((
121
122
123 |
124 | |[[image:1751972821016-346.png]]
125
126
127 This visualization is presented during the next questions.
128 Visualization description: This screen shows **detailed raw health data** of different team members. It shows it both in a graphs as in data points.
129 )))
130 |Q: How important is the second screen for the Team Lead?|Likert scale
131 |Q: How important is the second screen for the Medical Staff?|Likert scale
132 |Q: How important is the second screen for the Squad leader?|Likert scale
133 |Q: How important is the second screen for the Paramedic?|Likert scale
134 |Q: How important is this screen for the First Responder itself?|Likert scale
135 |Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
136 |Q: Is there something missing from this view?|Open answer
137 |(% colspan="2" %)(((
138
139
140 |
141 | |[[image:1751972821017-499.png]]
142
143
144 This visualization is presented during the next questions.
145 Visualization description: This screen shows **Aggregated health data** of different team members, combined in a way to show.
146 )))
147 |Q: How important is the second screen for the Team Lead?|Likert scale
148 |Q: How important is the second screen for the Medical Staff?|Likert scale
149 |Q: How important is the second screen for the Squad leader?|Likert scale
150 |Q: How important is the second screen for the Paramedic?|Likert scale
151 |Q: How important is this screen for the First Responder itself?|Likert scale
152 |Q: Do you think this is a good way to display the status of a first responder? Why or why not?|Open answer
153 |Q: Is there something missing from this view?|Open answer
154 |(% colspan="2" %)(((
155
156
157 |
158 | |[[image:1751972821017-270.png]]
159
160
161 This visualization is presented during the next questions.
162 Visualization description: This screen shows **Predicted health data** of the possible future health status of team members, including advice about future actions that should be taken to keep the First Responders safe.
163 )))
164 |Q: How important is the second screen for the Team Lead?|Likert scale
165 |Q: How important is the second screen for the Medical Staff?|Likert scale
166 |Q: How important is the second screen for the Squad leader?|Likert scale
167 |Q: How important is the second screen for the Paramedic?|Likert scale
168 |Q: How important is this screen for the First Responder itself?|Likert scale
169 |Q: Do you think this is a good way to display the predictions about the first responder's health? Why or why not?|Open answer
170 |Q: What do you think of this advice function, does it explain enough? What else would you want to know when making a decision?|Open answer
171
Tjalling Haije 1.1 172 == 2.3 Tasks ==
173
174
175 == 2.4 Measures ==
176
177
178 == 2.5 Procedure ==
179
180
181 == 2.6 Material ==
182
183
184 = 3. Results =
185
186
187 = 4. Discussion =
188
189
190 = 5. Conclusions =
Rosa Van Tuijn 2.1 191
192 **Health data**
193
194 Types of health data: heart rate, respiratory rate, body temperature, blood pressure, and mental health were frequently mentioned as essential.
195
196 Reasoning given for roles
197
198 * Team Lead - Important for monitoring the overall safety of teams.
199 * Medical Personnel - Essential for making critical decisions.
200 * Paramedic (Operational) - Necessary for directly treating team members.
201 * First Responder - Relevant for personal health and well-being.
202
203 Conclusion: Health data is essential for a wide range of roles, but the requirements vary greatly. Medical personnel and paramedics request detailed and contextual data, while team leaders and first responders value summaries and simple alerts more. Transparency in predictive models is necessary to build trust.
204
205
206 **Location data**
207
208 Types of Location data: Location data such as GPS coordinates, building heights, and paths to victims were frequently mentioned.
209
210 Reasoning given for roles
211
212 * Team Lead - Essential for team coordination.
213 * Squad leader (Operational) - Necessary for instructing team members.
214 * First Responder - Helps with orientation and finding victims.
215
216 Conclusion: Location data plays a crucial role in both tactical and operational decisions. Tactical team leaders want aggregated and sector-based data, while operational roles such as squad leaders and first responders need detailed and real-time information. 3D maps and interactive elements are valuable tools to improve navigation and coordination.
217
218
219 **Communication data**
220
221 Types of communication data: Respondents emphasized the importance of RSSI (signal strength), signal speed, and interference detection.
222
223 Reasoning given for roles
224
225 * Team Lead - Important for monitoring team connectivity.
226 * IT Specialist - Crucial for troubleshooting.
227 * Squad leader (Operational) - Relevant for field communication.
228 * First Responder - Only needed for personal connectivity.
229
230 Conclusion: Communication plays a central role at all levels of USAR operations. Tactical users need extensive analyses to monitor team status, while operational roles such as IT specialists focus on technical troubleshooting. Advisory functions and visual simplicity could contribute to effectiveness in the field.