Based on SYNERGISE objectives. 

First responder safety

Link to objectives: 

• OB04: Improve safety by providing overviews and warnings of environment conditions
• OB03: Improve first responder health through monitoring of physical and mental state  

Measures

• Exposure to hazards, e.g. time in structurally compromised buildings, hot/ warm zones or hazardous atmospheres
• FR physical and mental health, e.g. health incidents (such as heat stress, dehydaration, FR collapse), medical interventions, physiological sensor values (such as heart rate, core body temperature compared to “safe” bounds), (self-reported) fatigue
• Near-misses & accidents, e.g. near misses, hazards reported, medical evacuations, injuries, accidents

Situational Awareness

Link to objectives:

• Note: SA is not an objective in itself. But it supports the objectives: 
• OB01: Increase effectiveness through exploration, sensing and communication means 
• OB04: Improve safety by providing overviews and warnings of environment conditions 

Measures: 

• Common Operational Picture Accuracy, ENGAGE vs ground truth, including location of victims, hazards, and FR as specified in the SYNERGISE system. To compare with the ground truth. Then categorize in localization error in meters, completeness, false positives.         
• After mission SA assessment, e.g. self-reported SA e.g. same as COP, but ask them to individual FRs based on memory.
• Proxy for SA, e.g. less unexpected hazard encounters: compare how many hazards were encountered unexpectedly with human in the vicinity or compare less navigation errors.

Mission Effectiveness

Link to objectives: 

• OB01: Increase effectiveness through exploration, sensing and communication means 

Measures: 

• Victim detection, e.g. percentage found, time before finding victim from start of mission, time to rescue from start of mission
• Search completeness: how many rooms were searched (by human or robot)
• Hazard identification and mitigation: how many were identified (e.g. closing calve to contain a gas leak), how many missing, how many incorrect
• Decision Quality

Mission Efficiency

Link to objectives: 

• OB02: Increase efficiency through insights in resource availability and utilization 

Measures: 

• Mission completion time
• Victim detection and rescue speed, e.g. time before finding victim from start of mission and time to rescue from start of mission
• Hazard detection speed, e.g. average time before finding hazards from start of mission
• Average workload of first responder, e.g. verified questionnaire during scenario and/ er questionnaire after the scenario