Skip to Content

i. Design Patterns Evaluation SFT1

Version 2.5 by Tjalling Haije on 2026/07/27 12:07

Approach

The goal for the human-machine teaming framework is to (among others) develop human-machine teaming patterns that can be used to use technology

Design patterns of interest: 

Approaches for evaluating DPs:

  1. Make new usecases based on how the FR actually did the TDP and IDP with the robots with claims and check those with the raw data. 
  2. Match the premade usecase UC04.3: Detailed indoor exploration with ANYMAL (USAR) with the incident that fits best, and evaluate the claims for the TDP and IDP of interest using results from that incident. 

Choosing approach 2 because it has been prepared better, and helps in improving the evaluation approach for SFT 2 by identifying what info we missed. 

Design Patterns Evaluation

Approach: 

  1. Figure out in which incidents TDP2 and IDP1 were used
  2. Check if the tech worked as required (or good enough to be of value) in those incidents
  3. Figure out which of those incidents correspond most with UC04.3: Detailed indoor exploration with ANYMAL (USAR)
  4. Try to fill in j. SFT1 evaluation templates from the raw results, which 
  5. Check for each of the claims the results for the connected measures > Evaluates UC
  6. Check for each of the pros/cons for the Design Pattern if they are validated > Evaluates Design Pattern
  7. Adjust the Design Patterns based on the results and/or their expected pros/cons.
  8. Update how the users should use the technology and/or the technology itself to achieve the objectives. 
  9. Note missing data that should be included in the evaluation next time.

Design Patterns per Incident

IncidentIncident DescriptionRobots usedDesign Patterns
Incident 1

A collision caused by a major explosion has left casualties trapped in vehicles and created a hazardous chemical leak from a truck. The goal of the fire service is to rescue the casualties, identify and contain the chemical hazard, and safely manage the incident.

  
Incident 2

An explosion has caused the partial collapse of multiple industrial and office buildings, leaving an unknown number of people trapped or missing. The goal of the Urban Search and Rescue (USAR) teams and drone team is to assess the damage, locate and rescue victims, manage responder safety during a secondary collapse, and clear all affected buildings.

Incident 3 

A blast has left victims stranded on the upper floors of a high-rise residential building. The goal of the fire crew and drone team is to assess the building, locate and safely rescue the trapped occupants using ladder access, and clear the building.

 
Incident 4

A gas explosion and fire in a four-apartment residential building have left multiple occupants trapped and created a hazardous environment for firefighters conducting search, rescue, and firefighting operations. The goal of the fire crews is to extinguish the fire, rescue all occupants, manage firefighter safety during an emergency involving a downed rescuer, and clear the building.