i. TDPs evaluation SFT1

Version 1.2 by Tjalling Haije on 2026/07/27 10:31

Design patterns of interest: 

Approaches for evaluating DPs:

  1. Make new usecases based on how the FR actually did the TDP and IDP with the robots with claims and check those with the raw data. 
  2. Match the premade usecase UC04.3: Detailed indoor exploration with ANYMAL (USAR) with the incident that fits best, and evaluate the claims for the TDP and IDP of interest using results from that incident. 

Choosing approach 2 because it has been prepared better, and helps in improving the evaluation approach for SFT 2 by identifying what info we missed. 

Design Patterns Evaluation

Approach: 

  • Figure out which incidents TDP2 and IDP1 were used
  • Check if the tech worked as required (or good enough to be of value) in those incidents
  • Figure out which of those incidents correspond most with UC04.3: Detailed indoor exploration with ANYMAL (USAR)
  • Try to fill in j. SFT1 evaluation templates from the raw results, which 
  • Check for each of the claims the results for the connected measures > Evaluates UC
  • Check for each of the claims for the TDP / IDP if they are validated > Evaluates TDP/IDP