i. TDPs evaluation SFT1
Version 1.1 by Tjalling Haije on 2026/07/27 10:30
Design patterns of interest:
- TDP2 — Robots First, Then Humans Protocol
- IDP1 — Role-Based, Context-Specific Information Distribution
Approaches for evaluating DPs:
- Make new usecases based on how the FR actually did the TDP and IDP with the robots with claims and check those with the raw data.
- Match the premade usecase UC04.3: Detailed indoor exploration with ANYMAL (USAR) with the incident that fits best, and evaluate the claims for the TDP and IDP of interest using results from that incident.
Choosing approach 2 because it has been prepared better, and helps in improving the evaluation approach for SFT 2 by identifying what info we missed.
Design Patterns Evaluation
Approach:
- Figure out which incidents TDP2 and IDP1 were used
- Check if the tech worked as required (or good enough to be of value) in those incidents
- Figure out which of those incidents correspond most with UC04.3: Detailed indoor exploration with ANYMAL (USAR)
- Try to fill in j. SFT1 evaluation templates from the raw results, which
- Check for each of the claims the results for the connected measures