Project homeWiki source code of i. Design Patterns Evaluation SFT1
Version 2.2 by Tjalling Haije on 2026/07/27 10:41
Hide last authors
| author | version | line-number | content |
|---|---|---|---|
 |
2.2 | 1 | == Approach == |
| |
1.1 | 2 | |
| |
2.2 | 3 | The goal for the human-machine teaming framework is to (among others) develop human-machine teaming patterns that can be used to use technology |
| 4 | |||
| 5 | **Design patterns of interest: ** | ||
| 6 | |||
| |
1.1 | 7 | * [[TDP2 — Robots First, Then Humans Protocol>>2\. Specification.Requirements.TDP2 — Robots First, Then Humans Protocol.WebHome]] |
| 8 | * [[IDP1 — Role-Based, Context-Specific Information Distribution>>2\. Specification.Requirements.IDP1 — Role-Based, Context-Specific Information Distribution.WebHome]] | ||
| 9 | |||
| |
2.2 | 10 | **Approaches for evaluating DPs:** |
| |
1.1 | 11 | |
| 12 | 1. Make new usecases based on how the FR actually did the TDP and IDP with the robots with claims and check those with the raw data. | ||
| 13 | 1. Match the premade usecase [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] with the incident that fits best, and evaluate the claims for the TDP and IDP of interest using results from that incident. | ||
| 14 | |||
| 15 | Choosing approach 2 because it has been prepared better, and helps in improving the evaluation approach for SFT 2 by identifying what info we missed. | ||
| 16 | |||
| 17 | |||
| 18 | == Design Patterns Evaluation == | ||
| 19 | |||
| 20 | Approach: | ||
| 21 | |||
| |
1.5 | 22 | 1. Figure out in which incidents TDP2 and IDP1 were used |
| |
1.4 | 23 | 1. Check if the tech worked as required (or good enough to be of value) in those incidents |
| 24 | 1. Figure out which of those incidents correspond most with [[UC04.3: Detailed indoor exploration with ANYMAL (USAR)>>2\. Specification.b\. Use Cases.UC04\.0\: Detailed indoor exploration.UC04\.3\: Detailed indoor exploration with ANYMAL (USAR).WebHome]] | ||
| 25 | 1. Try to fill in [[j. SFT1 evaluation templates >>3\. Evaluation.SFT1.g\. Prototype .WebHome]]from the raw results, which | ||
| 26 | 1. Check for each of the claims the results for the connected measures > Evaluates UC | ||
| 27 | 1. Check for each of the pros/cons for the Design Pattern if they are validated > Evaluates Design Pattern | ||
| 28 | 1. Adjust the Design Patterns based on the results and/or their expected pros/cons. | ||
| 29 | 1. Update how the users should use the technology and/or the technology itself to achieve the objectives. | ||
| 30 | 1. Note missing data that should be included in the evaluation next time. | ||
| |
1.5 | 31 | |
| 32 | == Design Patterns per Incident == | ||
| 33 | |||
| 34 | |**Incident**|**Design Pattern** | ||
| 35 | | | | ||
| 36 | | | | ||
| 37 | | | | ||
| 38 | | | | ||
| 39 | |||
| 40 |