Project homej. SFT1 evaluation templates
General
| Baseline phases | Who fills it | Main purpose |
| Briefing | - | - |
| Estimate building integrity | - | - |
| Shoring | Particpants | (make estimation about shoring time) |
| Before sending in FRs (DM) | Participant | Ground truth/ baseline SA |
| Send in FRs, identify voids, DM | Evaluation leader | Objective performance, safety, timing, decision making |
| FRs exit building | Participant | Subjective SA, trust, workload, decision making |
| Hotwash |
| SYNERGISE phases | Who fills it | Main purpose |
| Briefing | - | - |
| Estimate building integrity | - | - |
| Send in robots, identify voids with robots | - | - |
| Decision Making (DM) | Participants (Squad/ team leader) | Ground truth/ baseline SA |
| Send in FRs ? | Evaluation leader | Objective performance, safety, timing, decision making |
| After test | Paricipant | Subjective SA, trust, workload, decision making |
| Hotwash |
List of ground truths needed for comparison:
- Health ranges
- hazards/ victims in buildings
- Safest path within buildings
- State of automation (tech question)
Before
| Role | What needs to be filled in it | Main purpose |
| Base of Operations | Initial situation awareness (layout building and hazards) | SA comparison |
| Squad/ Team leader | Initial situation awareness (layout building and hazards) | SA comparison |
| Robot operator | Initial situation awareness (layout building and hazards) | SA comparison |
| Robot analyst | Initial situation awareness (layout building and hazards) | SA comparison |
| Entry team | Initial situation awareness (layout building and hazards) | SA comparison |
| Evaluation leader (BoO) | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness** | - |
| Evaluation leader (Field; indoor exploration) | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* Record: System & mission readiness** | - |
| Evaluation leader (Field: ...) | - | - |
During
| Role | What needs to be filled in it | Main purpose |
| Base of Operations | ||
| Squad/ Team leader | ||
| Robot operator | ||
| Robot analyst | ||
| Entry team | ||
| Evaluation leader (BoO) | Threshold breached, alert and intervention record* | |
| Evaluation leader (Field; indoor exploration) | Safety observation** Path deviations observed*** Safety observations*** | |
| Evaluation leader (Field: ...) | - | - |
After
Templates per role
Template: Base of Operations LEMA (BoO/ HQ) | |
General: Participants roles (encircle): BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team | Trial type/ Building/ scenario: ............................................ | Date/ Time: .......................................... | |
|
|
Template: Evaluation leader (Field) | |
| Before start scenario | |
General: Participants roles (encircle): BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team | Trial type/ Building/ scenario: ............................................ | Date/ Time: .......................................... | |
System & mission readiness (Tick list based on predefined acceptable ranges. Cross out if not applicable.) | ☐ C3I operational, describe: ....................................................................................................................................................................................................................... ☐ Health & location sensors connected, describe: ..................................................................................................................................................................................... ☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe: ..................................................................................................................................... ☐ OWL operational, describe: ..................................................................................................................................................................................................................... ☐ ANYmal operational, describe: ................................................................................................................................................................................................................ ☐ ANYmal with robot arm operational, describe: ........................................................................................................................................................................................ ☐ ANYmal with SNAKE, describe: .............................................................................................................................................................................................................. |
| During start scenario: | |
| Let Team leader (and entry team?) sketch/ describe hazard, victims, layout | Notes:
|
Threshold breached, alert and intervention record | Health threshold breached (timestamp + action taken) Alert detection by system (timestamp + action taken) Intervention started (timestamp + action taken) |
| When humans enter a building/ hazard zone | |
Time within building/ hazard zone | Timestamp of entering:..................................................................................... | Timestamp of exiting:........................................................................................................... |
Safety observations | ☐ No unsafe situations observed ......................................................................................................................................................................................................................................................................... |
Path deviations observed (Check if the entry team takes the route that is discussed before entering) | ☐ None ☐ Minor ☐ Major notes: |
Template: Squad/ Team leader (Field) | |
General: Participants roles (encircle): BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team | Trial type/ Building/ scenario: ............................................ | Date/ Time: .......................................... | |
Pre-entry situation awareness sketch (participant) Sketch or describe hazards, victims, layout as you currently understand them. Predict victims, triage. | (Sketch space)
|
Template: Robot operator (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)
Template: Robot analyst (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)
Template: Entry team (Field)
Pre-entry situation awareness sketch (participant)
Sketch or describe hazards, victims, layout as you currently understand them.
(Sketch space)