Wiki source code of j. SFT1 evaluation templates
Version 11.1 by Rosa Van Tuijn on 2026/04/15 12:43
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | = General = | ||
| 2 | |||
| 3 | [[image:1776255113603-367.png]] | ||
| 4 | |||
| 5 | |||
| 6 | |**Baseline phases**|**Who fills it**|**Main purpose** | ||
| 7 | |//Briefing//|-|- | ||
| 8 | |//Estimate building integrity//|-|- | ||
| 9 | |//Shoring//|Particpants|(make estimation about shoring time) | ||
| 10 | |//Before sending in FRs (DM)//|Participant|Ground truth/ baseline SA | ||
| 11 | |//Send in FRs, identify voids, DM//|Evaluation leader|Objective performance, safety, timing, decision making | ||
| 12 | |//FRs exit building//|Participant|Subjective SA, trust, workload, decision making | ||
| 13 | |//Hotwash//| | | ||
| 14 | |||
| 15 | |(% style="width:414px" %)**SYNERGISE phases**|(% style="width:245px" %)**Who fills it**|(% style="width:690px" %)**Main purpose** | ||
| 16 | |(% style="width:414px" %)//Briefing//|(% style="width:245px" %)-|(% style="width:690px" %)- | ||
| 17 | |(% style="width:414px" %)//Estimate building integrity//|(% style="width:245px" %)-|(% style="width:690px" %)- | ||
| 18 | |(% style="width:414px" %)//Send in robots, identify voids with robots//|(% style="width:245px" %)-|(% style="width:690px" %)- | ||
| 19 | |(% style="width:414px" %)//Decision Making (DM)//|(% style="width:245px" %)Participants (Squad/ team leader)|(% style="width:690px" %)Ground truth/ baseline SA | ||
| 20 | |(% style="width:414px" %)//Send in FRs ?//|(% style="width:245px" %)Evaluation leader|(% style="width:690px" %)Objective performance, safety, timing, decision making | ||
| 21 | |(% style="width:414px" %)//After test//|(% style="width:245px" %)Paricipant|(% style="width:690px" %)Subjective SA, trust, workload, decision making | ||
| 22 | |(% style="width:414px" %)//Hotwash//|(% style="width:245px" %) |(% style="width:690px" %) | ||
| 23 | |||
| 24 | (% class="wikigeneratedid" %) | ||
| 25 | List of ground truths needed for comparison: | ||
| 26 | |||
| 27 | * Health ranges | ||
| 28 | * hazards/ victims in buildings | ||
| 29 | * Safest path within buildings | ||
| 30 | * State of automation (tech question) | ||
| 31 | |||
| 32 | |||
| 33 | |||
| 34 | === Before === | ||
| 35 | |||
| 36 | |**Role**|**What needs to be filled in it**|**Main purpose** | ||
| 37 | |//Base of Operations//|Initial situation awareness (layout building and hazards)|SA comparison | ||
| 38 | |//Squad/ Team leader//|Initial situation awareness (layout building and hazards)|SA comparison | ||
| 39 | |//Robot operator//|Initial situation awareness (layout building and hazards)|SA comparison | ||
| 40 | |//Robot analyst//|Initial situation awareness (layout building and hazards)|SA comparison | ||
| 41 | |//Entry team//|Initial situation awareness (layout building and hazards)|SA comparison | ||
| 42 | |//Evaluation leader (BoO)//|((( | ||
| 43 | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* | ||
| 44 | |||
| 45 | Record: System & mission readiness~*~* | ||
| 46 | )))|- | ||
| 47 | |//Evaluation leader (Field; indoor exploration)//|((( | ||
| 48 | Record: amount partipicpants, participant roles, type trial/ buidling, date/ time* | ||
| 49 | |||
| 50 | Record: System & mission readiness~*~* | ||
| 51 | )))|- | ||
| 52 | |//Evaluation leader (Field: ...)//|((( | ||
| 53 | - | ||
| 54 | )))|- | ||
| 55 | |||
| 56 | **Participant/ scenario information (evaluation leader)* ** | ||
| 57 | |||
| 58 | Role: | ||
| 59 | |||
| 60 | Trial type/ Building/ scenario: | ||
| 61 | |||
| 62 | Date/ Time: | ||
| 63 | |||
| 64 | |||
| 65 | **System & mission readiness (evaluation leader)~*~*** | ||
| 66 | |||
| 67 | //(Tick list based on predefined acceptable ranges. Cross out if not applicable.)// | ||
| 68 | |||
| 69 | ☐ C3I operational, describe: | ||
| 70 | |||
| 71 | ☐ Health & location sensors connected, describe: | ||
| 72 | |||
| 73 | ☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe: | ||
| 74 | |||
| 75 | ☐ OWL operational, describe: | ||
| 76 | |||
| 77 | ☐ ANYmal operational, describe: | ||
| 78 | |||
| 79 | ☐ ANYmal with robot arm operational, describe: | ||
| 80 | |||
| 81 | ☐ ANYmal with SNAKE, describe: | ||
| 82 | |||
| 83 | |||
| 84 | === During === | ||
| 85 | |||
| 86 | |**Role**|**What needs to be filled in it**|**Main purpose** | ||
| 87 | |//Base of Operations//| | | ||
| 88 | |//Squad/ Team leader//| | | ||
| 89 | |//Robot operator//| | | ||
| 90 | |//Robot analyst//| | | ||
| 91 | |//Entry team//| | | ||
| 92 | |//Evaluation leader (BoO)//|((( | ||
| 93 | Threshold breached, alert and intervention record* | ||
| 94 | )))| | ||
| 95 | |//Evaluation leader (Field; indoor exploration)//|((( | ||
| 96 | Safety observation~*~* | ||
| 97 | |||
| 98 | Path deviations observed~*~** | ||
| 99 | |||
| 100 | Safety observations~*~** | ||
| 101 | )))| | ||
| 102 | |//Evaluation leader (Field: ...)//|-|- | ||
| 103 | |||
| 104 | **Threshold breached, alert and intervention record (evaluation leader)* ** | ||
| 105 | |||
| 106 | Health threshold breached (timestamp + action taken) | ||
| 107 | |||
| 108 | Alert detection by system (timestamp + action taken) | ||
| 109 | |||
| 110 | Intervention started (timestamp + action taken) | ||
| 111 | |||
| 112 | |||
| 113 | **Safety observations (evaluation leader)~*~* ** | ||
| 114 | |||
| 115 | ☐ No unsafe situations observed | ||
| 116 | ☐ Unsafe / near‑incident observed → describe: | ||
| 117 | |||
| 118 | |||
| 119 | **Path deviations observed~*~**** | ||
| 120 | |||
| 121 | //(Check if the entry team takes the route that is discussed before entering)// | ||
| 122 | |||
| 123 | ☐ None ☐ Minor ☐ Major | ||
| 124 | |||
| 125 | |||
| 126 | **Safety observations~*~*~*~*** | ||
| 127 | |||
| 128 | |||
| 129 | |||
| 130 | === After === | ||
| 131 | |||
| 132 | |||
| 133 | == Template: Evaluation leader (BoO/ HQ) == | ||
| 134 | |||
| 135 | |||
| 136 | == Template: Base of Operations (BoO/ HQ) == | ||
| 137 | |||
| 138 | **Pre-entry situation awareness sketch (participant)** | ||
| 139 | |||
| 140 | Sketch or describe //hazards, victims, layout// as you currently understand them. | ||
| 141 | |||
| 142 | //(Sketch space)// | ||
| 143 | |||
| 144 | |||
| 145 | (% class="table-bordered" %) | ||
| 146 | |(% colspan="2" %)((( | ||
| 147 | == Template: Evaluation leader (Field) == | ||
| 148 | ))) | ||
| 149 | |(% colspan="2" %)**General: ** | ||
| 150 | | | | ||
| 151 | | | | ||
| 152 | | | | ||
| 153 | |||
| 154 | == Template: Squad/ Team leader (Field) == | ||
| 155 | |||
| 156 | **Pre-entry situation awareness sketch (participant)** | ||
| 157 | |||
| 158 | Sketch or describe //hazards, victims, layout// as you currently understand them. Predict victims, triage. | ||
| 159 | |||
| 160 | //(Sketch space)// | ||
| 161 | |||
| 162 | |||
| 163 | == Template: Robot operator (Field) == | ||
| 164 | |||
| 165 | **Pre-entry situation awareness sketch (participant)** | ||
| 166 | |||
| 167 | Sketch or describe //hazards, victims, layout// as you currently understand them. | ||
| 168 | |||
| 169 | //(Sketch space)// | ||
| 170 | |||
| 171 | |||
| 172 | == Template: Robot analyst (Field) == | ||
| 173 | |||
| 174 | **Pre-entry situation awareness sketch (participant)** | ||
| 175 | |||
| 176 | Sketch or describe //hazards, victims, layout// as you currently understand them. | ||
| 177 | |||
| 178 | //(Sketch space)// | ||
| 179 | |||
| 180 | |||
| 181 | == Template: Entry team (Field) == | ||
| 182 | |||
| 183 | **Pre-entry situation awareness sketch (participant)** | ||
| 184 | |||
| 185 | Sketch or describe //hazards, victims, layout// as you currently understand them. | ||
| 186 | |||
| 187 | //(Sketch space)// | ||
| 188 | |||
| 189 |