j. SFT1 evaluation templates

1

= General =

2

3

[[image:1776255113603-367.png]]

4

5

6

|**Baseline phases**|**Who fills it**|**Main purpose**

7

|//Briefing//|-|-

8

|//Estimate building integrity//|-|-

9

|//Shoring//|Particpants|(make estimation about shoring time)

10

|//Before sending in FRs (DM)//|Participant|Ground truth/ baseline SA

11

|//Send in FRs, identify voids, DM//|Evaluation leader|Objective performance, safety, timing, decision making

12

|//FRs exit building//|Participant|Subjective SA, trust, workload, decision making

13

|//Hotwash//| |

14

15

|(% style="width:414px" %)**SYNERGISE phases**|(% style="width:245px" %)**Who fills it**|(% style="width:690px" %)**Main purpose**

16

|(% style="width:414px" %)//Briefing//|(% style="width:245px" %)-|(% style="width:690px" %)-

17

|(% style="width:414px" %)//Estimate building integrity//|(% style="width:245px" %)-|(% style="width:690px" %)-

18

|(% style="width:414px" %)//Send in robots, identify voids with robots//|(% style="width:245px" %)-|(% style="width:690px" %)-

19

|(% style="width:414px" %)//Decision Making (DM)//|(% style="width:245px" %)Participants (Squad/ team leader)|(% style="width:690px" %)Ground truth/ baseline SA

20

|(% style="width:414px" %)//Send in FRs ?//|(% style="width:245px" %)Evaluation leader|(% style="width:690px" %)Objective performance, safety, timing, decision making

21

|(% style="width:414px" %)//After test//|(% style="width:245px" %)Paricipant|(% style="width:690px" %)Subjective SA, trust, workload, decision making

22

|(% style="width:414px" %)//Hotwash//|(% style="width:245px" %) |(% style="width:690px" %)

23

24

(% class="wikigeneratedid" %)

25

List of ground truths needed for comparison:

26

27

* Health ranges

28

* hazards/ victims in buildings

29

* Safest path within buildings

30

* State of automation (tech question)

=== Before ===

|**Role**|**What needs to be filled in it**|**Main purpose**

37

|//Base of Operations//|Initial situation awareness (layout building and hazards)|SA comparison

38

|//Squad/ Team leader//|Initial situation awareness (layout building and hazards)|SA comparison

39

|//Robot operator//|Initial situation awareness (layout building and hazards)|SA comparison

40

|//Robot analyst//|Initial situation awareness (layout building and hazards)|SA comparison

41

|//Entry team//|Initial situation awareness (layout building and hazards)|SA comparison

42

|//Evaluation leader (BoO)//|(((

43

Record: amount partipicpants, participant roles, type trial/ buidling, date/ time*

44

45

Record: System & mission readiness~*~*

46

)))|-

47

|//Evaluation leader (Field; indoor exploration)//|(((

48

Record: amount partipicpants, participant roles, type trial/ buidling, date/ time*

49

50

Record: System & mission readiness~*~*

51

)))|-

52

|//Evaluation leader (Field: ...)//|(((

-

)))|-

=== During ===

|**Role**|**What needs to be filled in it**|**Main purpose**

61

|//Base of Operations//| |

62

|//Squad/ Team leader//| |

63

|//Robot operator//| |

64

|//Robot analyst//| |

65

|//Entry team//| |

66

|//Evaluation leader (BoO)//|(((

67

Threshold breached, alert and intervention record*

68

)))|

69

|//Evaluation leader (Field; indoor exploration)//|(((

70

Safety observation~*~*

71

72

Path deviations observed~*~**

73

74

Safety observations~*~**

75

)))|

76

|//Evaluation leader (Field: ...)//|-|-

**Safety observations (evaluation leader)~*~* **

82

83

☐ No unsafe situations observed

84

☐ Unsafe / near‑incident observed → describe:

85

86

87

**Path deviations observed~*~****

88

89

//(Check if the entry team takes the route that is discussed before entering)//

90

91

☐ None ☐ Minor ☐ Major

92

93

94

**Safety observations~*~*~*~***

=== After ===

== Template: Base of Operations (BoO/ HQ) ==

102

103

104

== Template: Evaluation leader (BoO/ HQ) ==

105

106

**Pre-entry situation awareness sketch (participant)**

107

108

Sketch or describe //hazards, victims, layout// as you currently understand them.

//(Sketch space)//

(% class="table-bordered" %)

114

|(% colspan="2" %)(((

115

== Template: Evaluation leader (Field) ==

116

)))

117

|(% colspan="2" %)(((

**General: **

//Participants roles (encircle)//: BoO/ Suad leader / Team leader / Robot operator / Robot analyst / Entry team | //Trial type/ Building/ scenario//: ............................................ | //Date/ Time//: ..........................................

122

)))

123

|(((

124

**System & mission readiness**

125

126

//(Tick list based on predefined acceptable ranges. Cross out if not applicable.)//

127

)))|(((

128

☐ C3I operational, describe: ...................................................................................................................................

129

130

☐ Health & location sensors connected, describe: .................................................................................................

131

132

☐ Acceptable/ baseline health ranges defined (HR, temperature, etc.), describe: .................................................

133

134

☐ OWL operational, describe: .................................................................................................................................

135

136

☐ ANYmal operational, describe: ............................................................................................................................

137

138

☐ ANYmal with robot arm operational, describe: ....................................................................................................

139

140

☐ ANYmal with SNAKE, describe: ..........................................................................................................................

141

)))

142

|(% colspan="2" %)**During**

143

|(((

144

**Threshold breached, alert and intervention record **

145

)))|(((

146

Health threshold breached (timestamp + action taken)