Use of Behavioural Markers to Assess Performance on K-Offshore Simulators

Behavioural Markers for K-Sim Offshore
Kalyan Chatterjea – EMAS Training Academy & Simulation Centre
December 2014
ASIA/PACIFIC simulator user conference 2014
Cebu, Philippines, December, 2-3

Agenda
Assessing Performance
Behavioural Markers (BMs)
Categories for BMs
Examples of BMs

Maritime Education & Training
Developing Competencies
Knowledge-based
Training (KBT)
Skill-based Training
(SBT)
Non-technical
Skills [NOTECHS]
…Traditional Classroom
covering underpinning
knowledge
...With the advent of STCW
Simulators were introduced
to impart technical proficiency
…With the revised STCW
2010, we need to hone
our soft-skills covering
all the non-technical
skills

Non-technical Skills
& Organisational Safety
Now it is conclusively proven that, these
non-technical skills (also referred to as
Soft Skills) have significant influence in
Organisational Safety!

Organisational Safety
– Prof Rhona Flin (Feb 2013)
Soft-skills
[NOTECHS]
Ref: http://www.kingsfund.org.uk/sites/files/kf/rhona-flin-safety-culture-kingsfund-feb13.pdf

Defining Safety
– Prof Rhona Flin (Feb 2013)
The Health and Safety Executive in the UK
defines the safety culture of an organisation as
‘the product of individual and group values,
attitudes, and perceptions, competencies, and…
patterns of behaviour that determine the
commitment to, and the style and proficiency of,
an organisation’s health and safety management’.
Ref: http://www.kingsfund.org.uk/sites/files/kf/rhona-flin-safety-culture-kingsfund-feb13.pdf

Assessment of Behavioural Skills
… Flight-crew Human Factors Handbook, Oct 2014
• The only realistic method available was the
observation of crew behaviour, and this is still the case
today.
• There are major problems with this method, mostly
stemming from its subjective nature; for example it is
not an inherently reliable system (one trainer may
judge things very differently to another, or even
themselves on a different day).
• In an attempt to resolve these issues, scientifically
established methods of behavioural observation were
adapted for use within aviation training and
assessment.

• A well-established scientific method for recording and
analysing behaviour is the construction of lists (or
taxonomies) of behaviours that the scientists expect to
see (the items in the list can be called behavioural
descriptors).
• The observer refers to the list while watching the
activity (or a recording of it) and notes each of the
behaviours as they notice them occurring.
• This process is usually repeated for samples of
people.

• Using scales of this sort, scientists can produce
data about peoples’ behaviour, and this can be
analysed alongside factors such as peoples’
performance.
• The adjustment of this sort of methodology for
assessing the behaviour of a flight deck crew
during a single session is still debated, but is
nevertheless firmly established in the form of
behaviour marker systems.

• The general idea behind behavioural marker
systems is to provide a set of descriptors that
when identified by the instructor or trainer,
indicate effective (and in some marker systems,
ineffective) CRM behaviours.
• Hence, a key principle of the system is that
trainers are able to recognise the behaviours
consistently in the training environment.
• Many marker systems have been produced and a
variety of consistency measures have been
attempted in order to demonstrate their
consistency.

• The University of Texas (UT) system is considered to
be the first major behaviour marker scheme and was
developed from research by Helmriech et al. in the
early days of CRM.
• It was subsequently used as the basis for many
airlines’ behaviour marker schemes (Flin and Martin
2001).
• The UT scheme splits CRM into 13 general elements,
each one being accompanied by a number of
exemplar behaviours used to assist the trainer /
examiner to identify only good CRM performance.

… Prof. Rhona Flin, 2003
• NOTECHS
System
developed
by R Flin et
al. in 2003

Assessing Performance:
Behavioural Markers – Defined
 Behavioral markers  specific behaviors that serve as
indicators of how effectively crew resource management
skills are being practiced.
 They are not intended to be exhaustive, but rather as good
behaviours/poor behaviour associated with effective/
ineffective crew resource management.
 When considering each behavioral marker, the observer is
asked:
 Was the behavior present or absent?
 How critical was the behavior in the situation?
 Was it effective?
 How did the behavior contribute to the overall
management of the task?

Assessing Performance:
Behavioural Markers – Defined
 An effective behavioural marker should be:
 Having a clear relationship to the competence being
assessed
 Easily evaluated as a demonstration of good or poor
behaviour
 Easily observable and not an attitude or personality
trait
 Occurring frequently but need not be present at all
times
 User-friendly for domain assessors
 Positive as well as negative (for easy differentiation)

Offshore Operations:
Non-technical Skill Framework
Human Factors
Social Skills
Cognitive Skills

NTS Group ~ Human Factors:
Elements of Error Handling
Human Factors
ELEMENTS of Error Handling
1. Analysing Errors
2. Mitigating Errors
3. Trapping Errors
4. Managing Failures

NTS Group ~ Social Skills:
Elements of Communication
ELEMENTS of Communication
1. Providing information
2. Receiving information
3. Conducive body language
4. Briefings & debriefings
5. Using standard phrases
Social Skills

NTS Group ~ Cognitive Skills:
Elements of Task Management
ELEMENTS of Task Management
1. Planning
2. Prioritising
3. Distributing Workload/Resources
4. Providing & Maintaining Standards
(SOP) requirements
Cognitive Skills

Elements & BMs for Category:
Communication

Elements & BMs for Category:
Teamwork

Ratings Scale for BMs:
Suggested by Klampfer et al.(2001)

Use of Behavioral Markers
Bridge Resource Management Course
Man Over Board
Exercise – Run 1
Man Over Board
Exercise – Run 2

Use of Behavioral Markers
Bridge Resource Management Course

Simulator Scenes @ EMAS Academy
During an Assessment Exercise

Future of Behavioural Markers
… Katherine Devitt & Capt. Simon Holford
Warsash Maritime Academy**
• BMs will enable industry to assess the
performance of the deck & engine room
teams and to improve selection, training &
promotional processes
• We have to create BMs for these purposes
and get them validated against the
framework of STCW
**Ref: Devitt et Al. (2012) - The Validation of Non-Technical Behavioural Markers
for Merchant Navy Officers

Our Publication on BRM
Sharing Our Experience on Soft Skill Assessment

Thank You!
Disclaimer: This material includes forward-looking statements prepared by Ezra Holdings Limited (“Company”). The opinions, forecasts, projections or other statements other than statements of historical fact, including, without limitation, estimates of
proved reserves of oil and gas, reserves potential and plans and objectives of management of the Company for financing, are forward-looking statements. Although the Company believes that the expectations reflected in such forward-looking
statements are reasonable, it can give no assurance that such expectations will prove to have been correct. All forward looking-statements contained in this presentation are expressly qualified in their entirety by the cautionary statements contained or
referred to in this section. Readers should not place undue reliance on forward-looking statements. Each forward looking statement speaks only as of the date of this presentation. Neither the Company nor any of its subsidiaries and associates
undertake any obligation to publicly update or revise any forward-looking statement as a result of new information, future events or other information. In light of these risks, results could differ materially from those stated, implied or inferred from the
forward-looking statements contained in this presentation.

Use of Behavioural Markers to Assess Performance on K-Offshore Simulators

More Related Content

Similar to Use of Behavioural Markers to Assess Performance on K-Offshore Simulators (20)

More from WAVELINK MARITIME INSTITUTE PTE LTD (20)

Recently uploaded (20)

Use of Behavioural Markers to Assess Performance on K-Offshore Simulators

Editor's Notes