Sample Client · Demonstration

Field Ride Observations

Demonstration dashboard. Every name, region and number here is fictional sample data, built to show how the field ride calibration reads end to end. Nothing on this page reflects a real client.
The project

How Well Calibrated Are ASM Ratings?

A calibration check on how competency ratings are going. Independent Echelon observers joined fifteen full-day field rides, five in each region, and rated every call on the same competencies and scale ASMs use in their coaching system. Comparing the two sets of ratings shows where ASM ratings are well calibrated and where they drift. It looks at the ratings themselves, not at the individuals on the rides.

The big picture
ASM ratings are well calibrated on Preparation and Planning, and run high on Closes for Action.

Where the evidence shows up in the plan and the tools, ASM and observer ratings largely agree. On Engages the Customer and especially Closes for Action, where the rating depends on what happens in front of the provider, ASM ratings run ahead of what observers recorded. The opportunity is less about rating more and more about rating consistently.

Field

What sits behind the rating gaps

Themes seen across observers and regions, each followed by what observers saw in the field.

Organization

Across the organization

Each competency below is shown three ways, all on the same Developing, Demonstrating and Exceeding scale.

1
ASMs rated, whole organization: every competency rating ASMs recorded over the review period.
2
ASMs rated, the 15 observed rides: how those same ASMs rated the fifteen people on the observed rides. This is the apples-to-apples comparison.
3
Observers rated, the same 15 rides: how Echelon observers rated every call on those rides.
Region

By region: the Closes for Action gap is everywhere, but rating habits differ

The same comparison, split three ways, with five rides observed in each region.

Individual

Ride by ride: Closes for Action often goes unrated

▸Ride-by-ride view: ASM and observer ratings for all 15 ridesClick to open a grid comparing the ASM’s rating with the observer’s for each ride.Open

One row per ride. Each cell shows the ASM’s rating first and the observer’s second. Shaded cells are where the two disagree.

How to read this
Echelon Performance · Evidence-Based Coaching™ · Sample Client · Demonstration data