Prevailing scholarship, particularly that on talent selection, shows a lack of predictability when it comes to athletic outcomes, particularly when an athlete is younger. According to Dr. Joe Baker, Ph.D. of York University, "Player development systems are poorly designed, inadequately understood, and delivered by humans with brains that are not designed for the task.”$^5$ To put it simply, even if we know who is the best athlete today, it is unlikely that they will be the best athlete tomorrow.
The conversation on evaluations and selection, therefore, must change from ranking talent and skill to choosing based on organizational fit and development opportunity. Dr. Baker summarizes this by stating, “High-performance sport is a resource-limited system. Evaluations are about making decisions as to who gets access to those resources.”$^6$ Therefore, organizations should start with a realistic self-analysis to understand competencies, resourcing, and need before recruiting any athlete, let alone a goaltender.
In order to effectively evaluate fit, an organization must have the self-awareness to understand its own strengths and weaknesses. Leaders and coaches should reflect on the following questions:
With those answers in mind, leaders and coaches should then review the map of holistic criteria and come up with their own ratings:
Organizations should be as realistic as possible and should seek consensus on these findings among all coaches and leaders. If a majority of traits are weighted toward the same side of the scale, the organization should revisit its findings. As is discussed in the next section, goaltenders who rate “detrimental” in most traits may not be ready for your organization’s skill level; likewise, goaltenders who rate “beneficial” in most may be above the skill level of your team, and may not want to play for your organization if higher-level opportunities are available.
An organization can use its own ratings to formulate its own radar chart, which can then be overlaid and compared to that of the goaltenders being evaluated.
The goal here is to find goaltenders’ charts who closely match the organization’s competencies at an appropriate skill level. It is important to note that goaltenders whose charts are entirely above or below the baseline tick mark may not be appropriate for the level of competition that the organization faces. This is especially true if the goaltender has been evaluated in a competitive environment that includes a team’s current and future players, such as a training camp scrimmage.