Will at Work Learning

Purchasing Performance Support

Here are some purchasing support tools you can use:

Buying wine imported to the US? Slate Magazine Guide
Read accompanying article: Slate Magazine Article

Buying cosmetics and want to avoid toxins: Environmental Working Group Cosmetics

Buying vegetables and want to avoid pesticides: Environmental Working Group Pesticides
Also download an iPhone App: Environmental Working Group Pesticide iPhone

Anybody know of others?

I was at a conference recently and somebody gave me a job aid the size of an employee security card. Too detailed, but potentially a great idea.

What other workplace performance job aids and performance supports have you seen?

Another tool in our toolbox.

John Karlin and the field of Human Factors

Just came across this presentation by John Karlin, who worked at Bell Labs back in the mid 1900's, and found it fascinating.

This was the guy who created the "Karlin dot" on rotary phones and helped people dial the phone. The dot gave dialers a spot to aim their finger at, increasing dialing speed (which if you remember rotary phones, was very important, especially if the number had lots of 7's, 8's, and 9's).

Interestingly, now the behavioral economists with their etched flies in urinals think they invented this idea.

Check out John Karlin's speech from 2003. On paper he's an engaging fellow.

Geary Rummler Tribute at ISPI. Will's Notes and Reflections.

Tonight at the ISPI conference in Orlando, I attended a tribute to Geary Rummler, who recently died after a long and distinguished career in the “Performance-Improvement Field.”

I didn’t know Geary, so I didn’t know how I would react or how long I would stay. I brought my laptop to do emails while I listened. I sat in the back of the cavernous ballroom.

I became transfixed as speaker after speaker who had worked closely with Geary talked about his work and the contributions he made to the field.

The following is my stream of consciousness note-taking with some later annotations. Not worthy of a tribute, but perhaps enough to help me remember some of Geary’s work—and perhaps enough to encourage YOU to take a look at his books and writings.

Notes and Annotations

Entrepreneurial experimentation. Science and sweat. Learning through trial and error.
Creating one-week program on programmed instruction. Didn’t have time to tell, to present objectives, etc. Showed them, had them practice. Curiosity, interested in what did NOT work, not just what DID work. Pre-Testing then Programmed Instruction then Maintenance of Behavior. Annotation: Even way back in the 1960’s and 1970’s someone was thinking about maintaining performance after training, and we are still struggling to get most of the field to do this.

After the initial workshop was developed and deployed, then Management of Behavior Change Workshop. Then General Systems theory workshop. Started small and specific—built up to systems.
During 1960’s Geary and colleagues wouldn’t do training without a thorough front-end needs analysis. 

Annotation: Hmmm. With today’s pressures, many are eschewing FEA.

Geary rebuffed a man who insulted one of his woman colleagues by telling him, “Shut up, she knows more than you do.”

Praxis (a Geary company) had a mission (we didn’t earn that much money speaker said)—to make the world a better place by improving the place where people worked. Annotation:

One of Geary’s former colleagues sang a song in tribute (a tear-inducing moment).

Geary was an engineer. Geary worked with Tom Gilbert. Helped plan Motorola University. Did coaching of functional managers of manufacturing curriculum. One of nice things about Geary is that as a consultant as he learned—he would even tell about the mistakes he made.

Quote from Geary (paraphrased): “Beware of false prophets, the HR people, who would rank and rate you, but don’t really understand the organization.”

Article: “You want performance, not just training.”

Did Situation analysis. Asked these questions: (1) What is happening now? (2) What should be happening?, THEN Define desired outputs. “As-is” “To-Be”

This all become six-sigma, etc. Annotation: Several people said Geary’s work became basis for the Six-Sigma movement, TQM, etc.

Geary said: You’ve got a lot of white space on the org chart you need to manage.

Annotation: People like Geary and his colleagues have been doing very valuable stuff for years (For example, they got cycle time from 17 weeks to 5 days), but why hasn’t this spread? Why hasn’t this performance-based approach gradually knocked-out the dominant training-based approach?

Rummler stuff got repackaged into 6-sigma stuff. Motorola bought license from Geary Rummler’s stuff into 6-sigma and TQM.

Geary’s true legacy: Changed the lens we all look through, moving from training to performance improvement.

Provided a common language:
White space, disconnects, organization as a system, cross-functional processes.

Geary Rummler: Managing the whitespace:

Performance Design Lab (Came out of retirement and started/joined this company).
Geary retired, but had to come back and knew the world didn’t get it and had to get back in the game, forming Performance Design Lab in 2000, where they were focusing on performance management systems (maintaining  improvement after the performance improvement).

Serious Performance Consulting. A Geary Book.

Geary always had to have a vehicle for packaging  his insights into his workshops and his books in ways that would make sense for people.

A speaker said, “He believed that it could be possible to create a prosperous society by construction a good system that will hold successful organizations and generate superior results.”

Two places that Geary touched, who seem to want to use Geary’s work to improve the world. Performance Improvement Institute in Cd. Obregon. Sonora Inst of Tehcnol and norwest of Mexico.

Geary Quote: “We cannot continue working the way we are expecting to get different results.”
Speaker quote (paraphrased): “Geary would share his materials more than anyone I know, I think because he was a learner, he wanted us all to know enough so that he could  discuss with us and we could learn together.”

Drinking alcohol and developing relationships with good discussions was a recurring theme. Many stories about drinks being drunk.

“If you put a good performer in a bad system the system wins every time.” Quote from Geary Rummler.

One speaker, quieted by tears, haltingly spoke about imagining Geary becoming a star in the sky…

Annotation: I really didn’t know that much about Geary’s work, but now I am motivated to learn more. Also, I’m glad I went because it gave me nice perspective on the field, even knowing that this “history” was filtered through the lens of tribute protocol.

Bottom line: I was touched and I’m motivated to learn more. Thanks to ISPI for providing this, for all the speakers (who I apologize for failing to capture their names), and for all the people who came to Orlando especially for the tribute.

Here are two of Geary's most popular books:

Are Goals Always Good? No....Watch Out for Side Effects.

A nice new review of research on goal-setting provides some balance in how goals can be used to guide workplace performance.

The following (admittedly low-quality) graphic comes from the authors' working paper.

The authors don't deny that goals can be useful and powerful. Instead, they focus on the negative side-effects that can occur.

Their balanced approach seems eminently sensible to me. The SMART goal revolution didn't always acknowledge some of the downsides, nor did it provide a Situation-Based Learning Design approach, providing learners with a sense of when to use goals, and when not to.

Everybody in the Learning-and-Performance field ought to read this working paper at once.

The authors: Lisa D. Ordóñez, Maurice E. Schweitzer, Adam D. Galinsky, and Max H. Bazerman

My thanks to marciamarcia on Twitter for letting me know about this important work.

Working Paper Executive Summary (copied from first link above):

For decades, goal setting has been promoted as a halcyon pill for improving employee motivation and performance in organizations. Advocates of goal setting argue that for goals to be successful, they should be specific and challenging, and countless studies find that specific, challenging goals motivate performance far better than "do your best" exhortations. The authors of this article, however, argue that it is often these same characteristics of goals that cause them to "go wild." Key concepts include:

• The harmful side effects of goal setting are far more serious and systematic than prior work has acknowledged.
• Goal setting harms organizations in systematic and predictable ways.
• The use of goal setting can degrade employee performance, shift focus away from important but non-specified goals, harm interpersonal relationships, corrode organizational culture, and motivate risky and unethical behaviors.
• In many situations, the damaging effects of goal setting outweigh its benefits.
• Managers should ask specific questions to ascertain whether the harmful effects of goal setting outweigh the potential benefits.

Learning Landscape Model Annotated

Last June, I blogged about the Learning Landscape Model, a visual model that shows how learning becomes performance and creates results. It's based on years of research and I have found it very helpful in (1) clarifying my own thoughts, in (2) helping other learning-and-performance professionals fully understand their roles/goals, and in (3) explaining training-and-development to business (non-learning) stakeholders.

I have now created an annotated slide deck to introduce the Learning Landscape Model. It also includes insights and new opportunities for how we can measure learning.

Check it out, and let me know what you think.

Personality Instruments and Workplace Performance

The learning-and-performance industry is deluged with instruments purported to help people (1) work better in teams, (2) manage more effectively, (3) hire the right people, (4) promote the best people, (5) etcetera. Unfortunately, many of these instruments have validity, reliability, and magnitude-of-effect issues, despite being well-received by respondents and by learning-and-performance professionals. For example, I will note problems with the MBTI Myers-Briggs below.

Such instruments include multi-rater 360-degree instruments, job-skills tests, knowledge tests, and personality inventories. This blog post is related specifically to personality inventories.

Personality instruments include the wildly-popular MBTI Myers-Briggs Type Indicator and the DISC, plus all sorts of other tests indexed with colors, shapes, and other personality dimensions.

The thinking is that people's personalities influence their actions and their actions determine their workplace effectiveness. This makes sense intuitively, but in practice it has not always been easy to show that personality affects behavior. Early excitement about this possibility in the mid 1900's (i.e., 1930 to 1960) gave way to skepticism, only rebounding into favor in the 1990's as new research found evidence that personality tests could be used in relationship to job performance. For a good historic overview see John and Srivastava (1999, link in reference section below).

Recent research has generally found that personality inventories are related to job performance, though the relationships may be modest and not always consistent. Barrick and Mount (1991) did a meta-analysis looking at many aspects of job performance and found personality to be a factor. Zhao and Seibert (2006) found that the Five-Factor Personality types were related to entrepreneurial skills. Clarke and Robertson (2005) found that personality was related to workplace and non-workplace accidents. Barrick, Mount, and Judge (2001) examined 15 different meta-analyses and concluded that personality and performance were linked.

But this research needs to be understood with some perspective. As Hurtz and Donovan (2000) and others have pointed out, the relationship between the five-factor personality inventories and job performance can be somewhat limited. In other words, just because a person scores a certain way doesn't necessarily mean that they will act a certain way; while there is a slight tendency in the predicted direction, it often is only a slight tendency. Hurtz and Donovan worry further that when other indicators are used (e.g., previous job experience, interviews, etc.), personality measures may provide very little additional information. Moreover, they cite the worry that respondents can fake their responses on personality inventories (see also, Birkeland, Manson, Kisamore, Brannick, & Smith, 2006).

It is particularly important to note that personality research is now almost all tied to the "Big-Five" or "Five-Factor" personality taxonomy. This taxonomy measures personality along five distinct scales, including Openness, Conscientiousness, Extraversion, Agreeableness, and Emotional Stability. The “Big-Five” or “Five-Factor” Personality taxonomy has been validated in many scientific studies (Digman, 1990; Hogan, Hogan, & Roberts, 1996) and is the most widely-regarded of the many personality models, especially as it relates to workplace behaviors. For example, Barrick, Mount, and Judge in 2001 looked at 15 meta-analyses that investigated the relationship between the five personality factors and job performance.

Other personality taxonomies have not fared as well. For example, the MBTI (Myers-Briggs) has been widely discredited by researchers. It is considered neither reliable nor valid. For example, see Pittenger's (2005) caution about using the MBTI. The DISC has not been studied enough to be scientifically validated.

Years ago, I used the MBTI in leadership training to make the point that people are different and may bring different skills and needs to the table. While using such a diagnostic seemed helpful in making that point, today I would use other ways to get that message across or use instruments that are scientifically validated.

To Learn More about Five-Factor Model of Personality

http://en.wikipedia.org/wiki/Big_five_personality_traits

http://www.centacs.com/quickstart.htm

http://www.outofservice.com/bigfive/

http://www.uoregon.edu/~sanjay/bigfive.html

http://en.wikipedia.org/wiki/Neuroticism_Extraversion_Openness_Personality_Inventory

To Purchase/Use Instruments based on the Five-Factor Model

Most Trusted Instrument is the NEO: http://www3.parinc.com/products/product.aspx?Productid=NEO-PI-R, http://www.sigmaassessmentsystems.com/assessments/neopir.asp

Shorter Version of the NEO: http://www3.parinc.com/products/product.aspx?Productid=NEO_FFI, http://www.sigmaassessmentsystems.com/assessments/neoffi.asp

The BFI Instrument: http://www.ocf.berkeley.edu/~johnlab/bfi.htm

Public Domain Instrument (the IPAP): http://ipip.ori.org/, but be sure to read their article before using it: http://ipip.ori.org/Goldberg_etal_2006_IPIP_JRP.pdf

Research Citations

Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.

Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next?. International Journal of Selection and Assessment, 9, 9-30.

Birkeland, S. A., Manson, T. M., Kisamore, J. L., Brannick, M. T., & Smith, M. A. (2006). A Meta-Analytic Investigation of Job Applicant Faking on Personality Measures. International Journal of Selection and Assessment, 14, 317-335.

Clarke, S., & Robertson, I. T. (2005). A meta​-​analytic review of the Big Five personality factors and accident involvement in occupational and non​-​occupational settings. Journal of Occupational and Organizational Psychology, 78(3), 355-376.

Costa, P., & McCrae, R. (1992). NEO-PI-R and NEO-FFI professional manual. Odessa, FL: Psychological Assessment Resources.

Digman, J. M. (1990). Personality structure: Emergence of the five-factor model. Annual Review of Psychology, 41, 417-440.

Hogan, R., Hogan, J., & Roberts, B. W. (1996). Personality measurement and employment decisions: Questions and answers. American Psychologist, 51, 469-477.

John, O. P., & Srivastava, S.  (1999). The Big Five Trait Taxonomy:  History, measurement, and theoretical perspectives.  In L. A. Pervin & O. P. John (Eds.), Handbook of Personality:  Theory and Research (2nd ed., pp. 102-138), New York:  Guilford Press. Available at: http://www.ocf.berkeley.edu/~johnlab/pdfs/john&srivastava,1999.pdf or http://www.uoregon.edu/~sanjay/pubs/bigfive.pdf.

Pittenger, D. J. (2005). Cautionary Comments Regarding the Myers-Briggs Type Indicator. Consulting Psychology Journal: Practice and Research, 57, 210-221.

Zhao, H., & Seibert, S. E. (2006). The Big Five personality dimensions and entrepreneurial status: A meta-analytical review. Journal of Applied Psychology, 91, 259-271.

Some Interesting Articles on Personality and the Workplace (and their abstracts)

Personality and Team Performance: A Meta​-​Analysis.

By Peeters, Miranda A. G.; Van Tuijl, Harrie F. J. M.; Rutte, Christel G.; Reymen, Isabelle M. M. J.

European Journal of Personality. Vol 20(5), Aug 2006, 377-396.

Using a meta-analytical procedure, the relationship between team composition in terms of the Big-Five personality traits (trait elevation and variability) and team performance were researched. The number of teams upon which analyses were performed ranged from 106 to 527. For the total sample, significant effects were found for elevation in agreeableness (p = 0.24) and conscientiousness (p = 0.20), and for variability in agreeableness (p = -0.12) and conscientiousness (p = -0.24). Moderation by type of team was tested for professional teams versus student teams. Moderation results for agreeableness and conscientiousness were in line with the total sample results. However, student and professional teams differed in effects for emotional stability and openness to experience. Based on these results, suggestions for future team composition research are presented.

An examination of the role of personality in work accidents using meta​-​analysis.

By Clarke, Sharon; Roberston, Ivan

Applied Psychology: An International Review. Vol 57(1), Jan 2008, 94-108.

Personality has been studied as a predictor variable in a range of occupational settings. The study reported is based on a systematic search and meta-analysis of the literature, using the "Big Five" personality framework. The results indicated that there was substantial variability in the effect of personality on workplace accidents, with evidence of situational moderators operating in most cases. However, one aspect of personality, low agreeableness, was found to be a valid and generalisable predictor of involvement in work accidents. The implications of the findings for future research are discussed. Although meta-analysis can be used to provide definite estimates of effect sizes, the limitations of such an approach are also considered.

Personality and Transformational and Transactional Leadership: A Meta​-​Analysis.

By Bono, Joyce E.; Judge, Timothy A.

Journal of Applied Psychology. Vol 89(5), Oct 2004, 901-910.

This study was a meta-analysis of the relationship between personality and ratings of transformational and transactional leadership behaviors. Using the 5-factor model of personality as an organizing framework, the authors accumulated 384 correlations from 26 independent studies. Personality traits were related to 3 dimensions of transformational leadership--idealized influence-inspirational motivation (charisma), intellectual stimulation, and individualized consideration--and 3 dimensions of transactional leadership--contingent reward, management by exception-active, and passive leadership. Extraversion was the strongest and most consistent correlate of transformational leadership. Although results provided some support for the dispositional basis of transformational leadership--especially with respect to the charisma dimension--generally, weak associations suggested the importance of future research to focus on both narrower personality traits and nondispositional determinants of transformational and transactional leadership.

The Big Five personality dimensions and entrepreneurial status: A meta​-​analytical review.

By Zhao, Hao; Seibert, Scott E.

Journal of Applied Psychology. Vol 91(2), Mar 2006, 259-271.

In this study, the authors used meta-analytical techniques to examine the relationship between personality and entrepreneurial status. Personality variables used in previous studies were categorized according to the five-factor model of personality. Results indicate significant differences between entrepreneurs and managers on 4 personality dimensions such that entrepreneurs scored higher on Conscientiousness and Openness to Experience and lower on Neuroticism and Agreeableness. No difference was found for Extraversion. Effect sizes for each personality dimension were small, although the multivariate relationship for the full set of personality variables was moderate (R = .37). Considerable heterogeneity existed for all of the personality variables except Agreeableness, suggesting that future research should explore possible moderators of the personality-entrepreneurial status relationship.

Predicting job performance using FFM and non​-​FFM personality measures.

By Salgado, Jesús F.

Journal of Occupational and Organizational Psychology. Vol 76(3), Sep 2003, 323-346.

This study compares the criterion validity of the Big Five personality dimensions when assessed using Five-Factor Model (FFM)-based inventories and non-FFM-based inventories. A large database consisting of American as well as European validity studies was meta-analysed. The results showed that for conscientiousness and emotional stability, the FFM-based inventories had greater criterion validity than the non FFM-based inventories. Conscientiousness showed an operational validity of .28 (N=19,460, 90% CV=.07) for FFM-based inventories and .18 (N=5,874, 90% CV=-.04) for non-FFM inventories. Emotional stability showed an operational validity of .16 (N=10,786, 90% CV=.04) versus .05 (N=4,54I, 90% CV=-.05) for FFM and non-FFM-based inventories, respectively. No relevant differences emerged for extraversion, openness, and agreeableness. From a practical point of view, these findings suggest that practitioners should use inventories based on the FFM in order to make personnel selection decisions.

A Meta​-​Analytic Investigation of Job Applicant Faking on Personality Measures.

By Birkeland, Scott A.; Manson, Todd M.; Kisamore, Jennifer L.; Brannick, Michael T.; Smith, Mark A.

International Journal of Selection and Assessment. Vol 14(4), Dec 2006, 317-335.

This study investigates the extent to which job applicants fake their responses on personality tests. Thirty-three studies that compared job applicant and non-applicant personality scale scores were meta-analyzed. Across all job types, applicants scored significantly higher than non-applicants on extraversion (d = .11), emotional stability (d = .44), conscientiousness (d = .45), and openness (d = .13). For certain jobs (e.g., sales), however, the rank ordering of mean differences changed substantially suggesting that job applicants distort responses on personality dimensions that are viewed as particularly job relevant. Smaller mean differences were found in this study than those reported by Viswesvaran and Ones (Educational and Psychological Measurement, 59(2), 197-210), who compared scores for induced 'fake-good' vs. honest response conditions. Also, direct Big Five measures produced substantially larger differences than did indirect Big Five measures.

A meta​-​analytic review of the Big Five personality factors and accident involvement in occupational and non​-​occupational settings.

By Clarke, Sharon; Robertson, Ivan T.

Journal of Occupational and Organizational Psychology. Vol 78(3), Sep 2005, 355-376.

Although a number of studies have examined individual personality traits and their influence on accident involvement, consistent evidence of a predictive relationship is lacking due to contradictory findings. The current study reports a meta-analysis of the relationship between accident involvement and the Big Five personality dimensions (extraversion, neuroticism, conscientiousness, agreeableness, and openness). Low conscientiousness and low agreeableness were found to be valid and generalizable predictors of accident involvement, with corrected mean validities of .27 and .26, respectively. The context of the accident acts as a moderator in the personality-accident relationship, with different personality dimensions associated with occupational and non-occupational accidents. Extraversion was found to be a valid and generalizable predictor of traffic accidents, but not occupational accidents. Avenues for further research are highlighted and discussed.

Big Five personality predictors of post​-​secondary academic performance.

By O'Connor, Melissa C.; Paunonen, Sampo V.

Personality and Individual Differences. Vol 43(5), Oct 2007, 971-990.

We reviewed the recent empirical literature on the relations between the Big Five personality dimensions and post-secondary academic achievement, and found some consistent results. A meta-analysis showed Conscientiousness, in particular, to be most strongly and consistently associated with academic success. In addition, Openness to Experience was sometimes positively associated with scholastic achievement, whereas Extraversion was sometimes negatively related to the same criterion, although the empirical evidence regarding these latter two dimensions was somewhat mixed. Importantly, the literature indicates that the narrow personality traits or facets presumed to underlie the broad Big Five personality factors are generally stronger predictors of academic performance than are the Big Five personality factors themselves. Furthermore, personality predictors can account for variance in academic performance beyond that accounted for by measures of cognitive ability. A template for future research on this topic is proposed, which aims to improve the prediction of scholastic achievement by overcoming identifiable and easily correctable limitations of past studies.

Gender differences in personality traits across cultures: Robust and surprising findings.

By Costa Jr., Paul; Terracciano, Antonio; McCrae, Robert R.

Journal of Personality and Social Psychology. Vol 81(2), Aug 2001, 322-331.

Secondary analyses of Revised NEO Personality inventory data from 26 cultures (N =23,031) suggest that gender differences are small relative to individual variation within genders; differences are replicated across cultures for both college-age and adult samples, and differences are broadly consistent with gender stereotypes: Women reported themselves to be higher in Neuroticism, Agreeableness, Warmth, and Openness to Feelings, whereas men were higher in Assertiveness and Openness to Ideas. Contrary to predictions from evolutionary theory, the magnitude of gender differences varied across cultures. Contrary to predictions from the social role model, gender differences were most pronounced in European and American cultures in which traditional sex roles are minimized. Possible explanations for this surprising finding are discussed, including the attribution of masculine and feminine behaviors to roles rather than traits in traditional cultures.

Five​-​factor model of personality and job satisfaction: A meta​-​analysis.

By Judge, Timothy A.; Heller, Daniel; Mount, Michael K.

Journal of Applied Psychology. Vol 87(3), Jun 2002, 530-541.

This study reports results of a meta-analysis linking traits from the 5-factor model of personality to overall job satisfaction. Using the model as an organizing framework, 334 correlations from 163 independent samples were classified according to the model. The estimated true score correlations with job satisfaction were -.29 for Neuroticism, .25 for Extraversion, .02 for Openness to Experience, .17 for Agreeableness, and .26 for Conscientiousness. Results further indicated that only the relations of Neuroticism and Extraversion with job satisfaction generalized across studies. As a set, the Big Five traits had a multiple correlation of .41 with job satisfaction, indicating support for the validity of the dispositional source of job satisfaction when traits are organized according to the 5-factor model.

Relationship of personality to performance motivation: A meta​-​analytic review.

By Judge, Timothy A.; Ilies, Remus

Journal of Applied Psychology. Vol 87(4), Aug 2002, 797-807.

This article provides a meta-analysis of the relationship between the 5-factor model of personality and 3 central theories of performance motivation (goal-setting, expectancy, and self-efficacy motivation). The quantitative review includes 150 correlations from 65 studies. Traits were organized according to the 5-factor model of personality. Results indicated that Neuroticism (average validity=-.31) and Conscientiousness (average validity=.24) were the strongest and most consistent correlates of performance motivation across the 3 theoretical perspectives. Results further indicated that the validity of 3 of the Big Five traits--Neuroticism, Extraversion, and Conscientiousness--generalized across studies. As a set, the Big 5 traits had an average multiple correlation of .49 with the motivational criteria, suggesting that the Big 5 traits are an important source of performance motivation.

Temperament and personality in dogs (Canis familiaris): A review and evaluation of past research.

By Jones, Amanda C.; Gosling, Samuel D.

Applied Animal Behaviour Science. Vol 95(1-2), Nov 2005, 1-53.

Spurred by theoretical and applied goals, the study of dog temperament has begun to garner considerable research attention. The researchers studying temperament in dogs come from varied backgrounds, bringing with them diverse perspectives, and publishing in a broad range of journals. This paper reviews and evaluates the disparate work on canine temperament. We begin by summarizing general trends in research on canine temperament. To identify specific patterns, we propose several frameworks for organizing the literature based on the methods of assessment, the breeds examined, the purpose of the studies, the age at which the dogs were tested, the breeding and rearing environment, and the sexual status of the dogs. Next, an expert-sorting study shows that the enormous number of temperament traits examined can be usefully classified into seven broad dimensions. Meta-analyses of the findings pertaining to inter-rater agreement, test-retest reliability, internal consistency, and convergent validity generally support the reliability and validity of canine temperament tests but more studies are needed to support these preliminary findings. Studies examining discriminant validity are needed, as preliminary findings on discriminant validity are mixed. We close by drawing 18 conclusions about the field, identifying the major theoretical and empirical questions that remain to be addressed.

Will's Note: I included this last one because it amused me that searching for "personality" one might find a research review on dog personality---and to keep all this research stuff in perspective.

I just got Robo-called by my Health Insurance Company. Good Performance Support?

My home just got robo-called by my Health Insurance Company. They wanted to remind us to get our flu shots.

This seems like a nice performance-support reminder to me. My insurance company pays for those flu shots too, which makes it nice (I'm in Massachusetts, where we have new required health-care standards, and it's not clear whether the state reimburses the insurance companies or not).

Hmmm. I wonder whether they are testing the value of this. It would be so easy to evaluate the benefits of this.

A Better Learning to Performance Model and Job Aid

For almost a decade I've been building a model of how learning works to prompt performance. Each iteration gets better (in my unbiased opinion). Here's the latest one--this one has the advantage of pointing out the responsibilities learning professionals have AND the responsibilities that learners' managers and the workplace have in creating on-the-job results.

You can use this model for two purposes:

1. As a visual metaphor for how learning works to drive on-the-job performance and results.
2. As a job aid to assign responsibilities and tasks.

This graphic draws on many sources, many I'm probably unaware of. It draws from the wisdom of authors such as Wick, Pollock, Jefferson, and Flanagan of Six Disciplines of Breakthrough Learning fame, and Tim Mooney and Rob Brinkerhoff from the new book Courageous Training (which is great by the way, I'll review it within the next month).

It also draws from countless researchers on learning, memory, instruction, and cognition who have helped me understand learning at a deep level, enabling me to add to models that don't fully include wisdom on how learning and cognition really work to drive remembering.

Also, I'd like to thank my many clients who have enabled me a great real-world workshop in which to think deeply about how learning works in a practical reality. I'd particularly like to thank my friends at Walgreens, and especially Anne Laures who commented on an earlier version of this model.

Download Learning-Performance_Diagram_v2.pdf.

As always, this is a work in progress, so let me know what you like and what I might be missing. Note, of course, that human learning and performance is too complicated to include every factor of relevance. My goal is to create a model simple enough to be easily understood and precise enough to be useful and provide practical learning-to-performance improvement.

Oh, if you have to give it a name, you might call it the Learning-to-Performance Landscape Model, but I'll probably come up with a better name.

Simple Performance Improvement. Check the Clock.

New research in the New England Journal of Medicine shows that doctors who spend more time doing a colonoscopy perform better (find more polyps) than doctors who do the procedures more quickly.

As the New York Times reported, the study found "an astonishing gap in proficiency — clearly related to the time spent looking. The doctors who spent six minutes or more searching for polyps — the minimum time recommended in the professional literature — detected growths at nearly four times the rate of those who did the procedure more quickly. The doctor who took the longest time found polyps 10 times more often than the doctor who spent the least time."

The times further noted that the group of doctors studied was subsequently able to improve their performance, just by using a clock. The group "decided to spend at least eight minutes on withdrawing the instrument and looking for polyps — clocked by a timer with a bell — and has increased its polyp detection rate 50 percent." See original story.

Learnings for the learning-and-performance field:

1. Research can uncover insights that would otherwise be overlooked.
2. Simple measures can drastically improve performance.
3. Evaluating our performance is a moral imperative, because it can have real-world effects.