Wonderlic test


The Wonderlic Contemporary Cognitive Ability Test is a popular assessment used to measure the cognitive ability and problem-solving aptitude of prospective employees for a range of occupations. It is a proprietary assessment created and distributed by Wonderlic. The assessment is available in 12 different languages and is often used in all types of employment hiring from entry level to executive level. It consists of 50 multiple choice questions to be answered in 12 minutes. The test was developed by Eldon F. Wonderlic, while he was a graduate student at Northwestern University. The score is calculated as the number of correct answers given in the allotted time. A score of 20 is intended to indicate average intelligence.
The most recent version of the test is WonScore, a cloud-based assessment providing a single score to potential employers based on scientific research. The Wonderlic test was based on the Otis Self-Administering Test of Mental Ability with the goal of creating a short form measurement of cognitive ability.

History

Created in 1936 by E. F. Wonderlic, the Wonderlic Personnel Test was the first short-form cognitive abilities test. It was developed to measure general cognitive ability in the areas of math, vocabulary, and reasoning. Wonderlic created and distributed it as a graduate student in the psychology department at Northwestern University from his home. Regarding the time allotted to take the test, Eldon F. Wonderlic, in an article released in 1939, stated the following: "The length of the test was made such that only about two to five per cent of average groups complete the test in the twelve-minute time limit."
Originally designed to aid in employee selection of companies such as AT&T and Oscar Meyer in the 1940s, the Wonderlic Personnel Test has also been used by both the United States Armed Forces and the National Football League for selection purposes. During World War II, the Navy began using the Wonderlic Personnel Test to select candidates for pilot training and navigation. During this time period, 1940–1960, it was supplied for free as the data was so valuable to E. F. Wonderlic. He wanted to perfect the test, not charge for it. In the 1970s Tom Landry, coach of the Dallas Cowboys, was the first to use the Wonderlic Personnel Test to predict player performance. It is still used in the annual NFL Combine as a form of pre-draft assessment. In short, it attempts to screen candidates for certain jobs within the shortest possible time. It may be termed as a quick IQ test.
The Wonderlic test is continually being updated with repeated evaluations of questions. Also, beginning in the 1970s, Wonderlic began to develop other forms of the Wonderlic Personnel some of which include: Wonderlic Perceptual Ability Tests, Wonderlic Scholastic Level Exam, or the Wonderlic Contemporary Cognitive Ability Test.

Types

The tests are divided into three different sections: cognitive ability, personality, and motivation.

Cognitive Ability

Released in the 1990s, the Wonderlic Personnel Test measures an individual's capability of solving problems and learning. The Wonderlic Personnel test is divided into two different forms of test: the Wonderlic Personnel Test – Quicktest and the Wonderlic Personnel Test. The Wonderlic Personnel Test-Quicktest differs from the Wonderlic Personnel Test in that it is not proctored giving employers a general idea of the potential applicant's cognitive ability. The Wonderlic Personnel Test is a much more comprehensive test.
The Wonderlic SLE is the scholastic version of the Wonderlic Personnel Test and is commonly administered to nursing school and medical program applicants.

Personality

The Wonderlic Personality tests measure personal characteristics that are widely accepted as being predictive of a candidate's expected job performance. Wonderlic claims that using the Wonderlic Personality Test to select individuals whose traits are aligned with the demands of the position, employers can improve employee productivity, employee satisfaction and customer service while reducing recruitment costs and employee turnover.
Added during the 1990s, the Wonderlic Personality Test contains two sections. The Wonderlic Five-Factor Personality Profile and the Wonderlic Seven-Factor Personality Profile. The Wonderlic Five-Factor Personality Profile tests individuals on five primary dimensions of the individual's personality: extraversion, agreeableness, conscientiousness, emotional stability/neuroticism, and openness to experience. These are essentially the same constructs as the Big Five personality traits, also known as the Five Factor Model.

Motivation

Averaging 10–15 minutes, the 58-item assessment is based on leading workplace motivation model, Holland/RIASEC. It evaluates a candidate’s interests, which helps predict how motivated they will be by the actual responsibilities of the job. The more motivated they are by those responsibilities, the likelier they will succeed in that position.

Sample questions

Similar to other standardized tests, the Wonderlic Cognitive Ability Test presents its questions in an open response. The types of questions that have appeared in the oldest versions of the Wonderlic test include: analogies, analysis of geometric figures, arithmetic, direction following, disarranged sentences, judgment, logic, proverb matching, similarities, and word definitions. However, the questions may take different angles depending upon the ‘intelligence’ of the question setters.
Practice questions will include:
The Wonderlic test, as a vocational and intelligence test, falls under the field of Industrial and Organizational Psychology. As a personnel test the Wonderlic is used to gauge an applicant's job potential, educational potential, and training potential. Six forms of this test are made available in which Wonderlic suggests that when two of these versions are to be used, the best combinations are A and B or D and F. However, a study conducted by psychologists Kazmier and Browne shows that neither of these forms can be regarded as directly equivalent. While there is no lack of tests that could be used in place of the Wonderlic, such as the IQ or the Mechanical Aptitude Test, it is a quick and simple vocational test for personnel recruitment and selection. The Wonderlic test has been peer reviewed by the American Psychological Association and has been deemed worthy of field applications to the industrial use of personnel testing. Other sources can be found on the database APA PsycNET.

Reliability

In 1956, Weaver and Boneau reported in the Journal of Applied Psychology that two of the five forms, A and B, that were published at the time were harder than the others which caused scores on those forms to be significantly lower than scores obtained on forms C–F. Concerning these observed differences, Weaver and Boneau state: "This accords with the history of the development of the test. Forms D, E, and F are made up of items selected from the Otis Higher, while A and B were developed later and include types of items not found in the Otis." Those findings, seemingly, invalidate the claim that those forms were equivalent or consistent. E. N. Hay made a similar observation as well. Hay found that form F was significantly easier than Form D. Furthermore, Kazmier found Form B to be the most difficult of the five forms and, thus, recommended that it "not be regarded as directly equivalent to any of the forms." Kazmier also found Forms D and F to be significantly different from each other and recommended that these forms be regarded as inequivalent. In a study of the Wonderlic's test-retest reliability, conducted in 1992, Stuart McKelvie "concluded that conscious repetition of specific responses did not seriously inflate the estimate of test-retest reliability." To put it simply, one's memory of some of the answers does not significantly affect one's score on the Wonderlic.
In 1982, Carl Dodrill conducted a study in which 57 adults were administered the Wonderlic twice over a five-year period. In the Journal of Consulting and Clinical Psychology, Dodrill reported that the test-retest reliability for the Wonderlic was.94. According to a 1989 article in Psychological Reports, the Wonderlic scored a r=.87 on the reliability scale compared along with the Pearson test score of r=.21.

Validity

In an article written in Psychological Reports, T. Matthews and Kerry Lassiter report that the Wonderlic test "was most strongly associated with overall intellectual functioning," which is what it is purported to measure. However, Matthews and Lassiter did not find the Wonderlic to be a successful measure of fluid and crystallized intelligence, and they stated that "the Wonderlic test scores did not clearly show convergent or divergent validity evidence across these two broad domains of cognitive ability." In academic testing, the Wonderlic test has shown high correlations with aptitude tests such as the General Aptitude Test Battery.

Legal matters

''Jordan v. New London''

In May 1997, Robert Jordan filed a lawsuit against the city of New London, Connecticut, alleging violation of the Equal Protection Clause of the United States and Connecticut constitutions, in a case that was referred to by several media outlets as "Too Smart To Be A Cop", based on the city's application of scores generated by the Wonderlic test.
Jordan was born and raised in New London, and had previous experience in law enforcement, working as a part-time officer in near-by Groton Long Point, and as a seasonal officer for the Connecticut Department of Environmental Protection. In fall 1996, Jordan requested an interview with Keith Harrigan, New London's Assistant City Manager in charge of personnel. Harrigan informed Jordan that he was ineligible because he scored too high on the written portion of the Wonderlic test intended to evaluate cognitive ability. New London had decided to consider only applicants who scored between 20 and 27 on the written examination. Jordan scored a 33 on the exam, the equivalent of having an IQ of 125.
Jordan filed suit in the United States District Court for the District of Connecticut, where his case was dismissed by Judge Peter C. Dorsey, who noted: "The guarantee of equal protection under the Fifth Amendment is not a source of substantive rights or liberties, but rather a right to be free from invidious discrimination in statutory classifications and other governmental activity. It is well settled that where a statutory classification does not itself impinge on a right or liberty protected by the Constitution, the validity of the classification must be sustained unless the classification rests on grounds wholly irrelevant to the achievement of objective.... may have been disqualified unwisely but he was not denied equal protection." The dismissal was upheld on appeal to the United States Court of Appeals for the Second Circuit.

Central tendency of Wonderlic scores

Serving as a quantitative measure for employers, scores are collected by the employers and the applicant's score may be compared to a professional standard, as is the case with security guards or, simply, compared to the scores of other applicants who happen to be applying for the same or similar positions at that time. Each profession has its own, unique, average; therefore, different professions require different standards. Wonderlic, Inc. claims a minimum score of 10 points suggests a person is literate.

Median score by profession

Listed are a sample of median scores by profession on the Wonderlic test from 1983. The scores are listed in descending numerical order, and professions with the same score have been alphabetized.
The Wonderlic test is used in the NFL Scouting Combine. Paul Brown introduced the test to the league in the late 1960s. According to Paul Zimmerman's The New Thinking Man's Guide to Pro Football, the average score of an NFL player according to position is the following:
An average football player usually scores around 20 points. Quarterbacks and offensive linemen usually have higher scores. Most teams want at least 21 for a quarterback.
Some notable players who scored well below the average include:
Some notable players who scored well above the average include:
John P. Lopez of Sports Illustrated proposed a 26–27–60 rule to predict a quarterback's success in the NFL and listed several examples of successes and failures based on the rule. A 2005 study by McDonald Mirabile found that there is no significant correlation between a quarterback's Wonderlic score and a quarterback's passer rating, and no significant correlation between a quarterback's Wonderlic score and a quarterback's salary. Similarly, a 2009 study by Brian D. Lyons, Brian J. Hoffman, and John W. Michel found that Wonderlic scores failed to positively and significantly predict future NFL performance, draft position, or the number of games started for any position. Lyons said that Wonderlic's "limited return on investment" for the NFL is contrary to general mental ability being a very strong predictor of job performance for most careers; "because it's so physically based, the results point to that really doesn't matter". Donovan McNabb, whose score was the lowest of the five quarterbacks taken in the first round of the 1999 NFL Draft, had the longest and most successful career.
The Lyons study also found that the relationship between Wonderlic test scores and future NFL performance was negative for a few positions, indicating the higher a player scores on the Wonderlic test, the worse the player will perform in the NFL. According to Pat McInally, who was selected by the Cincinnati Bengals in the fifth round of the 1975 NFL Draft, George Young told him that his perfect score caused him to be selected later than he would have otherwise. NFL reporter Matt Verderame reported that New England Patriots offensive lineman Joe Thuney avoided answering Wonderlic questions so he would not score too high. McInally speculated that "coaches and front-office guys don't like extremes one way or the other, but particularly not on the high side. I think they think guys who are intelligent will challenge authority too much". Mike Florio of Profootballtalk.com agreed with McInally:
Job performance in the NFL also includes deviance. A 2016 study found that the Wonderlic significantly predicted future arrests—referred to as criminal off-duty deviance—in NFL draftees.

In popular culture

A simplified and condensed version of the Wonderlic test appears in newer editions of the Madden NFL video game series. The Madden version of the test is taken in "Superstar Mode" portion of the game, to make the game experience more realistic, although, it is now optional. The questions usually consist of basic math and English questions. For example, "If Adrian Peterson rushes for 125 yards in a game, how many yards will he have at the end of the season if he keeps up with this pace?". Players have four answers to choose from when taking this version of the test.