In Search of Excellence


In Search of Excellence is a book written by Tom Peters and Robert H. Waterman, Jr.. First published in 1982, it sold 3 million copies in its first four years, and being the most widely held monograph in the United States from 1989 to 2006.
The book purports to explore the art and science of management used by several 1980s companies.

Background

Context

In 1982, at the time of publication of In Search of Excellence, America was looking to Japan as the rising economic force. American businesses were studying Japanese management techniques and looking to learn from their successes.
In Search of Excellence went against this trend, by focusing on American companies and studying what made the most successful American companies successful.

Origins

In Search of Excellence did not start out as a book, as Tom Peters explained when interviewed in 2001 to mark the 20th anniversary of In Search of Excellence. In the same interview, Peters claims that he and Waterman were both consultants on the "margins" of McKinsey, based in the San Francisco office.
In 1977 McKinsey director Ron Daniel launched two projects; the first and major one, the Business Strategy project, was allocated to top consultants at McKinsey's New York City corporate HQ and was given significant resources, but could not manage to effectively implement strategy.
Peters states that directly after graduating with a PhD from Stanford, and returning to McKinsey, Daniel handed him a "fascinating assignment." Motivated by the new ideas coming from Bruce Henderson's Boston Consulting Group, Peters "was asked to look at 'organization effectiveness' and 'implementation issues' in an inconsequential offshoot project nested in McKinsey's rather offbeat San Francisco office." While Daniel's first project was focused on Business Strategy, this second project was concerned with Organization, which Peters defined as involving "the structure-and-people side." This "Organization" project was seen as less important, according to Peters in a Fast Company interview.
Despite being described as "marginal," the project "had an infinite travel budget that allowed to fly first class and stay at top-notch hotels and a license from McKinsey to talk to as many cool people as could all around the United States and the world." Peters admits that "There was no carefully designed work plan. There was no theory that I was out to prove. I went out and talked to genuinely smart, remarkably interesting, first-rate people." In addition to Karl Weick and Einar Thorsrud, Peters notes that Douglas McGregor's theory of motivation known as Theory X and Theory Y was directly influential on the direction of the project.
In a 1978 article, "Symbols, Patterns and Settings," Peters argued that "shifting organizational structure" and "inventing new processes" - structure and system, respectively - were only two tools of organizational change. Peters then outlines eight "mundane" tools that every manager has at their fingertips. He described this article as a "tentative presentation" and "the first public expression of these ideas."
In 1979 McKinsey's Munich office requested Peters to present his findings to Siemens, which provided the spur for Peters to create a 700-slide two-day presentation. Word of the meeting reached the US and Peters was invited to present also to PepsiCo, but unlike the hyper-organised Siemens, the PepsiCo management required a tighter format than 700 slides, so Tom Peters consolidated the presentation into eight themes. These eight would form the chapters of In Search of Excellence.
In 1980, Waterman joined Peters, and, along with Waterman's friend Tony Athos and Richard Pascale - both academics - came together at a two-day retreat in San Francisco to develop what would become known as the 7S Framework, the same framework that would organize In Search of Excellence. In June 1980, Peters published an op-ed in the Manager's Journal section of the Wall Street Journal titled "The Planning Fetish." In this article, he "stressed the importance of execution and dismissed the whole idea of strategy." As strategy was McKinsey's main operation at the time, this was seen as a "frontal assault" on the company, leading Mike Bulkin, the head of the New York office, to demand that Daniel fire Peters.
The primary "innovative" theme that under-girded what would become In Search of Excellence was that "structure is not organization." This also happened to be the title of a 1980 journal article authored by Bob Waterman, Tom Peters, and Julien Phillips in which they argue that the "picture of the thing is not the thing...An organizational structure is not an organization." This article also introduced what would become the McKinsey 7S Framework.
In December 1981, Peters left the company, after agreeing to a fifty percent royalty split with McKinsey. Later co-author Waterman stayed at the firm for three more years, but received no royalties from In Search of Excellence

Overview

The book consisted of three parts:
  1. The Saving Remnant - introduced the background and methodology for the book
  2. Toward New Theory - introduced their underpinning ideas about business and management
  3. Back To Basics - coverage of the 8 key "themes" found in Excellent companies

    Key ideas

Part 1 - Approach and method

In the first chapter of the book, Peters and Waterman introduced the background for the book and their research method.
Initial investigations
They started out by interviewing leaders of successful organisations to get a feel for what themes emerged.
They then refined their initial observations, using the approach described below.
The McKinsey 7S framework
Peters and Waterman were concerned with how organizations were organized and managed. They wondered whether structure follows strategy, as Alfred Chandler had suggested.
To address this, their perspective was that:
They used these seven "variables" to create a visual framework, which became known as the McKinsey 7S Framework.
The interviews and resulting insights
They then used their 7S framework as a lens through which to evaluate organizational excellence. They conducted in-depth interviews with leaders at 43 "excellent" companies using this lens.
They then reduced the set of emerging insights from these interviews down to eight "themes."
Companies covered
Forbes.com provides a list of companies covered in the book, and their subsequent financial performance. This list includes only publicly traded companies.

Part 2: Intellectual orientation

In Search of Excellence is a critique of a "rationalist" approach to management.
The second chapter of the book, "The Rational Model," introduces and then critiques the rationalist approach.
An example of the rationalist mindset is reproduced below:
By contrast, a more "social" form of management takes into account the realities of what really motivates people. This set of real human motivations is explored in the third chapter, "Man Waiting for Motivation."
The fourth chapter puts these concerns into a historical context, exploring the evolution of management theories between 1900 and the time of publication of the book in the early 1980s. The latest era of management is characterised as more "social" than "rational," meaning that real human motivations drive business goals and activities. It also more "open" than "closed," meaning that outside forces such as market pressures can shape the evolution of structure and organisation within a firm.
This leads to an increasing concern with the ongoing evolution of an organization, and the role of culture in maintaining and shaping an organization.
Ultimately, these chapters would be seen in today's terms as advocating for leadership over management. Leaders articulate values and purpose, and achieve buy-in to vision and values from employees.
These chapters set the foundation for the rest of the book, which address eight core themes for the book.

Part 3: The eight characteristics of excellent companies

Peters and Waterman found eight common themes which they argued were responsible for the success of the chosen corporations. The book devotes one chapter to each theme.
  1. A bias for action: a preference for doing something - anything - rather than sending a question through cycles and cycles of analyses and committee reports
  2. Staying close to the customer - learning his preferences and catering to them.
  3. Autonomy and entrepreneurship - breaking the corporation into small companies and encouraging them to think independently and competitively
  4. Productivity through people - creating in all employees the awareness that their best efforts are essential and that they will share in the rewards of the company's success.
  5. Hands-on, value driven - insisting that executives keep in touch with the firm's essential business.
  6. Stick to the knitting - remaining with the business the company knows best.
  7. Simple form, lean staff - few administrative layers, few people at the upper levels.
  8. Simultaneous loose-tight properties - fostering a climate where there is dedication to central values of the company combined with tolerance for all employees who accept these values.

    Discussion

The "Drucker gap" ...

Before and after In Search of Excellence, Peter Drucker was probably the preeminent management theorist.
However, while Peters and Waterman reviewed management theory over the preceding eight decades within In Search of Excellence, they did not consider Peter Drucker's contributions to management theory within their review.
According to the Los Angeles Times, Peters and Waterman had not read Drucker's work:
It seems unlikely that Peters and Waterman were completely unaware of Peter Drucker, if for no other reason than they cite Drucker three times in the index of In Search of Excellence.
Peters himself wrote that he read Drucker's The Effective Executive in 1968:
Peters shared in an interview that when writing In Search of Excellence, he was "pissed off" at Peter Drucker:
Apparently Peters had construed Druckman as advocating a Taylor-style reductionism:
After publication of In Search of Excellence, Peters re-read a wider body of Drucker's work, and commented:
In 2005, on the occasion of Drucker's passing, Peters summarized Drucker's contributions to the theory of management:
Peter Drucker presaged and covered similar perspectives to Peters and Waterman's approach to management theory, for example in Drucker's The Practice of Management.
Jim Collins noted in Built to Last that a number of companies featured in both In Search of Excellence and in Built to Last, such as HP and P&G, "were tremendously influenced by Drucker's writings."
The omission of any reference to Drucker's theory of management in In Search of Excellence was a serious gap, undermining Peters and Waterman's claim that In Search of Excellence helped develop a new approach to management theory.
This omission doesn't however change the validity of the points raised by both Drucker and Peters and Waterman.

The structure of the book

Peters and Waterman organized their work into eight "themes."
There may be issues with their chosen way of structuring this information for presentation, including atomicity and surfacing.
1. Atomicity
Sometimes the one "theme" consisted of two quite different points.
For example, "Hands-on, value driven" is about two different things:
  1. Having a core set of guiding values at the core of the organisation
  2. Leadership being "hands-on", for example through "management by walking around" or through open-door policies.
These are related, because leaders being hands-on is a way to institutionalise and embed the guiding values. But conceptually these are two different points, and arguably are better discussed as such.
Similarly, "Simple form, lean staff" is about two different things:
  1. Simple form is about the organisational structure - what branches, divisions or companies
  2. Lean staff is about a flat structure.
These are different points. So much so that the chapter on "Simple form, lean staff" does not discuss "lean staff" at all. It is covered only in an overview of the chapter, elsewhere in the book.
"Atomicity" would reduce each of the book's "theme's" to making a single major point.
2. Surfacing.
Sometimes there is an idea within a "theme" that arguably deserves to be surfaced as a main theme in itself.
For example, the theme "A bias to action" in In Search of Excellence also includes the sub-idea that excellent organizations adopt an experimental approach. Arguably this deserves to be raised to the level of a major "theme" in and of itself in the book - as it is in Jim Collins' Built To Last.

Peters' "confession" of "true data"

In December, 2001, Fast Company printed an article, crediting Tom Peters as author, entitled "Tom Peters's True Confessions". Most of the "confessions" were humorously self-deprecating remarks. One of them, however, used the term "faked data:"
BusinessWeek ran an article about Fast Company's article. As related by BusinessWeek, the article was actually written by Fast Company founding editor Alan M. Webber, based on a six-hour interview with Peters. Peters reviewed and approved the article prior to publication, but the actual phrase "we faked the data" was Webber's, and Peters had not actually used these words during the interview. BusinessWeek quoted Peters as saying "Get off my case. We didn't fake the data." According to BusinessWeek, Peters says he was "pissed" when he first saw the cover. "It was his damn word," he says. "I'm not going to take the heat for it."

Criticisms

Market performance of the "excellent" companies

As early as 1984 it was apparent, to certain analysts, that the book's choice of companies was poor to indifferent. NCR, Wang Labs, Xerox and others did not produce excellent results in their balance sheets in the 1980s.
Rick Chapman titled his book on high-tech marketing fiascoes, In Search of Stupidity, as a nod to Peters's book and the disasters that befell many of the companies it profiled. He notes that "with only a few exceptions... large firms with dominant positions in markets that were or static."
In an article in Fast Company, Peters remarked that the criticism that "If these companies are so excellent, Peters, then why are they doing so badly now," in his opinion "pretty much misses the point."

The "halo effect"

The research methodology employed by the authors of this book is also severely criticized by Phil Rosenzweigh in his book "The Halo Effect"
as the "Delusion of Connecting the Winning Dots". Rosenzweigh opines that it was not possible to identify the traits that make a company perform simply by studying already-performing companies which Peters and Waterman did.

Legacy

Reception

Almost 40 years after its original publication In Search of Excellence remains a widely read classic, and an influential book for leaders and managers.
A 2002 panel of experts convened by Forbes rated In Search of Excellence as the most influential business and management book from the decades between 1980 and 2000.
Inc magazine reported that by March 1999, In Search of Excellence had sold over 4.5 million copies. Forbes in 2016 ranked the best-selling business books ever - based on sales tracking data that was not collected before 2004 - and put Strengths Finder 2.0 at number 1 with 4.5 million copies sold. Since In Search of Excellence had equalled this level of sales in 1999, and presumably made further sales in the succeeding 17 years, there is an argument to be made that In Search of Excellence is either the best-selling business book of all time or the equal best-selling business book of all time.

Impact

Tom Peters identified several key contributions from the book, that changed the field of future management books.
First was the reorientation from a focus on strategy to recognising the importance of "soft" aspects of business like culture and people.
Second was the use of research and specific case studies to bring ideas about management to life:
In Search of Excellence opened up the way for further research and publication around excellence in business. Jim Collins's books and its sequel Good to Great are widely-known influential later works in this genre.
Third, Peters reflected that In Search of Excellence brought management ideas to a broader audience than previous theorists like Peter Drucker had reached.

Ideas

The ideas in the book remain influential today.
The book essentially boils down to five main tenets:
  1. Maintain vision and values at the core of the organisation
  2. Be customer-centric
  3. Respect and develop employees
  4. Be nimble and adaptive, with flat management structures and loosely coupled business units.
  5. Continue to build core capabilities
The authors advocated an agile, customer-centric organization with a core commitment to values.
From that perspective, many of the points made in the book are timeless rather than ephemeral - and they stand strong today.

Performance

In Search of Excellence is not widely regarded as being great at predicting future success for individual "excellent" companies.
However, the set of "excellent" companies studied, as a whole, still outperformed the market. A 2002 analysis in Forbes found that