Capacity Planning According To Clingon
Capacity Planning According To Clingon
Performance Professionals
The Computer Measurement Group, commonly called CMG, is a not for profit, worldwide organization of data processing professionals committed to the
measurement and management of computer systems. CMG members are primarily concerned with performance evaluation of existing systems to maximize
performance (eg. response time, throughput, etc.) and with capacity management where planned enhancements to existing systems or the design of new
systems are evaluated to find the necessary resources required to provide adequate performance at a reasonable cost.
This paper was originally published in the Proceedings of the Computer Measurement Group’s 1997 International Conference.
Copyright 1997 by The Computer Measurement Group, Inc. All Rights Reserved. Published by The Computer Measurement Group, Inc. (CMG), a non-profit
Illinois membership corporation. Permission to reprint in whole or in any part may be granted for educational and scientific purposes upon written application to
the Editor, CMG Headquarters, 151 Fries Mill Road, Suite 104, Turnersville , NJ 08012.
BY DOWNLOADING THIS PUBLICATION, YOU ACKNOWLEDGE THAT YOU HAVE READ, UNDERSTOOD AND AGREE TO BE BOUND BY THE
FOLLOWING TERMS AND CONDITIONS:
License: CMG hereby grants you a nonexclusive, nontransferable right to download this publication from the CMG Web site for personal use on a single
computer owned, leased or otherwise controlled by you. In the event that the computer becomes dysfunctional, such that you are unable to access the
publication, you may transfer the publication to another single computer, provided that it is removed from the computer from which it is transferred and its use
on the replacement computer otherwise complies with the terms of this Copyright Notice and License.
Copyright: No part of this publication or electronic file may be reproduced or transmitted in any form to anyone else, including transmittal by e-mail, by file
transfer protocol (FTP), or by being made part of a network-accessible system, without the prior written permission of CMG. You may not merge, adapt,
translate, modify, rent, lease, sell, sublicense, assign or otherwise transfer the publication, or remove any proprietary notice or label appearing on the
publication.
Disclaimer; Limitation of Liability: The ideas and concepts set forth in this publication are solely those of the respective authors, and not of CMG, and CMG
does not endorse, approve, guarantee or otherwise certify any such ideas or concepts in any application or usage. CMG assumes no responsibility or liability
in connection with the use or misuse of the publication or electronic file. CMG makes no warranty or representation that the electronic file will be free from
errors, viruses, worms or other elements or codes that manifest contaminating or destructive properties, and it expressly disclaims liability arising from such
errors, elements or codes.
General: CMG reserves the right to terminate this Agreement immediately upon discovery of violation of any of its terms.
Learn the basics and latest aspects of IT Service Management at CMG's Annual Conference - www.cmg.org/conference
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
THE KLINGON WARRIOR CODE
AND
THE FERENGI RULES OF ACQUISITION
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
Jerry Rosenberg
SRM Associates, Ltd.
Data processing has evolved over the past three plus decades. We now
have several generations of practitioners working in the field of capacity
planning. Unfortunately, the newer practitioners view the old guard as out-
moded and archaic. They also seem to feel that the lessons that have
been learned in the dark ages of mainframe-centric computing have little
value in a new era of distributed data processing. This is unfortunate,
since the basic rules and techniques remain as applicable today as they
were in the past.
To illustrate this point, this paper will borrow from the guidelines of two
fictional cultures - the Klingon and the Ferengi of Star Trek fame - and
show that some basic truths cross cultural boundaries and remain
applicable in a universal manner.
By considering maxims from the Klingon Warrior’s Code and The Ferengi
Rules of Acquisition and observing their relevance to time honored tenets
of system management and capacity planning, the paper will demonstrate
that the basic rules haven't really changed and should still be followed.
Background Deep Space Nine. They scorn the deeply felt Klingon
beliefs and are scheming and quite manipulative.
The use of both Klingon & Ferengi social mores as a Difficult to like, but successful.
baseline is inherently interesting in that these two
cultures are themselves as totally different from each Each of these cultures follows a code by which they
other as they are from current day humans & data live and deal with others. The Klingons follow The
processing. Warrior's Way and the Ferengi have the Rules of
Acquisition. Since these two groups have opposing
Those of us who were among the original Trekkie’s values and viewpoints, it would seem unlikely that the
were exposed to only the evil side of the Klingons as same lessons can be learned from both. We will
fought by Captain Kirk and Mr. Spock. We later found show that the fundamental rules which these two
out, in the next generation with the help of Jean-Luc groups adhere to can serve as guidelines for a
and Warf, that they were actually a honorable warrior successful capacity planning process. Even though
culture with very strong values relating to loyalty and these Klingons and Ferengi are more incompatible
family. than mainframe and distributed system practitioners,
some of the basic rules are, in fact, so elementary that
The Ferengi, on the other hand, are driven by only they cross cultural boundaries. The same holds true
one rule - profit. We introduce to this race aboard for the central process and techniques of capacity
planning and resource management. If these two
diverse cultures can sometimes share common rules, embraced operating platforms made their debuts with
it stands to reason that many of the time honored somewhat less than robust measurement and tuning
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
principles of capacity planning as learned by the old suites to support them. Fortunately, this situation is
dinosaurs, can be readily applied to today's systems. being aggressively addressed and rectified on several
fronts. Even in the scaleable environments, we are
We begin our investigation with one of the first recognizing that scalability does not go on forever.
lessons that we learned as performance analysts and There are capacity limits and there are performance
capacity planners. bottlenecks that need to be addressed. Because
ultimately we experience the Ferengi Truth - “Enough
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
enterprise. They must all be managed and monitored. will be, you need to understand where you are. The
Information is required constantly. But beware, it will issue for alternate platform capacity planners is that
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
take time to gather the proper data, develop a the measurement data may not be as robust or
reporting structure, and most critically, gain an standardized as it is on the mainframe. It might even
understanding of how the system behaves on a daily be necessary to rely on benchmarking to acquire the
basis in order to apply this understanding to the task needed data for workload characterization. The
of optimizing the use of computing resources. bottom line is the development of how the key
workloads on the system use the resources of that
The Ferengi know that “Free advice is seldom system.
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
the analysis process. It will be an important The usual outcome of the capacity planning process
component of overall performance. is the yearly Capacity Plan. It is wise to remember,
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
that in order for the capacity plan to be a reasonable
Forecasting document that represents an accurate assessment of
Based on both historical information and discussions the state of performance and resource usage in the
with the user community, estimates of future workload data center, it must be based on analysis that has
volumes can be developed. Traditionally, this can be taken place over time - not just a quick snapshot view
accomplished by reviewing performance data, of computing activity. In other words, ”To
analyzing the trends and obtaining information on understand life, endure pain”. While this Klingon
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
potential growth and new system implementations. view is somewhat harsh, it does make the point. In
order to understand your data processing
Unfortunately, significant historical data will probably environment, you need to measure, monitor and
not be available for the newer server based platforms. record it regularly. Consider that it may even be
Some assumptions as to trends can be made based necessary to gather the data by performing
on mainframe data, but the analyst must be extremely specialized benchmarks or directed tests to
careful about making direct conversions of relative concentrate on the measurement of areas of concern
utilization numbers. or key workloads in the system. There are no
shortcuts to this requirement for gathering data and
Ultimately, we will be required to gather some carefully analyzing it.
information from the user community. This is a very
good place to practice a new found sensitivity to the Some analysts may believe that there are, in fact,
needs of “other cultures”. The user community has easy shortcuts – rules of thumb (ROTs). To that
different needs and goals than data processing staffs, belief I respond, “Victory must be earned”. Rules of
but they are the customers and there is a definite thumb may offer a quick answer to performance or
requirement to form a symbiotic relationship. They capacity questions and may occasionally be correct,
need access to computing services that meet their but they do not always apply to your specific
requirements. Data processing needs them as a environment. The only way to determine the proper
customer and also to supply enough information to solution to your particular situation is to understand
adequately predict current and future needs. If we your environment and the factors that cause it to
don't work together, we will ultimately all fail. operate in a specific manner. I know that this requires
some effort but “Klingons do not run from battles”.
Performance Prediction
Using the information gathered on current system Performance Optimization
performance and anticipated workload changes; the
capacity planner must recommend the most cost This doesn’t mean that there are no guidelines to
effective hardware/software solution that will satisfy follow in the search for performance and capacity
user requirements consistently. Using an analytic answers. The solution is to develop a methodology
approach, predictions of the performance of various that employs established procedures in solving
hardware and software alternatives are evaluated problems in a changing environment. In the case of
given the expected workload volumes. These performance analysis, the following approach still
predictions must be geared to reasonable levels of works:
service, to be delivered to the user community.
There are only three components to any computer
The analytic approach utilized can range from simple system:
calculations on paper to very sophisticated queuing
models. Generally, it is best to only use the level of • CPU
detail that is required to answer the question at hand. • I/O
The more robust modeling tools that exist for • Memory
mainframe prediction are now becoming available for
client/server systems. In the interim, standard Over the years it has been necessary to reevaluate
statistical analysis and common sense can go a long this basic truth and it has withstood the test of time
way. For more detailed analysis, benchmarks may and technological innovation. Periodically, the
be in order. consideration of such items as cache controllers and
expanded storage and the ensuing debate as to
The Capacity Plan whether they are memory or I/O or some hybrid of
both have arisen. Consistently, the focus remains that
all computer work generates CPU usage, is fed by do not enhance the relationship between DP and
input and creates output and takes up some amount management. The capacity plan must supply
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
of storage. (A good example of this is the discussion sufficient information for management levels to make
above regarding the network as a form of I/O.) As intelligent decisions concerning resource
such, The understanding of computer performance requirements for the enterprise and it must identify
requires an awareness of how these three reasonable options to users in the client server world.
commodities are utilized and the symbiotic effects of It should not be a technical document couched in DP
each on the others. This leads to the basis of the jargon. It should relate DP needs to the business
performance analysis process - the CPU-I/O-memory plan and make a case for the proposed configuration
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
interdependency. This relationship exists on all that is based on bottom line profitability to the
computing platforms and allows the analyst to focus company. A functional capacity plan should offer:
corrective action by isolating the root cause of the
problem on whatever configuration or combination of • Multiple alternatives (mainframes &/or alternate
configurations is being used. platform)
• A benefit/impact analysis for each option
1. If the CPU is at 100% utilization or less and the • Cost comparisons
required work is being completed on time, everything • Discussions of the reasonable useful life of the
is okay for now. (But always remember, tomorrow is proposed configurations
another day).
2. If the CPU is at 100% busy and all the required Give management enough information to make
work is not completed, you have a problem. Begin informed decisions in support of user needs.
looking at the CPU level.
3. If the CPU is not 100% busy, and all work is not It is advisable to remember that a single ‘Capacity
completed, a problem also exists and the I/O and Plan’ is often not the right solution. In most cases,
memory subsystems should be investigated. there is a need to perform multiple analyses of
different situations to form a focused view. For
At first glance this seems a trifle simplistic. For example, planning for the implementation of a new
example, rule 2 could occur if a problem existed in the on-line transaction support system executing during
memory subsystem causing excessive CPU due to prime time, would require a very different analysis
paging activity. While this is a memory problem, the than an investigation of the night time batch window.
way to uncover it is to decompose CPU utilization into But both prime shift and batch windows would have to
its component parts and to see which of these is be considered when developing a comprehensive
excessive. In this example, excessive CPU on behalf capacity plan. So always “Focus on the target” to
of paging would suggest an investigation of memory optimize the value of your efforts. Additional
usage. Additionally, rule 3 will generally manifest itself examples of a need of a consolidated view of
as a result of queuing for I/O or memory or long waits computing requirements include:
in either subsystem.
• Planning for a distributed system in which the
This would appear to supply performance analysts analyst must consider the performance and
with a ”cookbook” approach to investigating computer capacity implications of each server, the clients
systems. (This is probably a good point to mention and the network in order to develop a total picture
that capacity planning is basically the process of of required resources.
proactively applying performance analysis to a future • Planning for a complex configuration that
scenario. Therefore the same rules apply). It is left to encompasses both distributed servers and a
the individual analyst to select preferred data capture, mainframe. An example might be the use of a
analysis and reporting tools to facilitate this process mainframe for data warehousing and
on each platform type. management (e.g. DB2) while transaction
processing is supported on a client/server
Management Focus network. Once again, the analyst must
investigate the performance issues on each
Another frequent shortcoming of the Capacity Plan is component and then combine these to develop an
that it is often couched in detailed technical terms that overall projection of configuration resource
have little meaning to the decision makers it is meant requirements.
to influence. Many capacity plans have little or no
relation to the business and are linguistically Reporting
incomprehensible to management personnel. These
This focus is also very important in the area of designing reports, first determine the message that
reporting. While the capacity plan is often the central you are trying to deliver and what the primary focus of
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
focus of the resource management effort, it should not the report/analysis is. Concentrate on that issue and
be the only document that is produced. The year- limit the report to satisfying that goal.
round effort should be supported by a reporting
system that responds to the needs of both technical In addition, it is important to utilize reports as a
and management staffs. Most analysts realize that feedback mechanism for yourself and for others.
reports are necessary in the development of the “Have the courage to admit your mistakes”. It is
capacity plan, but don’t develop a structure that always best to point out flaws in your analysis and
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
monitors on-going performance, flags changes in key projections before others do. Particularly, when you
measurements and facilitates corrective actions. This can also present a course of corrective action. But
type of comprehensive reporting system is central to especially don’t be shy about publicizing your
the successful resource management effort. successes either.
The basic requirements of any chargeback system Consider the issue in this manner - it is probably fair
that you implement are: to expect that an experienced salesperson has the
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
basic skills that allow him to sell almost any product.
• Ease of maintainable We would, however, be disappointed if that
• Repeatable charges salesperson did not invest some time and effort in
• Readily automated and integrated with financial “knowing the product”. Would you be happy buying a
systems car from a salesperson who was only doing auto sales
• Understandable to users and management part time but was really a furniture salesperson? All of
• us have basic DP knowledge. What we need to
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
Equitable
• Auditable acquire is an understanding of the DP role in
supporting our corporation’s business plans.
• Able to influence behavior to support standards
One good way to achieve success in the corporate
In other words, everyone should be able to
environment is to constantly anticipate not only the
understand the system and trust it.
questions that your boss will ask you, but also the
questions that your boss is likely to be asked by the
Satisfying the Customer next level up. If you can be ready to supply
information to answer those questions offer it before
The ultimate truth, as any Ferengi businessperson the questions are asked; you will be on the road to
can tell you, is that the art of surviving consists of success. Now expand this horizon to include
dealing well with your customer base. The customers anticipation of user needs and you can truly excel in
of capacity plan include the user community and the new world.
corporate management. In the end, it is their
requirements that we need to satisfy. To many of us, 3. Make Every Effort and Recommendation to
they seem more difficult to understand than the Enhance the Supportive Role of Data Processing.
Klingons and Ferengi. Here are some very basic The basic charter of capacity planning must include
guidelines to follow in developing your capacity the mission of making data processing more
planning process: responsive to the needs of the enterprise. If we learn
1. Understand the Business. the goals of the users and how we can support them,
Spend some time researching the question of what we can address the issue of supporting them better,
the corporation does for a living. Read trade faster, more economically and more proactively.
publications, not only in DP matters, but also in your
company’s area of interest. Find out what the non-DP Summary
user departments do for a living and how they support
and enhance the business enterprise.
The people that we deal with regularly and the
Learn the key concerns, acquire the jargon and situations in which we find ourselves, to which we
develop an empathy for the business process and its must adapt, may often seem as strange as Klingon or
dynamics. This is not an easy or trivial task, but the Ferengi cultures. It is prudent to remember the
benefits are enormous. lessons of Star Trek – These very diverse cultures
can function together and challenges can be
2. Appreciate the Relationships between the overcome successfully. In fact, adaptation and
cooperation are required for survival and success. It
Business and DP.
just takes a view to the past in using the knowledge
It is assumed that we have a reasonable knowledge
that we have accumulated, an open mind in applying
of DP fundamentals and the technical environment in
that knowledge to new situations, and the readiness to
place. Given that and some active effort to achieve an
understand the needs of those with whom we need to
understanding of the business, the capacity planner
coexist.
should focus on determining how data processing
acts to support the activities of the enterprise. Are we
It is wise to remember that while many things change,
actually assisting the user departments in achieving
some things stay the same. This is why we find
their goals? Do we enhance corporate bottom line
common threads in the underlying structure of
performance? In short, is there a symbiotic
seemingly different cultures. In our daily professional
relationship between DP and the corporation and how
lives, we can find much of value by reviewing the
it functions?
techniques and processes that have been used in the
past and applying them to emerging technologies.
Buy the Latest Conference Proceedings and Find Latest Computer Performance Management 'How To' for All Platforms at www.cmg.org
new environment, and applying the updated process J. Bleker, “ UNIX Capacity Planning Hints And Tips”,
to the problem at hand. This approach will be more CMG Proceedings 1994
productive and expedient than constantly trying to
reinvent the wheel. B. Domanski, “Capacity Management For Client–Server
Architectures: Techniques & Systems Management Issues”,
You will find that this analysis is well worth the effort.
CMG Proceedings 1994
“There is no substitute for success” (Ferengi rule
Join over 14,000 peers - subscribe to free CMG publication, MeasureIT(tm), at www.cmg.org/subscribe
58).
G. J. Lipovich, B. Gauthier and B. Pieper, “Shoes For The
Cobbler’s Children: The Rightsizing of Performance And
Capacity Management”, CMG Proceedings 1994