List of benchmarking methods and software tools
requires the use of specific valuation methods. With evaluation is meant the level of achieving the target for a particular evaluation item. There are general "methods" respectively approaches as well as IT-supported "software tools" that enable an effective and efficient work.
The following is a list of notable methods and benchmarking software tools.
Benchmarking methods
There are many benchmarking methods each having different analytical focus. The methods are mostly known and will be shown in the following summary.Methods | Notes |
Matrix technology | |
Comparison tables | |
Graphs: Pie chart, Bar chart / Histogram | |
SWOT analysis | |
Potential/resources-analysis | |
Price/performance ratio | |
Potential analysis | |
Life cycle analysis | |
market growth/market share portfolio | |
market attractiveness/competitive strength portfolio | |
Portfolio attractiveness customer/supplier position | |
Technology/resource strength | |
Market position/technology position portfolio | |
Contribution margin/cost development portfolio | |
Price/customer satisfaction portfolio | |
Revenue share/revenue portfolio | |
Spider web diagram |
Benchmarking software tools
There are a number software tools that allow the support of different kinds of benchmarking types.Software | Publisher | Platforms | Notes |
Subscribe Labs Inc | web-based | This web-based software platform allows any peer group benchmark any performance area of interest. Data is kept secure, identities are kept anonymous and results are shared in a log-in only environment with time-series visualizations and detailed views. | |
BenchmarkIndex | Winning Moves Ltd | web-based | |
Combo Benchmark | Compare to Compete Online Benchmarking | web-based database | This web-based database is suitable for groups of competitors to benchmark individual performance against group performance. All process and performance benchmarks can be processed in this software, providing interesting analysis tools and complete benchmarking report. |
GOBENCH | INDEC GmbH & Co. KG | web-based database | The web-based database supports different kinds of benchmarking categories and allows reams of analysing possibilities |
PowerStats Limited, Auckland, NZ | web-based, automated, self-service | PowerStats is a highly-automated platform intended to allow groups of competitors to contribute, manage and visualize data for purposes of benchmarking. Participants load raw data on a regular basis, and PowerStats creates relevant KPIs in real-time, making them available via self-service charts and tables via its online interface. | |
Workload Simulator | IBM | mainframe server | WSim simulates one or many network terminal to load a mainframe computer system by executing programmed scripts, for functional testing, system testing, regression testing, capacity management, benchmarking and stress testing. It is a re-packaged, subset version of IBM's Teleprocessing Network Simulator. |
SAP | web-based, automated, self-service | SAP Value Lifecycle Manager version = Based on an internal system that has been in use for more than 10 years. After registering, it is self-service for survey capture and provides personalized dashboards. The idea being that you can estimate the value of a business initiative. |
Benchmarking HPC Clusters
There are numerous suites for examining the performance of a High Performance Computing cluster, including- ADEPT - 4 suites relating to energy measurements
- HPCC, HPCG, Linpack
- IMB - gives rates for common MPI-1 point-to-point and collectives
- Mantevo - series of "mini apps" from Sandia National Labs
- NAS & NPB
- SHOC - for accelerators
- Stream