IBM Parallel Sysplex
In computing, a Parallel Sysplex is a cluster of IBM mainframes acting together as a single system image with z/OS. Used for disaster recovery, Parallel Sysplex combines data sharing and parallel computing to allow a cluster of up to 32 systems to share a workload for high performance and high availability.
Sysplex
In 1990, IBM mainframe computers introduced the concept of a Systems Complex, commonly called a Sysplex, with MVS/ESA SPV4.1. This allows authorized components in up to eight logical partitions to communicate and cooperate with each other using the XCF protocol.Components of a Sysplex include:
- A common time source to synchronize all member systems' clocks. This can involve either a Sysplex timer, or the Server Time Protocol
- Global Resource Serialization, which allows multiple systems to access the same resources concurrently, serializing where necessary to ensure exclusive access
- Cross System Coupling Facility, which allows systems to communicate peer-to-peer
- Couple Data Sets
- Console services – allowing one to merge multiple MCS consoles from the different members of the Sysplex, providing a single system image for Operations
- Automatic Restart Manager – Policy to direct automatic restart of failed jobs or started tasks on the same system if it is available or on another LPAR in the Sysplex
- Sysplex Failure Manager – Policy that specifies automated actions to take when certain failures occur such as loss of a member of a Sysplex or when reconfiguring systems
- Workload Manager – Policy based performance management of heterogeneous workloads across one or more z/OS images or even on AIX
- Global Resource Serialization - Communication – allows use of XCF links instead of dedicated channels for GRS, and Dynamic RNLs
- Tivoli OPC – Hot standby support for the controller
- RACF – Sysplex-wide RVARY and SETROPTS commands
- PDSE file sharing
- Multisystem VLFNOTE, SDUMP, SLIP, DAE
- Resource Measurement Facility – Sysplex-wide reporting
- CICS – uses XCF to provide better performance and response time than using VTAM for transaction routing and function shipping.
- zFS – Using XCF communication to access data across multiple LPARs
Parallel Sysplex
The Coupling Facility may reside on a dedicated stand-alone server configured with processors that can run Coupling Facility control code, as integral processors on the mainframes themselves configured as ICFs, or less common, as normal LPARs. The CF contains Lock, List, and Cache structures to help with serialization, message passing, and buffer consistency between multiple LPARs.
The primary goal of a Parallel Sysplex is to provide data sharing capabilities, allowing multiple databases for direct reads and writes to shared data. This can provide benefits of
- Help remove single points of failure within the server, LPAR, or subsystems
- Application Availability
- Single System Image
- Dynamic Session Balancing
- Dynamic Transaction Routing
- Scalable capacity
- DB2
- IBM Information Management System.
- VSAM
- IDMS
- Adabas
- DataCom
- Oracle
- Catalog – shared catalogs to improve performance by reducing I/O to a catalog data set on disk
- CICS – Using the CF to provide sharing and recovery capabilities for named counters, data tables, or transient data
- DFSMShsm – Workload balancing for data migration workload
- GRS Star – Reduced CPU and response time performance for data set allocation.
- Dynamic CHPID Management, and I/O priority management
- JES2 Checkpoint – Provides improved access to a multisystem checkpoint
- Operlog / Logrec – Merged multisystem logs for system management
- RACF – shared data set to simplify security management across the Parallel Sysplex
- WebSphere MQ – Shared message queues for availability and flexibility
- WLM - provides support for Intelligent Resource Director to extends the z/OS Workload Manager to help manage CPU and I/O resources across multiple LPARs within the Parallel Sysplex. Functions include LPAR CPU management, IRD.
- XCF Star – Reduced hardware requirements and simplified management of XCF communication paths
- Coupling Facility hardware, allowing multiple processors to share, cache, update, and balance data access;
- Sysplex Timers or Server Time Protocol to synchronize the clocks of all member systems;
- High speed, high quality, redundant cabling;
- Software.
With STP and ICFs it is possible to construct a complete Parallel Sysplex installation with two connected mainframes. Moreover, a single mainframe can contain the internal equivalent of a complete physical Parallel Sysplex, useful for application testing and development purposes.
The IBM Systems Journal dedicated a full issue to all the technology components.
Server Time Protocol
Maintaining accurate time is important in computer systems. For example, in a transaction-processing system the recovery process reconstructs the transaction data from log files. If time stamps are used for transaction-data logging, and the time stamps of two related transactions are transposed from the actual sequence, then the reconstruction of the transaction database may not match the state before the recovery process.Server Time Protocol can be used to provide a single time source between multiple servers. Based on Network Time Protocol concepts, one of the System z servers is designated by the HMC as the primary time source. It then sends timing signals to the Stratum 2 servers through use of coupling links. The Stratum 2 servers in turn send timing signals to the Stratum 3 servers. To provide availability, one of the servers can be designated as a backup time source, and a third server can be designated as an Arbiter to assist the Backup Time Server in determining if it should take the role of the Primary during exception conditions.
STP has been available on System z servers since 2005.
More information on STP is available in “Server Time Protocol Planning Guide”.
Geographically Dispersed Parallel Sysplex
Geographically Dispersed Parallel Sysplex is an extension of Parallel Sysplex of mainframes located, potentially, in different cities. GDPS includes configurations for single site or multiple site configurations:- GDPS HyperSwap Manager: This is based on synchronous Peer to Peer Remote Copy technology for use within a single data center. Data is copied from the primary storage device to a secondary storage device. In the event of a failure on the primary storage device, the system automatically makes the secondary storage device the primary, usually without disrupting running applications.
- GDPS Metro: This is based on synchronous data mirroring technology that can be used on mainframes apart. In a two-system model, both sites can be administered as if they were one system. In the event of a failure of a system or storage device, recovery can occur automatically, with limited or no data loss.
- GDPS Global - XRC: This is based on asynchronous Extended Remote Copy technology with no restrictions on distance. XRC copies data on storage devices between two sites such that only a few seconds of data may be lost in the event of a failure. If a failure does occur, a user must initiate the recovery process. Once initiated, the process is automatic in recovering from secondary storage devices and reconfiguring systems.
- GDPS Global - GM: This is based on asynchronous IBM Global Mirror technology with no restrictions on distance. It is designed for recovery from a total failure at one site. It will activate secondary storage devices and backup systems.
- GDPS Metro Global - GM: This is a configuration for systems with more than two systems/sites, for purposes of disaster recovery. It is based on GDPS Metro together with GDPS Global - GM.
- GDPS Metro Global - XRC: This is a configuration for systems with more than two systems/sites for purposes of disaster recovery. It is based on GDPS Metro together with GDPS Global - XRC.
- GDPS Continuous Availability: This is a disaster recovery / continuous availability solution, based on two or more sites, separated by unlimited distances, running the same applications and having the same data to provide cross-site workload balancing.