HP Insight Global Workload Manager 6.3 User Guide Abstract This document presents an overview of the techniques and tools available for using HP Insight Global Workload Manager software for Integrity servers (or gWLM). It exposes you to the essentials and allows you to quickly get started with gWLM.
© Copyright 2004, 2011 Hewlett-Packard Development Company, L.P. Legal Notice Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor’s standard commercial license. The information contained herein is subject to change without notice.
Contents 1 Overview..................................................................................................7 gWLM Overview......................................................................................................................7 Benefits of using gWLM.............................................................................................................7 Comparison of PRM, WLM, and gWLM features..........................................................................
Securing database communications..........................................................................................31 Securing Postgres communications........................................................................................31 Securing Oracle communications.........................................................................................31 5 Additional configuration and administration tasks.........................................33 Manually adjusting CPU resources..............
Unable to manage partitions with inactive cells or deconfigured cores......................................53 Unable to build a single shared resource domain...................................................................53 Compatibility with PRM and WLM.......................................................................................54 Rare incompatibility with virtual partitions.............................................................................
1 Overview This chapter provides an overview of gWLM, including benefits, key concepts and terms, and the gWLM management model. gWLM Overview gWLM allows you to centrally define resource-sharing policies that you can use across multiple HP servers. Using these policies can increase system utilization and facilitate controlled sharing of system resources. In addition, gWLM provides both real-time and historical monitoring of the resource allocation. gWLM consists of a VSE Central Management Server, or CMS.
Concepts and terms for using gWLM Here are some concepts and terms to know when using gWLM: Workload The collection of processes executing within a single compartment. The compartment can be an nPartition (npar), a virtual partition (vPar), a virtual machine provided by HP Integrity Virtual Machines (hpvm), a processor set (pset), or a Fair Share Scheduler (fss) group. gWLM manages a workload by adjusting the system resource allocations for its compartment.
Mode Two modes are available: advisory and managed. Advisory mode allows you to see what CPU resource requests gWLM would make for a workload—without actually affecting resource allocation. Advisory mode is not available for SRDs containing virtual machines, psets, or fss groups due to the nature of these compartments. Use this mode when creating and fine-tuning your policies.
honoring the Instant Capacity usage rights. As a result, no additional costs are incurred.) Combining gWLM A.04.00.07 or later and an appropriate version of the iCAP software, gWLM's ability to manage nPars using iCAP is extended across multiple complexes that are members of the same Global iCAP group. • HP-UX Virtual Partitions (vPar) A virtual partition is a software partition of a server or of a single nPartition, where each virtual partition runs its own instance of the HP-UX operating system.
a. b. c. gWLM monitors the CPU resource consumption of all the workloads in the SRD during the current allocation interval. At the end of the interval, gWLM adjusts the CPU resource allocations for the compartments in accordance with the policies. It also makes the allocation data available for real-time and historical reports. gWLM repeats the previous two substeps.
(The HP SIM menu bar and VSE Management menu bar are discussed in the section “Tabs and menus” (page 17).) • gwlm command A command-line interface, described in gwlm(1M) . Other components of the command-line interface are: vseinitconfig(1M), gwlmcmsd(1M), gwlmagent(1M), gwlmreport(1M), gwlmplace(1M), gwlmsend(1M), gwlmsslconfig(1M), gwlmstatus(1M), and gwlmxml(4).
Table 2 Where to find additional information (continued) To... See... Learn about gWLM concepts. Global Workload Manager topic in online help1 or HP Insight Global Workload Manager 6.3 User Guide (this document) (http://www.hp.com/go/insightdynamics/docs) Learn gWLM terms. “Concepts and terms for using gWLM” (page 8) or Glossary in online help1 Learn gWLM best practices. “Getting the Most Out of gWLM” topic in online help1 Learn about other gWLM features. HP Insight Global Workload Manager 6.
2 Configuring gWLM to manage workloads This chapter describes the various aspects of configuring gWLM to effectively manage the resources for your workloads. Policy types You can define several types of policies to instruct gWLM how to manage the resources for your workloads. These types are: Fixed Allocates a fixed (constant) amount of CPU resources to a workload’s compartment. gWLM satisfies these policies before attempting to satisfy any other type of policies.
Table 3 Choosing a policy type If... Use the following type of policy... You want gWLM to allocate a constant amount of CPU resources to a workload. Fixed You have your own metric by which you want gWLM to manage a workload. Custom IT acts as a service provider to business units. OwnBorrow This policy type allows you to set an owned amount of resources, while also giving you control over how workloads borrow and lend resources.
Seeing how gWLM will perform without affecting the system gWLM provides an advisory mode that allows you to see how gWLM will approximately respond to a given SRD configuration—without putting gWLM in charge of your system’s resources. Using this mode, you can safely gain a better understanding of how gWLM works. In addition, you can check that your policies behave as expected—with minimal effect on the system.
NOTE: You must be logged in as root on the systems where you run the mxstart, gwlmcmsd, and gwlmagent commands mentioned below. In HP SIM, you must be logged in as root or have authorizations for “All Tools” or “VSE All Tools.” 1. 2.
To see gWLM in action: NOTE: You must be logged in as root on the systems where you run the mxstart, gwlmcmsd, and gwlmagent commands mentioned below. In HP SIM, you must be logged in as root or have authorizations for “All Tools” or “VSE All Tools.” 1. Start the gWLM agent daemons on vpar1 and vpar2: # vpar1> /opt/gwlm/bin/gwlmagent # vpar2> /opt/gwlm/bin/gwlmagent Alternatively, you can start the agents through HP SIM, as discussed in the VSE Management Software Installation and Update Guide. 2.
Common uses for gWLM gWLM is a powerful tool that allows you to manage your systems in numerous ways. The following sections explain some of the more common tasks that gWLM can do for you. Fixing the amount of CPU resources a workload gets gWLM allows you to give a workload a fixed amount of CPU resources. This fixed amount is in the form of a set amount of CPU resources given to an npar, a vpar, a virtual machine, a pset, or an fss group.
Setting up gWLM (initial setup steps) Several of the configuration tasks require the same initial set-up steps. (Each task requiring these steps indicates that the steps are needed.) These steps are given below. NOTE: You must be logged in as root on the systems where you run the gwlmagent command mentioned below. 1. 2. Configure your CMS as indicated in the VSE Management Software Installation and Update Guide, if you have not already done so.
Quick Link Options In the previous procedure, instead of selecting an SRD and using the VSE Management menu bar, you can find the Details table for the SRD and then choose one of the following options: • Click the Change SRD to advisory mode link • Click the Modify SRD link Creating a new policy A policy instructs gWLM how to manage a workload’s resources. You can create a policy when managing a workload or create a policy separately.
5. 6. 7. 8. Select the policy to edit. Click Edit. Edit the settings. Click OK. NOTE: All workloads associated with this policy will automatically use the updated policy. Changing which policy is associated with a workload To change the policy affecting how gWLM allocates resources to a workload: NOTE: In HP SIM, you must be logged in as root or have authorizations for “All Tools” or “VSE All Tools.” 1. 2.
Stop managing a workload When you stop managing a workload: • gWLM stops managing resources for the workload • The workload’s definition is removed from the SRD, although it remains available for placing in another SRD NOTE: When gWLM stops managing npar-based or vpar-based workloads, it leaves the nPars or vPars with the number of cores they had in the last allocation interval. For this reason, in Step 3 below, you associate fixed policies with the workloads based on these types of compartments.
3. Associate fixed policies with all nPars or vPars that were in the SRD. When gWLM stops managing an SRD, it leaves compartments based on nPars or vPars as they were in the last allocation interval. Associating fixed policies allows you to set the sizes exactly to what you want. (For virtual machines, gWLM sets the entitlements of the running virtual machines to their minimums. psets and fss groups are removed in this situation, with their processes going to the default pset or default fss group.
3 Monitoring workloads and gWLM This chapter describes how to monitor workloads and gWLM. Monitoring workloads There are several methods for monitoring workloads, as described below. High-Level view To see a high-level view of the performance of your SRDs and workloads: 1. From the HP SIM menu bar, select: Tools→Virtualization Manager... 2. Click the Shared Resource Domain tab. Graphical reports gWLM provides graphs showing either real-time or historical data through HP SIM.
Monitoring gWLM from the command line There are several command-line tools for monitoring gWLM. These commands are added to the path during installation. On HP-UX systems, the commands are in /opt/gwlm/bin/. On Microsoft Windows systems, the commands are in C:\Program Files\HP\Virtual Server Environment\bin\gwlm\ by default. However, a different path might have been selected at installation.
Table 4 gWLM log files (continued) Log for Location gWLM interface in HP Systems Insight Manager HP-UX: /var/opt/gwlm/gwlm.log.0 Windows: C:\Program Files\HP\Virtual Server Environment\logs\gwlm.log.0 gwlm command HP-UX: /var/opt/gwlm/gwlmcommand.log.0 Windows: C:\Program Files\HP\Virtual Server Environment\logs\gwlmcommand.log.0 NOTE: On systems running Windows, log files are in C:\Program Files\HP\Virtual Server Environment\logs\ by default.
Items to be aware of when using GlancePlus: 30 • Data is displayed only for workloads based on fss groups. Data for the workload with FSS ID 0 is shown without a name. • gWLM workloads are referred to as “PRM Groups” in GlancePlus. • The workload names displayed by GlancePlus might vary slightly from those used in gWLM due to differences in characters allowed in names. • GlancePlus data is in terms of shares percentages of CPU resources, whereas gWLM data is in terms of physical cores.
4 Security This chapter highlights several security items you should be aware of. General security topics The following items are a few general topics on security: • HP provides the HP-UX Bastille product, available from http://software.hp.com at no charge, for enhancing system security. • You can secure gWLM’s communications as explained in the following section. • HP SIM allows you to create user roles with different levels of privileges. For more information, see the HP SIM documentation.
3. Set the following properties as desired: • oracle.net.encryption_types_client • oracle.net.crypto_checksum_types_client For more information on these properties, read their associated comments in the gwlmcms.properties file. 4. 5. 6. Ensure the Oracle listener and port being used by HP SIM is configured to accept secure communication for the encryption and checksum types specified in the previous step. The Oracle database administrator can use netmgr to configure settings on the Oracle server.
5 Additional configuration and administration tasks This chapter covers various configuration and administration tasks. Manually adjusting CPU resources When an SRD is created, it has a certain number of cores. gWLM manages the SRD using the same number of cores. If the SRD—or a policy used in the SRD—is configured to use Temporary Instant Capacity (TiCAP), gWLM can automatically activate that additional capacity to meet policies.
• Creation or deletion of a pset using psrset on a system where gWLM is managing pset compartments. • Performing online cell operations using parolrad. • Enabling and disabling Hyper-Threading. To make use of these additional resources using the gWLM command-line interface: 1. 2. 3. 4. Undeploy the SRD containing the systems that you want to adjust. Make your adjustments. Re-create and re-deploy the SRD.
--backup command . To make use of a backup file, use the vseinitconfig --restore command. For more information, see vseinitconfig(1M).
# FINE # FINER # FINEST # When you set the level, you will see messages only from that level and # the levels that are more severe. So, the SEVERE level produces the fewest # messages, while the FINEST level includes messages from all seven levels. # com.hp.gwlm.util.Log.logLevel = INFO # # Specify the size (in MB) and number of files to use # for logging. For a single file of unlimited size, set # logFileSize to negative one (logFileSize=-1).
# 20 minutes. # # samples: # The number of minutes of real-time data used to aggregate into a # historical data point. The default is to aggregate the data into # 5-minute averages. # com.hp.gwlm.node.cachesize = 20 com.hp.gwlm.node.samples = 5 # # Support for real-time graphing properties. # # viewport: # The size of the displayed real-time graph (in minutes). # # refresh: # The refresh rate of the real-time graphs and tables (in seconds). # com.hp.gwlm.ui.monitor.viewport = 20 com.hp.gwlm.ui.monitor.
# # # # # # # Global Workload Manager Agent on a given managed node. The agent on each managed node uses the default values unless you edit that node's gwlmagent.properties file. You must restart gwlmagent for changes made to this file to take effect. # # Set FileHandler /var/opt/gwlm/gwlmagent.log.0 log level.
# com.hp.gwlm.node.ticap.minimumBalance = 30 Communications ports gWLM uses the following ports for communications: Managed nodes: 9617 CMS: 9618 If you need to change these ports, add the following lines: com.hp.gwlm.cms.port = portX com.hp.gwlm.node.port = portY to both properties files: • gwlmcms.properties On HP-UX, this file is in /etc/opt/gwlm/conf/. On Windows, it is in C:\ Program Files\HP\Virtual Server Environment\conf\.
NOTE: HP recommends starting these daemons at boot only when used in a secure operating environment. Setting GWLM_CMS_START to 0 (zero) prevents automatic use at boot of HP Virtualization Manager and HP Capacity Advisor. The gwlmCtl file is shown below: ######################################################################## # (C) Copyright 2004-2008 Hewlett-Packard Development Company, L.P. # # gWLM Configuration File # # $Revision: 1.
This feature works best when one managed node is lost at a time or all managed nodes are lost. NOTE: If a vpar is borrowing cores from other vPars when it loses contact with its SRD, those borrowed cores might be separated from the SRD. If the vpar might be down for an extended time, check that the SRD has reformed without that vpar and that it has enough cores to meet its commitments. If not, try using vparmodify to reclaim some of the cores.
3. If the problem persists, check the files /var/opt/gwlm/gwlmagent.log.0 and /var/ opt/gwlm/gwlmcmsd.log.0 for additional diagnostic messages. “SRD Communication Issue” and “SRD Reformed with Partial Set of Nodes” events NOTE: SRD. Reforming with a partial set of nodes requires a minimum of three managed nodes in the NOTE: “SRD Communication Issue” events are not enabled by default.
NOTE: If the gWLM CMS and agent disagree about whether an SRD is deployed or undeployed, you can use the --force option with the gwlm deploy or gwlm undeploy commands. Nesting partitions gWLM allows you to form SRDs consisting of various compartment types. This ability provides flexibility in dividing your complex. For example, you can divide your complex as shown in Figure 2. The complex has four nPars, two of which are divided into vPars.
Then, click the Shared Resource Domain tab. From the VSE Management menu bar, select: Create→Shared Resource Domain • When editing an SRD From the HP SIM menu bar, select: Tools→Virtualization Manager... Then, click the Shared Resource Domain tab. From the VSE Management menu bar, select: Modify→Shared Resource Domain Changing the interval on the command line Use the gwlm command and a text editor to change the interval on the command line: 1. 2.
Figure 3 Using gWLM with hosts separated by firewalls Firewall Public network vparA vparB vparC vparD Hostname on public network CMS mgmtA mgmtB mgmtC mgmtD Hostname on management LAN Management LAN On the public network, the hosts can be accessed through their hostnames: vparA, vparB, vparC, and vparD. However, they cannot access each other through those names.
2. The CMS must also be in the management LAN. If the primary hostname for the CMS is not the name it uses in the management LAN: a. Edit the gwlmagent.properties file on the CMS to include the property: com.hp.gwlm.security.virtualLocalHostName=hostnameOnLAN On HP-UX, the gwlmagent.properties file is in /etc/opt/gwlm/conf/. On Windows, it is in C:\Program Files\HP\Virtual Server Environment\conf\. (The given Windows path is the default; however, a different path might have been selected at installation.
Incorrectly configured host name or IP address You might see the following message in a log file (gwlmagent.log.0 or gwlmcmsd.log.0): Unable to determine the network address and/or hostname of the current host. This indicates a mis-configured network and/or a host name resolution issue for this host. For troubleshooting information, see the VSE Management Software Release Notes and search for this message.
[mysystem#4] > nslookup 15.11.100.17 Trying DNS Name: mysystem.mydomain.com Address: 15.11.100.17 Fix any issues by editing /etc/hosts or for additional information, see: • The HP-UX IP Address and Client Management Administrator's Guide, available online at http://www.hp.com/go/bizsupport. • The BIND 9 Administrator Reference Manual, available from the Internet Systems Consortium at http://www.isc.org/sw/bind/arm93. • The Windows documentation.
6 Support and other resources This chapter contains support information and the available resources for the HP Insight Global Workload Manager software for Integrity servers.
Warranty information HP will replace defective delivery media for a period of 90 days from the date of purchase. This warranty applies to all Insight software products. HP authorized resellers For the name of the nearest HP authorized reseller, see the following sources: • In the United States, see the HP U.S. service locator web site: http://www.hp.com/service_locator • In other locations, see the Contact HP worldwide web site: http://welcome.hp.com/country/us/en/wwcontact.
A Compatibility with agents The gWLM A.6.3.0.* CMS runs on HP-UX 11i v1 (B.11.11), HP-UX 11i v2 (B.11.23), HP-UX 11i v3 (B.11.31), and Microsoft Windows systems. It works with the following versions of the agents: • gWLM A.03.00.00.05: HP-UX 11i v1, HP-UX 11i v2, HP-UX 11i v3 • gWLM A.03.00.01.05: HP-UX 11i v1, HP-UX 11i v2, HP-UX 11i v3 • gWLM A.04.00.07: HP-UX 11i v1, HP-UX 11i v2, HP-UX 11i v3 • gWLM A.04.01.00.*: HP-UX 11i v1, HP-UX 11i v2, HP-UX 11i v3 • gWLM A.6.0.0.
B Global Workload Manager A.6.3.0.* Known issues This appendix contains the limitations and known issues for the Global Workload Manager (gWLM) A.6.3.0.* release. Limitations The following are limitations for Global Workload Manager. HP Integrity Superdome 2 support HP Global Workload Manager (gWLM) supports fss, psets, and HP Integrity Virtual Machines on HP Integrity Superdome 2. It does not support nPars and vPars. Online migration of CPU is also not supported.
Workaround This message indicates that there are no supported resource-sharing mechanisms available between the specified hosts. The message can occur if: • You have specified hosts in different complexes and the complexes are not managed in the same GiCAP group. • You have specified hosts in different nPartitions in a complex when there are no iCAP usage rights to share between the nPartitions.
disrupt the Virtualization Manager and Capacity Advisor tracking of the workload utilization between cluster members. Thus, it is recommended that you not directly manage a workload associated with a Serviceguard package. Workaround For all hosts to which a workload associated with a Serviceguard package might fail over, you must apply a policy to an enclosing operating system instance (virtual partition or nPartition).
Workaround Remove old historical monitoring and configuration data from the gWLM database by entering the following command: # gwlm history --truncate --truncate= If you prefer not to trim the database, you can delete multiple workloads simultaneously using the gwlm delete command. For more information, see gwlm(1M).
Workaround There is no workaround; this is simply how fss groups are implemented on a system with psets. You can continue with your fss groups inside pset 0 (leaving the other psets unmanaged), manage using psets instead (ignoring fss groups), or remove all the psets (other than pset 0) using the following command: # psrset -d all Custom metrics lost on redeploy Custom policies use metric values that you provide via the gwlmsend command.
Workaround Use Java 1.5.0.12 or later. gWLM commands core dump Attempts to run gwlm commands result in core dumps when /var is full. Workaround Make space available in /var. Multiple time changes on CMS might render gWLM unusable If the time on the CMS is changed to a point in the future, changes to the gWLM configuration are made and time on the CMS is moved back to the present; gWLM will not recognize any new changes as the latest configuration.
Workaround Time a gwlm list command on the CMS. If it takes more than 10 seconds, perform the following steps: 1. In the file /etc/opt/gwlm/conf/gwlmcms.properties (HP-UX) or install-path\VirtualServerEnvironment\conf\gwlmcms.properties (Windows), increase the CMS database cache size by increasing the value of the com.hp.gwlm.cms.cachesize property by 25%. (The cache is more memory efficient if the size is near a power of 2. If your target cache size is close to a power of 2, round it up to the next power.
Modifying Java while gWLM is running gWLM does not support any actions (including the use of update-ux) that remove, overwrite, or otherwise modify the version of Java that gWLM is using in a managed node or CMS that is part of a deployed SRD. Workaround Undeploy an SRD before taking any actions that affect the version of Java that gWLM is using on systems that are part of the SRD.
Workaround Undeploy the SRD using the --force option with the gwlm undeploy command, and restart gwlmagent on the managed node. SRD deployment times out and displays a blank screen If you attempt to deploy an SRD, but: • gWLM times out and displays a blank screen • There are events from each managed node similar to the following event: gWLM Agent MySystem.MyDomain.com Information Unable to manage the following hosts: Associated Exception Unable to manage the following hosts: MySystem.MyDomain.
Sizes/allocations less than policy minimums for Virtual Machines The sizes or allocations for virtual machines in a deployed SRD can appear to be less than their policy minimums. Workaround Wait a few minutes, since it can take several minutes for gWLM to recognize a virtual machine transition between the states of off and on.
# gwlm deploy --srd=SRD --force For more information about the gwlm command, see gwlm(1M). The agents should be restarted to clear their configuration. The following steps should be performed on all agents: # # # # gwlmagent --stop rm /etc/opt/gwlm/deployed.config rm /var/opt/gwlm/RPmap (If it exists.
Index security, 31 set up, 21 startup behavior, 39 support, 49 tabs and menus, 17 wizard, 17 A advisory mode, 17 advisory mode to managed mode change, 21 automatic restart gWLM managed nodes in SRD, 40 C communication ports, 39 compartment, 8 compatibility with agents, 51 conditional policy, 15 configuration, 20 CPU resources manual adjustment, 33 custom policy, 15 H D K database backup and restore, 35 deploy, 9 known issues, 53 F memory resources manual adjustment, 34 message logs, 28 messages inc
node failed to rejoin SRD, 41 stop managing, 24 startup behavior, 39 support, 49 T tabs and menus, 17 typographic conventions, 50 U unable to create new native thread, 48 undeploy, 9 utilization policy, 15 V virtual partition, 10 W wizard, 17 workload, 8 disk space requirement, 34 monitoring, 27 stop managing, 24 66 Index