vCenter Server and Host Management Update 1 ESXi 5.0 vCenter Server 5.0 This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this document, see http://www.vmware.com/support/pubs.
vCenter Server and Host Management You can find the most up-to-date technical documentation on the VMware Web site at: http://www.vmware.com/support/ The VMware Web site also provides the latest product updates. If you have comments about this documentation, submit your feedback to: docfeedback@vmware.com Copyright © 2009–2012 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws.
Contents About VMware vCenter Server™ and Host Management 7 Updated Information 9 1 vSphere Concepts and Features 11 Virtualization Basics 11 Physical Topology of vSphere Datacenter 12 vSphere Software Components 13 vSphere Managed Inventory Objects 15 Optional vCenter Server Components 17 vCenter Server Plug-Ins 18 2 vSphere Client Interfaces 19 Start the vSphere Client and Log In 20 Stop the vSphere Client and Log Out 20 Register a vCenter Server System with the vSphere Web Client Log in to vCenter S
vCenter Server and Host Management Join a Linked Mode Group After Installation 53 Reconciling Roles When Connecting vCenter Server to a Linked Mode Group 54 Isolate a vCenter Server Instance from a Linked Mode Group 54 Change the Domain of a vCenter Server System in a Linked Mode Group 54 Configure the URLs on a Linked Mode vCenter Server System 55 Monitor vCenter Server Services 55 6 Organizing Your Inventory 57 Create Datacenters 58 Add Hosts 58 Create Clusters 59 Create Resource Pools 60 Create a Reso
Contents 11 Managing Hosts in vCenter Server 107 Disconnecting and Reconnecting a Host 107 Remove a Host from a Cluster 108 Understanding Managed Host Removal 109 Remove a Managed Host from vCenter Server 110 12 Migrating Virtual Machines 111 Cold Migration 112 Migrating a Suspended Virtual Machine 112 Migration with vMotion 113 Migration with Storage vMotion 116 CPU Compatibility and EVC 117 About Migration Compatibility Checks 124 Migrate a Powered-Off or Suspended Virtual Machine in the vSphere Clien
vCenter Server and Host Management 6 VMware, Inc.
About VMware vCenter Server™ and Host Management ® vCenter Server and Host Management describes how to start and stop the VMware vSphere Client components, build your vSphere environment, monitor and manage the information generated about the components, and set up roles and permissions for users and groups using the vSphere environment.
vCenter Server and Host Management 8 VMware, Inc.
Updated Information This vCenter Server and Host Management documentation is updated with each release of the product or when necessary. This table provides the update history of the vCenter Server and Host Management documentation. Revision Description 000775-01 n 000775-00 Initial release. VMware, Inc. Removed obsolete options for import and export of virtual machines in “Schedule Tasks,” on page 97.
vCenter Server and Host Management 10 VMware, Inc.
vSphere Concepts and Features 1 VMware vSphere™ leverages the power of virtualization to transform datacenters into simplified cloud computing infrastructures and enables IT organizations to deliver flexible and reliable IT services. The two core components of vSphere are VMware ESXi™ and VMware vCenter Server™. ESXi is the virtualization platform on which you create and run virtual machines. vCenter Server is a service that acts as a central administrator for ESXi hosts that are connected on a network.
vCenter Server and Host Management Because virtual machines are decoupled from specific underlying physical hardware, virtualization allows you to consolidate physical computing resources such as CPUs, memory, storage, and networking into pools of resources that can be dynamically and flexibly made available to virtual machines. With appropriate management software, such as vCenter Server, you can also use a number of features that increase the availability and security of your virtual infrastructure.
Chapter 1 vSphere Concepts and Features Figure 1-1. VMware vSphere Datacenter Physical Topology vCenter Server vSphere Client server group 1 vSphere Web Client terminal server group 2 server group 3 virtual machines VM VM VM VM VM VM ESXi fibre channel switch fabric / IP network fibre channel storage array iSCSI storage array NAS storage array vSphere Software Components VMware vSphere is a suite of software components for virtualization.
vCenter Server and Host Management vCenter Server is a single Windows Service and is installed to run automatically. vCenter Server runs continuously in the background. It performs its monitoring and managing activities even when no vSphere Clients are connected and when no one is logged on to the computer where it resides. It must have network access to all the hosts it manages and be available for network access from any machine where the vSphere Client is run.
Chapter 1 vSphere Concepts and Features Host agent On each managed host, the software that collects, communicates, and executes the actions received through the vSphere Client. It is installed as part of the ESXi installation. LDAP vCenter Server uses LDAP (Lightweight Directory Access Protocol) to synchronize data such as license and role information across vCenter Server systems joined in Linked Mode.
vCenter Server and Host Management Datastores A virtual representation of underlying physical storage resources in the datacenter. A datastore is the storage location for virtual machine files. These physical storage resources can come from the local SCSI disk of the ESXi host, the Fibre Channel SAN disk arrays, the iSCSI SAN disk arrays, or Network Attached Storage (NAS) arrays.
Chapter 1 vSphere Concepts and Features Optional vCenter Server Components Optional vCenter Server components are packaged and installed with the base product, but might require a separate license. Optional vCenter Server features include: vMotion A feature that enables you to move running virtual machines from one ESXi host to another ESXi host without service interruption. It requires licensing on both the source and target host. vCenter Server centrally coordinates all vMotion activities.
vCenter Server and Host Management finds an appropriate datastore for it. The load balancer takes care of initial placement and future migrations based on workload measurements. Storage space balancing and I/O balancing minimize the risk of running out of space and the risk of I/O bottlenecks slowing the performance of virtual machines.
vSphere Client Interfaces 2 You have several ways to access vSphere components through vSphere interface options. vSphere interface options include: vSphere Client A required component and the primary interface for creating, managing, and monitoring virtual machines, their resources, and their hosts. It also provides console access to virtual machines. The vSphere Client is installed on a Windows machine with network access to your ESXi or vCenter Server system installation.
vCenter Server and Host Management Start the vSphere Client and Log In The vSphere Client is a graphical user interface to vCenter Server and to hosts. A login screen appears when you start the vSphere Client. After you log in, the client displays the objects and functionality appropriate to the server you are accessing and the permissions available to the user you logged in as. Procedure 1 Log in to your Windows system.
Chapter 2 vSphere Client Interfaces The vCenter Server system in a vCenter Server appliance is preregistered with the vSphere Web Client installed in the appliance. To register another vCenter Server system with the vSphere Web Client installed as part of a vCenter Server Appliance, you must use the admin-app command-line script rather than the Web-based administration tool. Prerequisites n Log-in to the system on which the vSphere Web Client is installed.
vCenter Server and Host Management Procedure 1 Open a Web browser and enter the URL for the vSphere Web Client: https://client-hostname:port/vsphere-client. By default the port is 9443, but this can be changed during vSphere Web Client installation. 2 In the Server drop-down menu, select the vCenter Server to which you want to connect. 3 In the Username text box, enter your user name on the vCenter Server system. 4 In the Password text box, enter your password. 5 Click Login.
Using the vSphere Client 3 The vSphere Client is the principal interface for administering vCenter Server and ESXi. The vSphere Client user interface is configured based on the server to which it is connected: n When the server is a vCenter Server system, the vSphere Client displays all the options available to the vSphere environment, according to the licensing configuration and the user permissions.
vCenter Server and Host Management n Restore Getting Started Tabs on page 24 If you turned off the display of the Getting Started tabs, you can restore the settings to display these tabs for all inventory objects. Disable Getting Started Tabs You can disable the Getting Started tabs if you do not want to display them. You can disable the tabs in the following ways. Procedure n Click the Close Tab link to disable Getting Started tabs for the type of object selected.
Chapter 3 Using the vSphere Client View Virtual Machine Console The console of a powered-on virtual machine is available through a connected server. All console connections to the virtual machine see the same information. The message line indicates if others are viewing the virtual machine. Procedure 1 Select a powered-on virtual machine. 2 In the Information panel, click the Console tab.
vCenter Server and Host Management Perform an Advanced Search Using advanced search allows you to search for managed objects that meet multiple criteria. For example, you can search for virtual machines matching a search string. The virtual machines reside on hosts whose names match a second search string. Procedure 1 Select View > Inventory > Search to display the advanced search page.
Chapter 3 Using the vSphere Client Filter a List View You can filter a list if it is too long, or if you are looking for specific items in the list (alarms that begin with the word "datastore," for example). You can show and hide the filter field by using the Filtering option in the View menu. The list is updated based on whether filtering is on or off. For example, if you are in the Virtual Machines tab, you have filtered the list and the filtered text is “powered on.
vCenter Server and Host Management Add Custom Attributes You can create custom attributes to associate with virtual machines or managed hosts. Procedure 1 Select Administration > Custom Attributes. This option is not available when connected only to an ESXi host. 2 Click Add. 3 Enter the values for the custom attribute. a Type the name of the attribute in the Name text box. b Select the attribute type from the Type drop-down menu:Virtual Machine, Host, or Global.
Chapter 3 Using the vSphere Client Manage vCenter Server Plug-Ins After the server component of a plug-in is installed and registered with vCenter Server, its client component is available to vSphere clients. Client component installation and enablement are managed through the Plugin Manager dialog box. The Plug-in Manager lets you perform the following actions: n View available plug-ins that are not currently installed on the client. n View installed plug-ins.
vCenter Server and Host Management Troubleshooting vCenter Server Plug-Ins In cases where vCenter Server plug-ins are not working, you have several options to correct the problem. vCenter Server plug-ins that run on the Tomcat server have extension.xml files, which contain the URL where the corresponding Web application can be accessed. These files are located in C:\Program Files\VMware\Infrastructure\VirtualCenter Server\extensions.
Chapter 3 Using the vSphere Client 2 Right-click a session and select Terminate. 3 Click OK to confirm the termination. Send a Message to All Active Users You can send a Message of the Day to all active session users and to new users when they log into the vSphere Client. The Message of the day text is sent as a notice message to all active session users and to new users when they log in. Procedure 1 On the Home page of a vSphere Client connected to a vCenter Server system, click the Sessions button.
vCenter Server and Host Management 32 VMware, Inc.
Configuring Hosts and vCenter Server 4 Configuring ESXi hosts, vCenter Server systems, and the vSphere Client involves several tasks.
vCenter Server and Host Management n Configure Mail Sender Settings on page 38 You must configure the email address of the sender account in order to enable vCenter Server operations, such as sending email notifications as alarm actions. n Configure SNMP Settings on page 39 You can configure up to four receivers to receive SNMP traps from vCenter Server. For each receiver, specify a host name, port, and community.
Chapter 4 Configuring Hosts and vCenter Server 3 Select the type of license key to assign to this vCenter Server. n Select Assign an existing license key to this vCenter Serverand select a license key from the Product list. n Select Assign a new license key to this vCenter Server, click Enter Key, and enter a vCenter Server license key and an optional label for the key. NOTE To enter ESX 4.0/ESXi 4.0 keys, select Home > Administration > Licensing.
vCenter Server and Host Management Prerequisites To configure statistics settings, the vSphere Client must be connected to a vCenter Server system. Procedure 1 If necessary, select Administration > Settings to open the vCenter Server Settings dialog boxvCenter Server. 2 If your environment uses multiple vCenter Servers, in Current vCenter Server, select the server. 3 In the navigation panel, select Statistics.
Chapter 4 Configuring Hosts and vCenter Server Estimate the Effect of Statistics Collection on the Database The impact of the statistics collection on your vCenter Server database is based on the current vCenter Server and inventory size. Required privilege: Global.Settings Prerequisites To configure statistics settings, the vSphere Client must be connected to a vCenter Server system. Procedure 1 If necessary, configure the statistics intervals.
vCenter Server and Host Management What to do next If you made changes to the vCenter Server system Unique ID, you must restart the vCenter Server system for these changes to take effect. Configure Active Directory Settings You can configure some of the ways vCenter Server interacts with the Active Directory server. Required privilege: Global.Settings Prerequisites To configure active directory settings, the vSphere Client must be connected to the vCenter Server system.
Chapter 4 Configuring Hosts and vCenter Server 5 Enter the sender account information. The Sender Account is the email message address of the sender. NOTE The full email address must be entered, including the domain name (the information after the @ sign). For example, mail_server@datacenter.com. 6 Click OK.
vCenter Server and Host Management 3 In the settings list, select Ports. The ports used by the Web service are displayed. 4 Click OK. Configure Timeout Settings You can configure the timeout intervals for vCenter Server operations. These intervals specify the amount of time after which the vSphere Client times out. Required privilege: Global.Settings Prerequisites To configure timeout settings, the vSphere Client must be connected to the vCenter Server system.
Chapter 4 Configuring Hosts and vCenter Server 5 Option Description Info (Normal logging) Displays information, error, and warning log entries Verbose (Verbose) Displays information, error, warning, and verbose log entries Trivia (Extended verbose) Displays information, error, warning, verbose, and trivia log entries Click OK. Changes to the logging settings take effect immediately. You do not need to restart vCenter Server system.
vCenter Server and Host Management Configure SSL Settings You can configure vCenter Server to check the SSL certificates of hosts to which it connects. If you select this option, vCenter Server and the vSphere Client check for valid SSL certificates before connecting to a host for such operations as adding a host or making a remote console connection to a virtual machine. Required privilege: Global.
Chapter 4 Configuring Hosts and vCenter Server 2 If the vCenter Server system is part of a connected group, select the server you want to configure from the Current vCenter Server drop-down menu. 3 In the settings list, select Advanced Settings. 4 In the Key field, type a key. 5 In the Value field, type the value for the specified key. 6 Click Add. 7 Click OK. What to do next Many advanced options changes require that the vCenter Server system be restarted before they take effect.
vCenter Server and Host Management n Configure Inventory Size for the VMware vCenter Server Appliance on page 47 Set the inventory size of the VMware vCenter Server Appliance based on the number of hosts and virtual machines that you plan to have in the VMware vCenter Server Appliance inventory.
Chapter 4 Configuring Hosts and vCenter Server 2 On the vCenter Server tab, select Database. 3 Select the Database Type from the drop-down menu. 4 Option Description embedded Use the embedded database. This option is available only for a small inventory size, with fewer than 5 hosts and 50 virtual machines. oracle Use an external Oracle database. Type the server and port information. This option is disabled if the database type is set to embedded. 5 Type the instance name.
vCenter Server and Host Management Start vCenter Server in the VMware vCenter Server Appliance Start vCenter Server from the VMware vCenter Server Appliance. Prerequisites Install the VMware vCenter Server Appliance and configure the database. See “Configure Database Settings for the VMware vCenter Server Appliance,” on page 44 and the vSphere Installation and Setup documentation. Procedure 1 Log in to the VMware vCenter Server Appliance Web console. 2 On the vCenter Server tab, select Status.
Chapter 4 Configuring Hosts and vCenter Server Enable or Disable SSH Administrator Login on the VMware vCenter Server Appliance You can enable or disable the ability to log in to the VMware vCenter Server Appliance using SSH. Procedure 1 Log in to the VMware vCenter Server Appliance web console. 2 On the vCenter Server tab, click Administration. 3 (Optional) Click Enable SSH login to allow log in to the VMware vCenter Server Appliance using SSH.
vCenter Server and Host Management 9 10 Select the inventory size from the drop-down menu. Option Description small For fewer than 100 hosts and 1000 virtual machines in the VMware vCenter Server Appliance inventory. medium For between 100 and 400 hosts or between 1000 and 4000 virtual machines in the VMware vCenter Server Appliance inventory. large For over 400 hosts or 4000 virtual machines in the VMware vCenter Server Appliance inventory. Click Save Settings.
Chapter 4 Configuring Hosts and vCenter Server 3 Type the Autodeploy Server Port to use. 4 In the Autodeploy repository max size field, type the maximum Auto Deploy repository size in GB. 5 (Optional) Click Test Settings to verify that the specified settings are valid. 6 Click Save Settings. 7 Restart ESXi services.
vCenter Server and Host Management Hosts provisioned with Auto Deploy send log files to the specified ports. Although the VMware vCenter Server Appliance acts as a syslog server, it does not appear as a syslog server in the vSphere Client. What to do next You must restart ESXi services for these changes to take effect.
Using vCenter Server in Linked Mode 5 You can join multiple vCenter Server systems using vCenter Linked Mode to allow them to share information. When a server is connected to other vCenter Server systems using Linked Mode, you can connect to that vCenter Server system and view and manage the inventories of the linked vCenter Server systems. Linked Mode uses Microsoft Active Directory Application Mode (ADAM) to store and synchronize data across multiple vCenter Server systems.
vCenter Server and Host Management The following requirements apply to each vCenter Server system that is a member of a Linked Mode group: n Linked Mode groups that contain both vCenter Server 5.0 and earlier versions of vCenter Server are not supported. The vSphere Client does not function correctly with vCenter Servers in groups that have both version 5.0 and earlier versions of vCenter Server. Do not join a version 5.
Chapter 5 Using vCenter Server in Linked Mode Join a Linked Mode Group After Installation After installing vCenter Server, you can join a vCenter Server to a Linked Mode group. Prerequisites See “Linked Mode Prerequisites for vCenter Server,” on page 51 . NOTE Joining a version 5.0 vCenter Server to older versions of vCenter Server is not supported. Procedure 1 Select Start > All Programs > VMware > vCenter Server Linked Mode Configuration. 2 Click Next.
vCenter Server and Host Management Reconciling Roles When Connecting vCenter Server to a Linked Mode Group When you join a vCenter Server system to a linked mode group, the roles defined on each vCenter Server system in the group are replicated to the other systems in the group. If the roles defined on each vCenter Server system are different, the roles lists of the systems are combined into a single common list.
Chapter 5 Using vCenter Server in Linked Mode 3 Rejoin the vCenter Server system to the Linked Mode group. Configure the URLs on a Linked Mode vCenter Server System If you connect a vCenter Server system to a Linked Mode group and the vCenter Server system has a machine name that does not match the domain name, several connectivity problems arise. Correct this situation by changing the URLs.
vCenter Server and Host Management n 56 Messages associated with the change in status. VMware, Inc.
Organizing Your Inventory 6 Plan how you will set up your virtual infrastructure. A large vSphere implementation might contain several virtual datacenters with a complex arrangement of hosts, clusters, resource pools, and networks. It might involve multiple vSphere Servers operating in Linked Mode. Smaller implementations might require a single virtual datacenter with a much less complex topology.
vCenter Server and Host Management n “Create Datacenter-Wide Networks,” on page 63 Create Datacenters A virtual datacenter is a container for all the inventory objects required to complete a fully functional environment for operating virtual machines. You can create multiple datacenters to organize sets of environments.
Chapter 6 Organizing Your Inventory 5 (Optional) Select Enable Lockdown Mode to disable remote access for the administrator account after vCenter Server takes control of this host. Selecting this check box ensures that the host is managed only through vCenter Server. You can perform certain management tasks while in lockdown mode by logging into the local console on the host. 6 Review host information and click Next. 7 (Optional) Assign a license key to the host if needed and click Next.
vCenter Server and Host Management 5 Select a swap file policy and click Next. 6 Review the options you selected for the cluster and click Finish. The cluster is added to the inventory. What to do next Add hosts and resource pools to the cluster. Create Resource Pools You can use resource pools to hierarchically partition available CPU and memory resources of a standalone host or a cluster.
Chapter 6 Organizing Your Inventory 3 Type a name to identify the resource pool. 4 Specify how to allocate CPU and memory resources. 5 Option Description Shares Specify shares for this resource pool with respect to the parent’s total resources. Sibling resource pools share resources according to their relative share values bounded by the reservation and limit. n Select Low, Normal, or High to specify share values respectively in a 1:2:4 ratio.
vCenter Server and Host Management Procedure 1 Select Home > Inventory > Datastores. 2 Right-click on a datacenter and select Add Datastore. 3 Select a host and click Next. 4 Select a type of storage and click Next. 5 Option Description Disk or LUN a b c d e Select a disk or LUN and click Next. Review the disk layout information and click Next. Enter a name for the datastore and click Next. Specify maximum file and block sizes. Specify disk or LUN capacity and click Next.
Chapter 6 Organizing Your Inventory Create Datacenter-Wide Networks In vSphere, you can create standard networks and distributed networks. Standard networks provide a method of communication among the virtual machines on a standalone host and consist of standard switches and port groups. Distributed networks aggregate the networking capabilities of multiple hosts and enable virtual machines to keep consistent network configuration as they migrate across hosts.
vCenter Server and Host Management 4 5 (Optional) Edit uplink port names. a Click Edit uplink names. b Type new names for one or more uplink ports. c Click OK. Click OK. Edit Advanced vSphere Distributed Switch Settings You can change advanced vSphere distributed switch settings such as Cisco Discovery Protocol and the maximum MTU for the vSphere distributed switch. Procedure 1 Log in to the vSphere Client and select the Networking inventory view.
Chapter 6 Organizing Your Inventory 6 (Optional) Set the maximum number of ports on a host. a Click View Details for the host. b Select the maximum number of ports for the host from the drop-down menu. c Click OK. 7 Click Next. 8 (Optional) Migrate virtual machine networking to the distributed switch. a Select Migrate virtual machine networking. b For each virtual machine, select Destination port group and select a port group from the drop-down menu or select Do not migrate. 9 Click Next.
vCenter Server and Host Management 3 4 Select General to edit the following distributed port group settings. Option Action Name Type the name for the distributed port group. Description Type a brief description of the distributed port group. Number of Ports Type the number of ports on the distributed port group. Port binding Choose when ports are assigned to virtual machines connected to this distributed port group.
License Management and Reporting 7 vCenter Server provides licensing infrastructure that you can use for management and reporting of licenses that apply to ESXi hosts, vCenter Server, and certain solutions such as vCenter Site Recovery Manager, vCenter CapacityIQ, vCenter Chargeback, and so on. Licensing in vCenter Server is implemented using license keys. You can assign one license key to multiple licensable objects of the same type if the key has enough capacity.
vCenter Server and Host Management n Licensing for ESXi 5.0 Hosts on page 69 ESXi 5.0 hosts are licensed with vSphere 5.0 license keys. vSphere 5.0 license keys have per-processor capacity with pooled vRAM entitlements. vRAM entitlements of vSphere 5.0 licenses are pooled across all assigned vSphere 5.0 license keys of the same product edition for a single vCenter Server system or for a Linked Mode group. n Licensing for vCenter Server 5.0 on page 72 vCenter Server 5.
Chapter 7 License Management and Reporting Solution A product that is packed and distributed independently from vSphere. You install a solution in vSphere to take advantage of certain functionality. Every solution has a licensing model specific for the solution, but can use the licensing infrastructure of vCenter Server for license management and reporting. Examples of solutions are vCenter CapacityIQ, vCenter Site Recovery Manager, vCenter Chargeback, and so on. Asset Any licensable object in vSphere.
vCenter Server and Host Management If you try to assign a license key that has insufficient capacity to license all physical processors on the host, the license assignment is unsuccessful. In such case, you need to assign a different license key with a larger processor capacity. You need to use a different license key in your inventory or combine your license key with another license key to create a new license key with a larger processor capacity.
Chapter 7 License Management and Reporting A vRAM pool aggregates all vRAM entitlements of vSphere 5.0 license keys of one edition that are assigned to ESXi 5.0 hosts. A vRAM pool for one license edition is available for one vCenter Server or a Linked Mode group. The amount of vRAM that is available in a vRAM pool for a license edition determines the total amount of memory that you can provision on powered-on virtual machines running on ESXi 5.0 hosts. For example, you assign license key A of vSphere 5.
vCenter Server and Host Management vSphere 5.0 Essentials and Essentials Plus Kits If you have vSphere 5.0 Essentials or Essential Plus kits, you cannot use more than 192GB of vRAM for poweredon virtual machines. If the memory that is configured to powered-on virtual machines reaches 192GB, you cannot power on any new virtual machines or hot add memory to already powered-on virtual machines.
Chapter 7 License Management and Reporting Licensing ESXi Hosts and vCenter Server After Upgrade Upgrading the ESXi or vCenter Server software may require changes in the licensing configuration of ESXi hosts or vCenter Server. When you apply a minor upgrade or patch to the ESXi or vCenter Server software, you do not need to replace the existing license key with a new one. If you apply a major upgrade to ESXi or vCenter Server, you need to apply a new license key.
vCenter Server and Host Management 4 The host license key belongs to two separate license inventories. If the total assignment of the key exceeds the key's capacity, this scenario is not supported and causes your license use to be out of compliance. Example: Linked Mode Scenario 1 You have two vCenter Server instances that belong to the same Linked Mode group. 2 You assign a license to a host in one vCenter Server instance. 3 The two vCenter Server instances share a single license inventory.
Chapter 7 License Management and Reporting Combining the Capacity of License Keys If your license inventory contains multiple license keys, each with a small amount of capacity, you might want to combine them into one large-capacity license key. Combining license keys is useful when the total available capacity across license keys is large enough to accommodate an asset, but no single license key is large enough to accommodate the asset.
vCenter Server and Host Management n Managing Licenses on ESXi Hosts on page 79 You can license an ESXi host that is connected to vCenter Server or if your vSphere Client is connected directly to the host. You can also query which features are licensed on a host or set a host to evaluation mode. n Managing Licenses on ESX/ESXi 3.5 Hosts on page 80 vCenter Server 5.0 requires a license server to manage licenses on ESX/ESXi 3.5. For ESX/ESXi 4.x and later hosts, vCenter Server 5.
Chapter 7 License Management and Reporting Procedure 1 In the vSphere Client, select Home > Administration > Licensing. 2 In the Management tab, select Asset as a primary entity for sorting the license information. 3 Right-click an asset and select Change license key. 4 Select Assign a new license key and click Enter Key. 5 Specify the license key, type an optional label for the key, and click OK. 6 Click OK.
vCenter Server and Host Management Assign a License Key to Assets You can assign license keys to single or multiple assets, individually, or in batches. NOTE If an ESXi host disconnects from vCenter Server immediately after you assign a license key, the license assignment operation does not complete but the host appears as licensed. The host is licensed after it reconnects to vCenter Server. Prerequisites n Verify that you have the Global.Licenses privilege.
Chapter 7 License Management and Reporting Managing Licenses on ESXi Hosts You can license an ESXi host that is connected to vCenter Server or if your vSphere Client is connected directly to the host. You can also query which features are licensed on a host or set a host to evaluation mode. n License a Host When Adding It to the vCenter Server Inventory on page 79 When you add a host to the vCenter Server inventory, you can assign a license key to the host.
vCenter Server and Host Management 5 Click OK. View Which Features Are Licensed on a Host You can view which features a host is licensed to use. If you try to configure features that are not included in the host license, the vSphere Client displays an error message. Procedure 1 From the vSphere Client, select the host in the inventory. 2 Click the Configuration tab. 3 Under Software, click Licensed Features. The list appears of features that you can configure on the host.
Chapter 7 License Management and Reporting Configure vCenter Server to Use a License Server To manage ESX/ESXi 3.5 hosts, you must configure vCenter Server to use a license server. Prerequisites You must have a license server installed. You can download the VMware License Server from the VMware Web site. Procedure 1 In vCenter Server, select Administration > vCenter Server Settings. 2 In the License Server text box, enter the port number and license server machine name, as in port@host.
vCenter Server and Host Management Procedure 1 In the vSphere Client, select Home > Administration > Licensing. 2 Select the Reporting tab. 3 (Optional) If the vCenter Server instance that you are connected to is part of a Linked Mode group, leave the default All vCenter Server instances value in the vCenter Server drop-down menu. You should leave the default All vCenter Server instances value to view the license use for the entire group.
Chapter 7 License Management and Reporting 2 Select the Reporting tab. 3 If the vCenter Server instance that you are connected to is part of a Linked Mode group, leave the default All vCenter Server instances value in the vCenter Server drop-down menu. You should leave the default All vCenter Server Instances value to view the license use for a product for the entire group.
vCenter Server and Host Management The table in the Product Details pane lists all license keys that belong to the selected product and that are assigned to assets over the selected period. The table contains details for the use and capacity of every key. The license use on the Product Details pane is an aggregated value from the row data in the license use snapshots that are stored in vCenter Server.
Chapter 7 License Management and Reporting Export a License Use Report From the Licensing page in the vSphere Client, you can export a report for the license use of products for a certain time period. The report is exported in a CSV file that you can later open with third party applications. NOTE A tamper-detection feature in vCenter Server protects the license use information. If the licensing data in the vCenter Server database has been edited, you cannot export a license use report.
vCenter Server and Host Management The exported report contains raw data about the license use of products for a single vCenter Server instance or a Linked Mode group. The exported report includes all of the snapshots collected over the selected period. The exported report can contain host, vCenter Server, or solution asset IDs, but does not include user-defined names. The exported report is free of user and company-specific information.
Chapter 7 License Management and Reporting 2 Select the Reporting tab. 3 (Optional) If the vCenter Server that you are connected to is part of a Linked Mode group, from the vCenter Server drop-down menu, select the vCenter Server system where you want to set a threshold for the license use of a product. 4 Select the product from the Products Chart pane. 5 Click Edit Threshold in the Product Details pane. 6 Type the value for the threshold. 7 Click OK.
vCenter Server and Host Management 88 VMware, Inc.
System Log Files 8 In addition to lists of events and alarms, vSphere components generate assorted logs. These logs contain additional information about activities in your vSphere environment.
vCenter Server and Host Management 4 (Optional) Perform a regular expression search. a Press the slash key (/). b Type the text to find. c Press Enter The found text is highlighted on the screen. 5 Press q to return to the direct console. External System Logs VMware technical support might request several files to help resolve any issues you have with the product. This section describes the types and locations of log files found on various ESXi component systems.
Chapter 8 System Log Files Procedure 1 Select File > Export > Export System Logs. 2 If you are connected to vCenter Server, select the object for which you want to export data. Selecting an object selects all of its child objects. 3 If you are connected to vCenter Server, select Include information from vCenter Server and vSphere Client to download vCenter Server and vSphere Client log files and host log files, and click Next.
vCenter Server and Host Management 5 6 7 To set up logging globally, click global and make changes to the fields on the right. Option Description Syslog.global.defaultRotate Sets the maximum number of archives to keep. You can set this number globally and for individual subloggers. Syslog.global.defaultSize Sets the default size of the log, in KB, before the system rotates logs. You can set this number globally and for individual subloggers. Syslog.global.LogDir Directory where logs are stored.
Chapter 8 System Log Files Collect vSphere Log Files You can collect vSphere log files into a single location. Procedure u View the log file using one of the following methods. Task Description View the viclient-*.log file Change to the directory, %temp%. Download the log bundle from vSphere Client connected to a vCenter Server system Select Administration > Export System Logs to download the log bundle. The log bundle is generated as a .zip file.
vCenter Server and Host Management 94 VMware, Inc.
Working with Tasks and Events 9 vSphere tasks and events are activities and actions that occur on an object within the vSphere inventory. This chapter includes the following topics: n “Managing Tasks,” on page 95 n “Managing Events,” on page 101 n “Report Errors to VMware,” on page 104 Managing Tasks Tasks represent system activities that do not complete immediately, such as migrating a virtual machine.
vCenter Server and Host Management 2 3 Display the tasks for a single object or the entire vCenter Server. n To display the tasks for an object, select the object. n To display the tasks in the vCenter Server, select the root folder. Click the Tasks & Events tab. The task list contains tasks performed on the object and its children. 4 (Optional) To view detailed information for a task, select the task in the list.
Chapter 9 Working with Tasks and Events 3 If the Name, Target or Status contains search field is not displayed, select View > Filtering. 4 Click the search field arrow and select the attributes to include in the search. 5 Type a keyword into the box and press Enter. Cancel a Task Canceling a task stops a running task from occurring. Canceling a scheduled task does not cancel subsequent runs. To cancel a scheduled task that has not run, reschedule it.
vCenter Server and Host Management Table 9-1. Scheduled Tasks (Continued) Scheduled Task Description Deploy a virtual machine Creates a new virtual machine from a template on the specified host or cluster. Migrate a virtual machine Migrate a virtual machine to the specified host or datastore by using migration or migration with vMotion. Make a snapshot of a virtual machine Captures the entire state of the virtual machine at the time the snapshot is taken.
Chapter 9 Working with Tasks and Events 7 Select a Frequency and specify a Start Time. You can schedule a task to run only once during a day. To set up a task to run multiple times in one day, set up additional scheduled tasks. Table 9-2. Scheduled Task Frequency Options Frequency Action Once n n To run the scheduled task immediately, select Now and click Next. To run the scheduled task at a later time and date, select Later and enter a Time.
vCenter Server and Host Management If your vSphere uses virtual services, you can also cancel the following scheduled tasks: n Change the power state of a virtual machine n Make a snapshot of a virtual machine Change or Reschedule a Task After a scheduled task is created, you can change the timing, frequency, and specifics of the task. You can edit and reschedule tasks before or after they run. Required privilege:Schedule Task.
Chapter 9 Working with Tasks and Events n The vSphere Client and vCenter Server system use UTC time to determine the start time of a scheduled task. This ensures vSphere Client users in different time zones see the task scheduled to run at their local time. Events are logged in the event log at start and completion of a task. Any errors that occur during a task are also recorded in the event log. CAUTION Do not schedule multiple tasks to be performed at the same time on the same object.
vCenter Server and Host Management View Events You can view events associated with a single object or view all vSphere events. The events list for a selected inventory object includes events associated with child objects. Prerequisites You must have a vSphere Web Client or a vSphere Client connected to a vCenter Server. Required privilege: Read-only Procedure u Perform the actions that correspond with the client interface you are using. In this interface... Do this...
Chapter 9 Working with Tasks and Events Procedure 1 2 Select the object on which to filter the events. n To filter events associated with one object, select the object in the inventory, click the Events tab, and click Events. n To filter events associated with all objects, in the navigation bar, click Home > Management > Events. If the Name, Target or Status contains search field is not visible, select View > Filtering. The search field appears.
vCenter Server and Host Management Procedure u Perform the actions that correspond with the client interface you are using. Option Description vSphere Client a b c d e vSphere Web Client a b c d e f Select File > Export > Export Events. (Linked-mode only) In thevCenter Server list, select the server where the events occurred. Specify Events, Time, and Limits attributes for the events you want to export. Specify a file name and location. Click OK.
Starting and Stopping the vSphere Components 10 You can start and stop each one of the major vSphere components, ESXi, and vCenter Server. You might want to stop a component to perform maintenance or upgrade operations. This chapter includes the following topics: n “Start an ESXi Host,” on page 105 n “Reboot or Shut Down an ESXi Host,” on page 105 n “Starting vCenter Server,” on page 106 Start an ESXi Host When you install ESXi, it starts itself through the installation reboot process.
vCenter Server and Host Management Starting vCenter Server vCenter Server runs as a Windows service. vCenter Server starts when you start the Windows machine on which it is installed. It also restarts when that machine is rebooted. Verify That vCenter Server Is Running You can verify that the vCenter Server service is running. Procedure 1 Go to the Services console for your version of Windows. For example, select Control Panel > Administrative Tools > Services and click VMware VirtualCenter Server.
Managing Hosts in vCenter Server 11 To access the full capabilities of your hosts and to simplify the management of multiple hosts, you should connect your hosts to a vCenter Server system. For information on configuration management of ESXihosts, see the vSphere Networking documentation, the vSphere Storage documentation, or the vSphere Security documentation. The views and capabilities displayed vary depending on whether the vSphere Client is connected to a vCenter Server system or an ESXihost.
vCenter Server and Host Management Reconnect a Managed Host Use the vSphere Client to reconnect a managed host to a vCenter Server system. Procedure 1 From the vSphere Client connected to a vCenter Server system, display the inventory and click the managed host to reconnect. 2 Right-click the host and select Connect from the pop-up menu. When the managed host’s connection status to vCenter Server is changed, the statuses of the virtual machines on that managed host are updated to reflect the change.
Chapter 11 Managing Hosts in vCenter Server 4 Select the host icon in the inventory panel, and drag it to the new location. The host can be moved to another cluster or another datacenter. When the new location is selected, a blue box surrounds the cluster or datacenter name. vCenter Server moves the host to the new location. 5 Right-click the host, and select Exit Maintenance Mode from the pop-up menu. 6 (Optional) Restart any virtual machines, as needed.
vCenter Server and Host Management Remove a Managed Host from vCenter Server Remove a managed host from vCenter Server to stop all vCenter Server monitoring and management of that host. If possible, remove managed hosts while they are connected. Removing a disconnected managed host does not remove the vCenter Server agent from the managed host. Prerequisites Make sure NFS mounts are active. If NFS mounts are unresponsive, the operation fails.
Migrating Virtual Machines 12 Migration is the process of moving a virtual machine from one host or storage location to another. Copying a virtual machine creates a new virtual machine. It is not a form of migration. In vCenter Server, you have the following migration options: Cold Migration Moving a powered-off virtual machine to a new host. Optionally, you can relocate configuration and disk files to new storage locations.
vCenter Server and Host Management n “About Migration Compatibility Checks,” on page 124 n “Migrate a Powered-Off or Suspended Virtual Machine in the vSphere Client,” on page 124 n “Migrate a Powered-On Virtual Machine with vMotion in the vSphere Client,” on page 126 n “Migrate a Virtual Machine with Storage vMotion in the vSphere Client,” on page 127 n “Migrate a Powered-Off or Suspended Virtual Machine in the vSphere Web Client,” on page 129 n “Migrate a Powered-On Virtual Machine with vMotion
Chapter 12 Migrating Virtual Machines Migration with vMotion Migration with vMotion™ allows virtual machine working processes to continue throughout a migration. The entire state of the virtual machine, as well as its configuration file, if necessary, is moved to the new host, while the associated virtual disk remains in the same location on storage that is shared between the two hosts. After the virtual machine state is migrated to the alternate host, the virtual machine runs on the new host.
vCenter Server and Host Management vMotion Networking Requirements Migration with vMotion requires correctly configured network interfaces on source and target hosts. vMotion requires a Gigabit Ethernet (GigE) network between all vMotion-enabled hosts. Each host enabled for vMotion must have a minimum of two Ethernet adapters, at least one of which must be a GigE adapter. Recommended networking best practices are as follows: n Use one dedicated GigE adapter for vMotion.
Chapter 12 Migrating Virtual Machines Swapfile Location Compatibility Virtual machine swapfile location affects vMotion compatibility in different ways depending on the version of ESXi running on the virtual machine's host. Virtual machines on hosts running ESX Server 3.0.x have a virtual machine swap file located with the virtual machine configuration file. Virtual machines on these hosts can be migrated with vMotion only if the destination host can access the VMFS volume where the swap file is located.
vCenter Server and Host Management Migration with Storage vMotion Using Storage vMotion, you can migrate a virtual machine and its disk files from one datastore to another while the virtual machine is running. You can choose to place the virtual machine and all its disks in a single location, or select separate locations for the virtual machine configuration file and each virtual disk. The virtual machine does not change execution host during a migration with Storage vMotion.
Chapter 12 Migrating Virtual Machines CPU Compatibility and EVC vCenter Server performs a number of compatibility checks before allowing migration of running or suspended virtual machines to ensure that the virtual machine is compatible with the target host. vMotion transfers the running state of a virtual machine between underlying ESXi systems.
vCenter Server and Host Management n The virtual machine’s CPU feature set contains features not supported by the destination host. CPU compatibility requirements are not met, and migration with vMotion cannot proceed. NOTE EVC overcomes such incompatibility by providing a "baseline" feature set for all virtual machines running in a cluster and that hides the differences among the clustered hosts' CPUs from the virtual machines.
Chapter 12 Migrating Virtual Machines EVC cannot prevent virtual machines from accessing hidden CPU features in all circumstances. Applications that do not follow CPU vendor recommended methods of feature detection might behave unexpectedly in an EVC environment. VMware EVC cannot be supported with ill-behaved applications that do not follow the CPU vendor recommendations.
vCenter Server and Host Management Table 12-1.
Chapter 12 Migrating Virtual Machines 4 Move the host into the cluster. You can power on the virtual machines on the host, or migrate virtual machines into the cluster with vMotion, if the virtual machines meet CPU compatibility requirements for the cluster’s EVC mode. Virtual machines running on hosts with more features than the EVC mode must be powered off before migration into the cluster. 5 Repeat Step 3 and Step 4 for each additional host that you want to move into the cluster.
vCenter Server and Host Management Prerequisites If you intend to lower the EVC mode, power off any currently running virtual machines with a higher EVC mode than the one you intend to enable. See “Determine EVC Modes for Virtual Machines,” on page 122. The cluster cannot contain a disconnected host. All hosts in the cluster must be connected and registered on the vCenter Server. Procedure 1 Display the cluster in the inventory. 2 Right-click the cluster and select Edit Settings.
Chapter 12 Migrating Virtual Machines Prepare Clusters for AMD Processors Without 3DNow! Future generations of AMD processors might not include 3DNow!™ CPU instructions. vCenter Server provides an EVC mode that masks the 3DNow! instructions from virtual machines, allowing you to prepare clusters for the introduction of AMD hosts without 3DNow! instructions.
vCenter Server and Host Management In some cases, where a choice between CPU compatibility or guest operating system features (such as NX/XD) exists, VMware provides check-box options to configure individual virtual machines through the virtual machine’s Advanced Settings option. For more control over the visibility of CPU features, you can edit the virtual machine’s CPU compatibility mask at the bit level. CAUTION This is an experimental feature.
Chapter 12 Migrating Virtual Machines 3 4 Select the migration type. Option Description Change host Move the virtual machine to another host. Change datastore Move the virtual machine’s configuration file and virtual disks. Change both host and datastore Move the virtual machine to another host and move its configuration file and virtual disks. (This option is not available for a powered-on virtual machine.
vCenter Server and Host Management 7 Select the datastore location where you want to store the virtual machine files. Option Action Store all virtual machine files in the same location on a datastore. a b Store all virtual machine files in the same datastore cluster. a b c d Store virtual machine configuration files and disks in separate locations.
Chapter 12 Migrating Virtual Machines 3 Select Change host and click Next. 4 Select a destination host or cluster for the virtual machine. Any compatibility problem appears in the Compatibility panel. Fix the problem, or select another host or cluster. Possible targets include hosts and fully automated DRS clusters. You can select a non-automated cluster as a target. You are prompted to select a host within the non-automated cluster. 5 Select a resource pool and click Next.
vCenter Server and Host Management 4 Select a disk format. Option Description Same as Source Use the format of the original virtual disk. If you select this option for an RDM disk in physical compatibility mode, only the mapping file is migrated. If you select this option for an RDM disk in virtual compatibility mode, the RDM is converted to a virtual disk. 5 Thin provisioned Use the thin format to save storage space.
Chapter 12 Migrating Virtual Machines Migrate a Powered-Off or Suspended Virtual Machine in the vSphere Web Client You can use the Migration wizard to migrate a powered-off virtual machine or suspended virtual machine. Procedure 1 Select a virtual machine. n In the virtual machines and templates inventory tree, select a group of virtual machines and select a virtual machine from the list on the right. n Search for a virtual machine and select it from the search results list.
vCenter Server and Host Management 7 If you chose to move the virtual machine’s configuration file and virtual disks, select a disk format. Option Description Same as Source Use the format of the original virtual disk. If you select this option for an RDM disk in physical compatibility mode, only the mapping file is migrated. If you select this option for an RDM disk in virtual compatibility mode, the RDM is converted to a virtual disk. Thin provisioned Use the thin format to save storage space.
Chapter 12 Migrating Virtual Machines 5 Select a destination host or cluster for the virtual machine. Any compatibility problem appears in the Compatibility panel. Fix the problem, or select another host or cluster. Possible targets include hosts and fully automated DRS clusters. You can select a non-automated cluster as a target. You are prompted to select a host within the non-automated cluster. 6 7 Select the migration priority level and click Next.
vCenter Server and Host Management 4 Select the datastore location where you want to store the virtual machine files. Option Action Store all virtual machine files in the same location on a datastore. Select a datastore and click Next. Store all virtual machine files in the same Storage DRS cluster. a b c Store virtual machine configuration files and disks in separate locations. a b c d 5 Select a Storage DRS cluster.
Chapter 12 Migrating Virtual Machines Table 12-2. svmotion Command Parameters (Continued) Parameter Description new_datastore The name of the new datastore to which the virtual machine configuration file or disk is to be moved. Do not include brackets around the name of the new datastore. --disks If you do not specify this parameter, all virtual disks associated with a virtual machine are relocated to the same datastore as the virtual machine configuration file.
vCenter Server and Host Management An example of relocating all of a virtual machine’s disks to a datastore named new_datastore: svmotion --url=https://myvc.mycorp.com/sdk --username=me --password=secret --datacenter=DC1 --vm='[old_datastore] myvm/myvm.vmx: new_datastore' An example of relocating a virtual machine to new_datastore, while leaving the disks, myvm_1.vmdk and myvm_2.vmdk on old_datastore: svmotion --datacenter='My DC' --vm='[old_datastore] myvm/myvm.
Chapter 12 Migrating Virtual Machines Table 12-4 lists datastore limits for migration with vMotion and Storage vMotion. Table 12-5 lists the datastore resource costs for migration with vMotion and Storage vMotion. Table 12-4. Datastore Limits for Migration with vMotion and Storage vMotion Operation ESX/ESXi Version Maximum Cost vMotion/Storag e vMotion 3.x 8 vMotion/Storag e vMotion 4.0 8 vMotion/Storag e vMotion 4.1, 5.0 128 Table 12-5.
vCenter Server and Host Management 136 VMware, Inc.
Using vCenter Maps 13 A vCenter map is a visual representation of your vCenter Server topology. Maps show the relationships between the virtual and physical resources available to vCenter Server. Maps are available only when the vSphere Client is connected to a vCenter Server system. The maps can help you determine such things as which clusters or hosts are most densely populated, which networks are most critical, and which storage devices are being utilized.
vCenter Server and Host Management Set the Maximum Number of Map Objects In large environments, maps can be slow to load and difficult to read. You can set the maximum number of objects maps can display so that maps load more quickly and are easier to read. Procedure 1 In the vSphere Client, select Edit > Client Settings > Maps tab. 2 Enter the maximum number of objects you want maps to display. 3 Click OK.
Chapter 13 Using vCenter Maps Table 13-1. Resource Map Icons Icon Description Host icon. A host that is compatible for vMotion migration. The color of the circle varies in intensity based on the load of the current host. Heavily used hosts are pale; low-load hosts are saturated green. A host that is not compatible for vMotion migration. Virtual machine icon. When the virtual machine is powered on, the icon contains a green triangle. Network icon. Datastore icon.
vCenter Server and Host Management 2 Select the object and click the Maps tab. For example, to display the resource map for your entire vCenter Server system, select the vCenter Server in the inventory panel. To display the resource map for a host, select the host in the inventory panel. Print vCenter Maps You can print resource maps to any standard printer. Perform this procedure on the vSphere Client Map tab. Procedure 1 Select File > Print Maps > Print.
Index Numerics 3DNow!, EVC modes 123 A abbreviations 7 Active Directory configuring settings 38 server 38 Active Directory Application Mode 51 active sessions, send messages 31 ADAM 51 adding distributed port groups 65 license keys 76, 77 adding hosts 58 admin contact info 64 advanced search 26 advanced settings, vCenter Server 42 alarms triggering on events 103 viewing 24 annotations 27 Asset 68 Assign license 69 assigning license keys 78 B baselines, security 18 binding on host, distributed port groups
vCenter Server and Host Management creating 61 relocate virtual machine files 116 determining which features are licensed 80 diagnostic bundles, generating 90 diagnostic data creating report 90 export 90 exporting 90 Directory Services 54 disconnecting from vCenter Server 22 distributed port groups adding 65 binding on host 66 config reset at disconnect 66 description 65 live port moving 66 name 65 number of ports 65 override settings 66 port group type 65 port name format 66 distributed switch adding a ho
Index hypervisor 11 I information panels 24 installing plug-ins 29 VirtualCenter Server 51 interfaces 19 inventory organize 57 searching 25 selecting objects 28 topology maps 137 inventory panels 24 IP address, vCenter Server 37 K kernel-level CPU features 117 L late binding port groups 65 LDAP 53 License capacity 68, 81, 83, 84 License compliance 71 License details 84 license inventory 73 license key, applying 79 License key 68, 69, 73, 84 License key details 84 license keys assigning 79 change history
vCenter Server and Host Management virtual machines with Storage vMotion 127, 131 with vMotion 126, 130 migration about 111 compatibility checks 124 limits 134 of suspended virtual machines 112 relocate virtual machine files 116 Storage vMotion 116 with snapshots 115 with vMotion 113 modules, See plug-ins N networks, requirements for vMotion 114 NFS, VMware vCenter Server Appliance 49 Normal operations 40 O objects, selecting 28 override settings, distributed port groups 66 P panels 24 per-processor lic
Index SMTP notification 38 server 38 snapshots, virtual machines, migrate 115 SNMP community string 39 receiver URL 39 settings 39 traps 39 Solution 68 Solution licensing 72 solutions, licensing 67 SSH 47 SSL certificate 108 SSL settings, configuring 42 starting, vSphere Client 20 statistics, impact on the database 37 Statistics, Collection Intervals 35 statistics intervals disabling 36 enabling 36 Statistics settings, configuring 35 status bar 24 storage, VMware vCenter Server Appliance 49 Storage vMotion
vCenter Server and Host Management stop 106 verify on Windows 106 vCenter Server license 72 vCenter Server services, monitoring 55 vCenterServer.VimApiUrl 55 vCenterServer.
