Distributed Processing Setup Guide
Table Of Contents
- Apple Qmaster Distributed Processing Setup Guide
- Contents
- Welcome to Distributed Processing
- Distributed Processing Basics
- Getting Started Quickly
- Preparing a Network for Distributed Processing
- The Minimum You Need to Know
- Example of a Minimal Distributed Processing Network
- Using Compressor AutoClusters
- Other Possible Components of a Distributed Processing Network
- Example of an Expanded Distributed Processing Network
- Sample Setup for Part-Time Processing on Desktop Computers
- Configuring Access for Part-Time Distributed Processing
- Setting Up for Part-Time Distributed Processing with Shake
- Additional Steps for Distributed Processing with Shake
- The Interfaces
- Creating Clusters
- An Overview of Configuring a Cluster
- Configuring Service Nodes and Cluster Controllers
- Creating Clusters with Apple Qadministrator
- About QuickClusters
- Administering Clusters
- Using the Command Line
- Installing Apple Qmaster from the Command Line
- Using the Command Line for Distributed Processing
- Using Scripts to Run Apple Qmaster, Compressor, and Batch Monitor
- Appendix
- Resources for Solving Problems
- Solutions to Common Problems
- Contacting AppleCare Support
Rather than actually moving segments, Apple Qmaster tells the service nodes which
segments to read via the network, where to find them, and what to do with them. Below
is an example of how one batch could be processed in an Apple Qmaster system.
Batch submitted by
Compressor or
Apple Qmaster (job request
for frames 1–30)
Cluster controller
divides and distributes
job to available
service nodes
Service node 1
Service node 2
Service node 3
Instructions specifying
locations of source files
and frames 11–20
Instructions specifying
locations of source files
and frames 21–30
Instructions specifying
locations of source files
and frames 01–10
Processed file (frames 1-30)
placed in specified
destination
In distributing batches, Apple Qmaster uses the technology built in to Mac OS X to locate
services in a cluster on the same IP subnet and to dynamically share and receive
information. Because the computers can continually transmit their current processing
availability status, Apple Qmaster can distribute (load-balance) the workload evenly across
the cluster.
14 Chapter 1 Distributed Processing Basics