18 September 1997 Processing TOVS Polar Pathfinder data using the distributed batch controller
Author Affiliations +
Abstract
The distributed batch controller (DBC) supports scientific batch data processing. Batch jobs are distributed by the DBC over a collection of computing resources. Since these resources may be widely scattered the DBC is well suited for collaborative research efforts whose resources may not be centrally located. The DBC provides its users with centralized monitoring and control of distributed batch jobs. Version 1 of the DBC is currently being used by the TOVS Polar Pathfinder project to generate Arctic atmospheric temperature and humidity profiles. Profile generating jobs are distributed and executed by the DBC on workstation clusters located at several sites across the US. This paper describes the data processing requirements of the TOVS Polar Pathfinder project, and how the DBC is being used to meet them. It also describes Version 2 of the DBC. DBC V2 is implemented in Java, and utilizes a number of advanced Java features such as threads and remote method invocation. It incorporates a number of functional enhancements. These include a flexible mechanism supporting interoperation of the DBC with a wider variety of execution resources and an improved user interface.
© (1997) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
James Duff, Kenneth M. Salem, Axel Schweiger, Miron Livny, "Processing TOVS Polar Pathfinder data using the distributed batch controller", Proc. SPIE 3117, Earth Observing Systems II, (18 September 1997); doi: 10.1117/12.278920; https://doi.org/10.1117/12.278920
PROCEEDINGS
11 PAGES


SHARE
RELATED CONTENT


Back to Top