Title: Online Data Processing
Master URL: http://www.iram.es/IRAMES/documents/projectDataProcOnline/
Revision: UNDER CONSTRUCTION, (needs review of section implementation and use cases), 1.1.4
Revision Date: 2002-06-14 [last rev: 2001-11-15]
Authors: W. Brunswig
Contributors: H. Ungerechts, A. Sievers
Audience: technical staff, astronomers
Publisher: IRAM, Granada, Spain
Keywords: data processing, data format, raw data, calibration, quick look
Description - about this document: This projects will implement online data processing under Unix. It will be one of the main features of the new control system but we foresee to install part of it already also in the current control system. This version of the document concentrates on the installation in the current control system.

User Guide (2002-06-06)

Operation

Start of odpCalibration process (2002-05-29)

The odpCalibration process is started during boot of host: mrt-lx1 by script script: /etc/rc.d/tcs.

Restart of odpCalibration process (2002-05-29)


This note on how to restart odpCalibration will be replaced soon by a script the operator can execute. In case of a failure of the odpCalibration process, the operator can restart the process on host: mrt-lx1 under account root:
  1. Check if the process ist still running: 
    ps uxa | grep odpCal
Result (similar to this, numbers can be different)
mrt       3529  0.2  0.4  3384 2108 pts/1    S    09:39   0:06 
  /usr/bin/python ./odpCal.py --pipeDir /mrt-lx1/mrt/data/Pipe/raw/pODP/ --name odp
  2. If there is still such a process, stop it: 
    kill -9 3529   # replace 3529 with the current process number
  3. restart odpCal with command: 
    /etc/rc.d/tcs.d/odpCal

Observer

File with calibrated data (2002-06-06)

Calibrated spectra are written into file: /mrt-lx1/mrt/data/(project-directory)/spectraOdp.30m . During creation of projects we set up a link: data.30m to this file in the default directory of the project. We also set up a link: data to the directory where project data (rawdata, fits files, ...) are stored. Access to the data directory and file data.30m is readonly !
Check if these links are defined for your project: if not your project account and execute: 
ln -s /mrt-lx1/mrt/data/(project-directory)/spectraOdp.30m data.30m
ln -s /mrt-lx1/mrt/data/(project-directory)/ data

Files with quick look data (2002-05-29)

Intermediate spectra used for "quick look" are written into file: /mrt-lx1/data/mrt/(project-directory)/spectraPlot.30m .

Monitor online data processing (2002-05-29)

On host: mrt-lx1 enter: 
/mrt/tcs/tools/tcsMessageMonXterm odpCal

Plotting calibrated data (2002-05-29)

The plot utility will display quick look data and the final calibrated data. On host: mrt-lx1 you can start the plot program by entering: 
/mrt/tcs/tools/odpPlot

In order to kill the plot process, enter "jobs" to find out the number of the plot job and enter "kill -9 n" with n being the job number.
2002-06-14Online Data Processing (W. Brunswig)