|
Size: 4502
Comment:
|
Size: 6762
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| <<TableOfContents(5)>> | <<TableOfContents(3)>> |
| Line 9: | Line 9: |
| Well before your observations are scheduled to start, it is a good idea to prepare observing scripts, i.e. small !PaKo routines, to setup the receivers and spectrometers, to select your sources and lines, etc.. The Astronomer-of-Duty is there to help you doing this. Script should reside on the subdirectory ''~/PaKo'' of your project account. | Well before your observations are scheduled to start, it is a good idea to prepare observing scripts, i.e. small !PaKo routines, to setup the receivers and spectrometers, to select your sources and lines, etc.. The Astronomer-of-Duty is there to help you doing this. Script should reside on the subdirectory ''~/pako'' of your project account. |
| Line 22: | Line 22: |
| === A typical observing session: PaKo === === Displays === |
=== A typical observing session: PaKo [ASTRO] === |
| Line 51: | Line 50: |
| === How can I safe my data ? Use rsync, stupid ! === | * At the end of an observing run, the operators make sure that the observer receives a copy of the project account. Upon request, IMBfits raw data are included. Depending on the project size, the data may be provided on an external USB disk (provided by the observer, or by IRAM) or DVDs. * In addition, we retain at least one copy of the project account (including all 30m files and IMBfits raw data files) at the observatory. Upon request to the computer team, we will retrieve data. Depending on when the data were taken, data are stored on different media. Most recent projects are stored on a local disk array, the project archive ''prArch'' and/or on Ultrium tapes. Older data are still available via DVDs, and CDs. * Data streams are not regularly backuped. === How much data to expect ? === This depends on the spectrometers used, and on the observing mode and data rate, i.e. how many spectra are taken per second. To give a rough number: If you use the FTS backends, you may expect upto 1GB of data created per hour of observation. Calculate the space you might according to the formula space per hour of observing time = Backend-Channels * 4Bytes * spectra/sec * 3600 Example: Backend-Channels = 40000 , 1 spectra/sec: space 160KB*1*3600 ~= 50 MB/hour If you plan to take as well the IMBFits raw data back home, multiply by 2. === Saving data on external disks === Especially, for projects creating large amounts of data, it is a good idea if the observer copies data over to his/her own laptop or external hard disk. This should be done in regular intervals during the run, and not only at its end. * Assuming your project number is 100-11, change directory to the subdirectory on your local disk where project data shall be stores, and then copy the data over using ''rsync -rtvH --safe-links --bwlimit 2000 100-11@mrt-lx3:/vis/100-11/* ./''. * Detailed information is given [[https://mrt-lx1.iram.es/mainWiki/VisitorBackup|here (internal)]]. |
| Line 54: | Line 77: |
| === Howto work with spectra: CLASS === === Howto work with data cubes: GREG === |
=== Howto work with spectra: CLASS [ASTRO] === === Howto work with data cubes: GREG [ASTRO] === |
| Line 62: | Line 85: |
== Appendix == === Displays === === More information, references === * [[http://www.iram.es/IRAMES/mainWiki/PointingFluxes|Which pointing source to use ? Current fluxes]] * [[http://www.iram.es/IRAMES/mainWiki/CalibrationPapers|Compilation of papers on calibration of the 30m telescope]] |
Contents
Quick Guide for Dummies - The novice 30m observer
This guide is meant to help the novice observer at the 30m telescope getting started.
Howto observe ?
Well before your observations are scheduled to start, it is a good idea to prepare observing scripts, i.e. small PaKo routines, to setup the receivers and spectrometers, to select your sources and lines, etc.. The Astronomer-of-Duty is there to help you doing this. Script should reside on the subdirectory ~/pako of your project account.
When time has come to start real observing, take a seat and let the Astronomer-of-Duty and the Operator guide you through the first steps. It is really easy. You'll need to log into your project account onto mrt-lx1 and start the observing software called PaKo, run the receiver and backend setup scripts, select a source, and then e.g. start a pointing. This will send the commanded frequencies to the synthesizers, and it is now on the operator to "tune" the receivers, to make them ready for observations to start. This may take 10 minutes or more. Once tuning is finished, you may want to check the pointing and focus of the telescope first, before going to your science source. See below.
Getting started
- Log into your project account at the PC on the observers desk
- Start a new X-window/ KDE session under your project account
- Click on icon "paKo". this will connect to your project account on mrt-lx1
In the X-window, type: goPako, pakoDisplay, pako
Run your setup scripts a the pako prompt, e.g. @ setup
And then continue with set doSubmit yes, start
A typical observing session: PaKo [ASTRO]
Computer System
What are all the screens for ? Network topology or entering the unknown
mrt-lx1 is the name of the workstation to run the observations. This is the central machine, the observer is using for running PaKo. The online data processing software Odp is running on mrt-lx3. During observations it is continuously transferring IMBfits raw data from mrt-lx1 to mrt-lx3. The observer should use mrt-lx3 (or mrt-lx2) for offline data processing.
My machine is called mrt-lx18. Now what ? Software
PCs with numbers larger than 4, are small PCs used as terminals. Not much software is installed on these PCs and the user may want to quickly change to one of the main workstations described above, e.g. via ssh -X mrt-lx3.
Details like telescope and instruments
Data
Online data processing (Odp)
The Odp creates calibrated spectra online during the observations, stored in the so-called 30m files, and readable by class. In most cases, the observer works offline only with these files. However, in case of problems with the data, e.g. calibration issues, the observer needs to know to some extent what Odp is doing.
During observations, the backends take data and save them in streams in FITS format. These streams are merged with streams from other parts of the system, e.g. antenna mount drive, and also with messages, to be included in IMBFits raw data files. These are then combined by mira/odp to create calibrated spectra, usually on the antenna temperature scale TA*, and saved as 30m files. These in turn can then be read offline with class by the observer. Mira, class, greg are part of the GILDAS software package. Astronomical data therefore is created in several levels: level-1 are the streams, level-2 are the IMBfits files, level-3 are the 30m files. In case of calibration or other problems, it is possible to recalibrate data using MIRA, or even to recreate data from the streams.
Where are my data ?
- On the observers project account,
30m data are found here: ~/observationData/mira. One file is created per backend and per day, e.g. FTSOdp20120105.30m
IMBfits raw data are found here: ~/observationData/imbfits. Their file name gives date, scan-number, backend, e.g. iram30m-fts-20120107s167-imb.fits.
What happens to my data ? Backup, Storage
- At the end of an observing run, the operators make sure that the observer receives a copy of the project account. Upon request, IMBfits raw data are included. Depending on the project size, the data may be provided on an external USB disk (provided by the observer, or by IRAM) or DVDs.
In addition, we retain at least one copy of the project account (including all 30m files and IMBfits raw data files) at the observatory. Upon request to the computer team, we will retrieve data. Depending on when the data were taken, data are stored on different media. Most recent projects are stored on a local disk array, the project archive prArch and/or on Ultrium tapes. Older data are still available via DVDs, and CDs.
- Data streams are not regularly backuped.
How much data to expect ?
This depends on the spectrometers used, and on the observing mode and data rate, i.e. how many spectra are taken per second. To give a rough number: If you use the FTS backends, you may expect upto 1GB of data created per hour of observation.
Calculate the space you might according to the formula
space per hour of observing time = Backend-Channels * 4Bytes * spectra/sec * 3600
Example: Backend-Channels = 40000 , 1 spectra/sec: space 160KB*1*3600 ~= 50 MB/hour
If you plan to take as well the IMBFits raw data back home, multiply by 2.
Saving data on external disks
Especially, for projects creating large amounts of data, it is a good idea if the observer copies data over to his/her own laptop or external hard disk. This should be done in regular intervals during the run, and not only at its end.
Assuming your project number is 100-11, change directory to the subdirectory on your local disk where project data shall be stores, and then copy the data over using rsync -rtvH --safe-links --bwlimit 2000 100-11@mrt-lx3:/vis/100-11/* ./.
Detailed information is given here (internal).
Next steps: user dp
Howto work with spectra: CLASS [ASTRO]
Howto work with data cubes: GREG [ASTRO]
Whom to complain to ? Help needed
Don't be afraid of "silly" questions, please!
This page is maintained by CK. Any comments are welcome.
Appendix
Displays