Remote Data Reduction with CHARA
For remote data reduction, we are running a virtual machine on the CHARA server in Atlanta. This machine currently has the data reduction packages for Classic, CLIMB, JouFlu, PAVO, VEGA, and MIRC-X installed.
Arranging Access to the Remote Data Reduction Machine
Use this form to request access. After submitting this form, we will make an account on the machine for the user, start a VNC server on their account, and send their login credentials. We use VNC because the graphical elements of the reduction software packages are often prohibitively slow through ssh. Please allow 3-5 business days for a response to your request. If we have not responded within that time, email CHARA Data Scientist Jeremy Jones (This email address is being protected from spambots. You need JavaScript enabled to view it.).
Connecting to the Remote Data Reduction Machine
- Download and install a VNC viewer. We recommend tigervnc (http://tigervnc.org/) because of the viewers we’ve tested, it runs the fastest. Others do work, though.
- If using tigervnc's viewer, run the vncviewer command. This should open a window that looks like this:
- Input the address you are given into the "VNC server" prompt. This should bring up a password prompt. This will connect you to the Atlanta remote observing machine.
- If you get the error "unable to connect to host: Connection timed out (10060)", you are likely behind a firewall and should try again from another network or get in touch with your IT people to open up the 5900 range of ports (5900-5999).
- If it is your first time accessing the system, we recommend changing the automatically generated passwords. To change your password for your VNC server, run the command “vncpasswd” and to change your account password, use the command “passwd”.
Finding the Data
Once logged on, you can find the data in the /dbstorage/ directory. From there, it is organized by beam combiner. CLIMB, Classic, JouFLU, and miscellaneous CHARA data are in the /dbstorage/Cl_CL_JF/ directory. The rest are self-explanatory. Data are proprietary within 18 months, so if you have any data from that time period, make sure to note it in your access form or email Jeremy. If you wish to access another PI’s proprietary data, we will, of course, need their permission. Once we have that, we will give you access to it. Older data are freely accessible.
Reducing your Data
Classic/JouFLU Data Reduction
We recommend that you use redfluor for Classic/JouFLU reduction. A tutorial can be found here.
Note: Make sure to use the –D flag to indicate the destination for the reduced files as you will not have write permissions in the data directory.
CLIMB Data Reduction
Use the redclimb pipeline for your CLIMB data reduction. More information can be found here.
Note: Make sure to use the –D flag to indicate the destination for the reduced files as you will not have write permissions in the data directory. We will be providing John Monnier’s IDL pipeline soon.
PAVO Data Reduction
The PAVO Data Reduction manual can be found here. All of the IDL scripts are installed and available. To access them, run ‘pavo_idl’. We will run headstrip.pro on each night’s data as it comes in.
VEGA Data Reduction
Instructions for how to reduce VEGA data are available on the VEGA website
MIRCX Data Reduction
The new MIRCX pipeline is installed. Documentation here.
Questions
Please direct any questions to CHARA Data Scientist Jeremy Jones (This email address is being protected from spambots. You need JavaScript enabled to view it.)