This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
chara:archived_procedures [2022/01/18 22:01] charaobs |
chara:archived_procedures [2023/08/30 16:58] (current) jones |
||
---|---|---|---|
Line 4: | Line 4: | ||
{{: | {{: | ||
+ | |||
+ | ===== Bootlaunch for servers ===== | ||
+ | |||
+ | Here are the available bootlaunch scripts as of June 2017:\\ | ||
+ | \\ | ||
+ | gps computer: | ||
+ | |||
+ | * bootlaunch_beamsamp – Starts the beam sampler servers, BS1 and BS2. | ||
+ | * bootlaunch_zaber – Starts the ZABER_2 server. | ||
+ | |||
+ | \\ telescope bunker computers are now using bootlaunch_master to start each of the servers listed below. | ||
+ | |||
+ | * bootlaunch_hut – Starts the E1_HUT, E2_HUT, S1_HUT, S2_HUT, W1_HUT, or W2_HUT server, depending on the machine it's launched from. | ||
+ | * bootlaunch_rpc – Starts the RPC_E1, RPC_E2, RPC_S1, RPC_S2, RPC_W1, or RPC_W2 server, depending on the machine it's launched from. | ||
+ | * bootlaunch_weather – Starts the E1_WEATHER, E2_WEATHER, S1_WEATHER, S2_WEATHER, W1_WEATHER, or W2_WEATHER server, depending on the machine it's launched from. | ||
+ | * bootlaunch_lower – Starts the E1_Lower, E2_Lower, S1_Lower, S2_Lower, W1_Lower, or W2_Lower cylinder server, depending on the machine it's launched from. | ||
+ | * bootlaunch_upper – Starts the E1_Upper, E2_Upper, S1_Upper, S2_Upper, W1_Upper, or W2_Upper server, depending on the machine it's launched from. | ||
+ | |||
+ | ===== Manually restarting the dome server ===== | ||
+ | |||
+ | To manually start the dome server: | ||
+ | |||
+ | 1. Make sure the power to the drives is OFF. | ||
+ | |||
+ | 2. Login to the relevant computer as observe. For example, type " | ||
+ | |||
+ | 3. Work out the process ID number (PID), either with the command | ||
+ | |||
+ | (s1:1001) tsockman get dome_S1 \\ Name : dome_S1 \\ Machine : s1.chara-array.org \\ PID : 29953 \\ Commands : -1 \\ Data : -1 \\ Message : 4002 \\ Restart : / | ||
+ | |||
+ | 5. You should then check that the server has indeed stopped: \\ \\ [s1:600] tsockman get dome_S1 \\ Name : dome_S1 \\ Machine : s1.chara-array.org \\ PID : 15635 \\ Commands : -1 \\ Data : -1 \\ Message : 2008 \\ Restart : / | ||
+ | |||
+ | 6. Restart the dome server by copying the command at the end of the / | ||
+ | |||
+ | [s1:602] more / | ||
+ | |||
+ | 7. Turn the power to the drives back on. | ||
+ | |||
+ | 8. Hit REOPEN and ENABLE on the domegtk, and type " | ||
===== Tiptilt Server: ===== | ===== Tiptilt Server: ===== | ||
Line 11: | Line 50: | ||
From the Observing Procedures page: | From the Observing Procedures page: | ||
- | (This section is obsolete with the retiring of the old lab tiptilt)\\ | + | (This section is obsolete with the retiring of the old lab tiptilt) \\ Establish connection between tiptilt and the telescopes. On the Control Tab on Cosmic Debris, click on [TIPTILT COMM]. Click [START JOB QUEUE] on CD to continue the Tiptilt Communication sequence. After several seconds, the telescope servers will indicate that the Socket (SOC) connection is established and turn on the tiptilt rate display. Cosmic Debris will usually display a lower rate, such as 42Hz, to indicate tiptilt is running. The servers will display 158Hz to show a proper functioning of the tiptilt system. If the connection is not established the first time, try again until CD shows rates for each telescope used. If a telescope server will not display a TT signal rate, you may need to shut it down and restart it. Once the telescope WFS's are used for tiptilt, these steps for the lab tiptilt will not be used. \\ Finish setting up tiptilt GUIs. Click re-open on the Tiptilt GUI. This will update the TT labels on the TT viewing screens from B1,B2,etc to the telescope names. Click on the [SERVO CONTROL] tab on the tiptilt GUIto bring up a second window and move to screen 5 with the telescope guis. The Servo Control GUIallows you to turn ON the servo for the TT loop and make biases for individual beams (DBIAS and ZBIAS) |
- | Establish connection between tiptilt and the telescopes. On the Control Tab on Cosmic Debris, click on [TIPTILT COMM]. Click [START JOB QUEUE] on CD to continue the Tiptilt Communication sequence. After several seconds, the telescope servers will indicate that the Socket (SOC) connection is established and turn on the tiptilt rate display. Cosmic Debris will usually display a lower rate, such as 42Hz, to indicate tiptilt is running. The servers will display 158Hz to show a proper functioning of the tiptilt system. If the connection is not established the first time, try again until CD shows rates for each telescope used. If a telescope server will not display a TT signal rate, you may need to shut it down and restart it. Once the telescope WFS's are used for tiptilt, these steps for the lab tiptilt will not be used.\\ | + | |
- | Finish setting up tiptilt GUIs. Click re-open on the Tiptilt GUI. This will update the TT labels on the TT viewing screens from B1,B2,etc to the telescope names. Click on the [SERVO CONTROL] tab on the tiptilt GUIto bring up a second window and move to screen 5 with the telescope guis. The Servo Control GUIallows you to turn ON the servo for the TT loop and make biases for individual beams (DBIAS and ZBIAS) | + | |
- | The tiptilt server controls the CCD based tiptilt detection system.\\ | + | The tiptilt server controls the CCD based tiptilt detection system. \\ \\ Before you start the tiptilt server, you must ensure that the power to the cooling system and the CCD iteslf is on. It is extremely important that the cooler be running before you turn on the CCD and is only turned off if you are sure the CCD is NOT running. You can start the server from the X windows menu or with the command xtiptilt. \\ \\ Note that there are background counts and read noise to deal with. Whenever you change the frame rate, please ensure that the bias frame is OK. The server will attempt to load an old bias frame that should work, but if things are not working, try making a new bias frame by ensuring that the detector is in the dark and typing " |
- | \\ | + | |
- | Before you start the tiptilt server, you must ensure that the power to the cooling system and the CCD iteslf is on. It is extremely important that the cooler be running before you turn on the CCD and is only turned off if you are sure the CCD is NOT running. You can start the server from the X windows menu or with the command xtiptilt.\\ | + | |
- | \\ | + | |
- | Note that there are background counts and read noise to deal with. Whenever you change the frame rate, please ensure that the bias frame is OK. The server will attempt to load an old bias frame that should work, but if things are not working, try making a new bias frame by ensuring that the detector is in the dark and typing " | + | |
- | \\ | + | |
- | In the tiptilt GUI windows, the white dots represent the starlight while the green dots represent the motion applied to telescope' | + | |
==== Tiptilt server complains about the CCD ==== | ==== Tiptilt server complains about the CCD ==== | ||
- | Is the CCD turned on? When the tiptilt server starts up it tries no more than five times to communicate with the CCD. If they all fail, it will give up. If this happens, try cycling the power to the CCD and try again. If this fails, connect to the tiptilt machine and type the command rtccdAPIDemo, | + | Is the CCD turned on? When the tiptilt server starts up it tries no more than five times to communicate with the CCD. If they all fail, it will give up. If this happens, try cycling the power to the CCD and try again. If this fails, connect to the tiptilt machine and type the command rtccdAPIDemo, |
- | \\ | + | |
- | Note that it is never a good idea to reboot machines unless you are very very sure it is necessary. The only reason to reboot tiptilt, other than a lock up of some kind, is that the clock interrupt has failed. You can test this by running the command " | + | |
- | \\ | + | |
- | Also note that cycling the power on the CCD can cause harm so be sure you need to do it before trying it. Also, it is important to wait for at least 20 seconds after turning off the power before turning it on again. | + | |
==== Tiptilt doesn' | ==== Tiptilt doesn' | ||
- | Sometimes the telescope server will not show that TT is running. It will show 0Hz for a signal rate for TT. Running TIPTILT COMM will not get it started while other scopes do show it starting. Close and restart any telescope servers that won't connect after two tries of TIPTILT COMM.\\ | + | Sometimes the telescope server will not show that TT is running. It will show 0Hz for a signal rate for TT. Running TIPTILT COMM will not get it started while other scopes do show it starting. Close and restart any telescope servers that won't connect after two tries of TIPTILT COMM. \\ Note: There is more info in the software manual on this topic, but I wasn't sure if it was still relevant. |
- | Note: There is more info in the software manual on this topic, but I wasn't sure if it was still relevant. | + | |
==== Tiptilt server says the clock isn't running ==== | ==== Tiptilt server says the clock isn't running ==== | ||
- | First check whether the clock itself is running and the other machines receive the clock signal. Look at the clock cards at the back of other computers in the rack. The clock cards have three LEDs, one yellow and two greens. If the computer is receiving the clock signal properly all three LEDs should blink, but at a different rate. If the LEDs on all the clock cards are solid then reboot the GPS computer. When the GPS computer is down, it is best to cycle the power also on the box right above the GPS computer.\\ | + | First check whether the clock itself is running and the other machines receive the clock signal. Look at the clock cards at the back of other computers in the rack. The clock cards have three LEDs, one yellow and two greens. If the computer is receiving the clock signal properly all three LEDs should blink, but at a different rate. If the LEDs on all the clock cards are solid then reboot the GPS computer. When the GPS computer is down, it is best to cycle the power also on the box right above the GPS computer. \\ \\ If the clock appears to be working properly on other machines and not on the tiptilt now it is time to reboot tiptilt. \\ \\ [There is a bug in the real time part of the CCD code. It is caused by the clock in the tiptilt system either not running at all or having been set to a time very different from the last time the CCD ran.] \\ \\ For the time being the only solution is to reboot tiptilt, but do so from the lab. Power OFF the CCD, then reboot the tiptilt machine and go into the BIOS. Make sure that interrupt 11 has been set to ISA legacy, save the BIOS and reboot. When the clock card LEDs in the tiptilt machine indicate proper clock signal, turn the CCD back on and start the tiptilt server. \\ \\ Also, sometimes Serial Port 3 grabs IRQ 11 which stops the clock from running. Since there is no serial port 2 it's safe to disable this in the BIOS. This problem normally comes up when there has been a power outage. \\ \\ Sometimes syncing the clock can also cause this problem, but that should be fixed soon. If it does, exit the tiptilt server, log in as root, and reload the tiptilt model using the following commands: \\ /sbin/rmmod tiptilt_rt \\ / |
- | \\ | + | |
- | If the clock appears to be working properly on other machines and not on the tiptilt now it is time to reboot tiptilt.\\ | + | |
- | \\ | + | |
- | [There is a bug in the real time part of the CCD code. It is caused by the clock in the tiptilt system either not running at all or having been set to a time very different from the last time the CCD ran.]\\ | + | |
- | \\ | + | |
- | For the time being the only solution is to reboot tiptilt, but do so from the lab. Power OFF the CCD, then reboot the tiptilt machine and go into the BIOS. Make sure that interrupt 11 has been set to ISA legacy, save the BIOS and reboot. When the clock card LEDs in the tiptilt machine indicate proper clock signal, turn the CCD back on and start the tiptilt server.\\ | + | |
- | \\ | + | |
- | Also, sometimes Serial Port 3 grabs IRQ 11 which stops the clock from running. Since there is no serial port 2 it's safe to disable this in the BIOS. This problem normally comes up when there has been a power outage.\\ | + | |
- | \\ | + | |
- | Sometimes syncing the clock can also cause this problem, but that should be fixed soon. If it does, exit the tiptilt server, log in as root, and reload the tiptilt model using the following commands:\\ | + | |
- | /sbin/rmmod tiptilt_rt\\ | + | |
- | / | + | |
- | \\ | + | |
- | Note that it is never a good idea to reboot machines unless you are very very sure it is necessary. The only reason to reboot tiptilt, other than a lock up of some kind, is that the clock interrupt has failed. You can test this by running the command " | + | |
==== Tiptilt is not locking on a star or locks, but lets the star drift away ==== | ==== Tiptilt is not locking on a star or locks, but lets the star drift away ==== | ||
Line 96: | Line 108: | ||
cosmic_fluor -F -o2 (for a secondary program using secondary ople) | cosmic_fluor -F -o2 (for a secondary program using secondary ople) | ||
- | |||
- |