User Tools

Site Tools


chara:pavo_analysis_manual

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
chara:pavo_analysis_manual [2018/11/29 14:49]
jones [processv2.pro]
chara:pavo_analysis_manual [2018/11/29 14:59]
jones [l0_l1_gui.pro]
Line 79: Line 79:
 ==== l0_l1_gui.pro ==== ==== l0_l1_gui.pro ====
  
-This program takes the .pav files and performs an automated outlier rejection as well as enables the user to manually reject bad sections of data. This program can only be run if /individual is set when running processv2.pro (i.e. .pav files have been created), which should really be the default option. \\  \\ Walkthrough: \\ 1) generate a file which contains the path and names of your .pav files you want to analyse, one .pav file per line. Suppose in the following this file is called //list//, and an example .pav file is called //example0.pav.// \\ 2) start the GUI in IDL, click on the LOAD button and load the file //list//. The output files for all scans will be called //list_l0l1.res.// \\ 3) The program will start showing results for the first .pav file, with the top panel displaying UT time versus V2, and the bottom panel UT time versus S/N (calculated in real-time (RT), i.e. the number you see in the PAVO server during observing). In the top panel each wavelength is shown as a white dot, and white squares are the average V2 over all wavelengths. Green squares are frames which are kept with the current rejection criteria. A screenshot of this for good 1-bl data can be found [[:chara:file_view_l0l1_1bl.tiff_232655714_l0l1_1bl.tiff|here]]. \\+This program takes the .pav files and performs an automated outlier rejection as well as enables the user to manually reject bad sections of data. This program can only be run if /individual is set when running processv2.pro (i.e. .pav files have been created), which should really be the default option. \\  \\ Walkthrough: \\ 1) generate a file which contains the path and names of your .pav files you want to analyse, one .pav file per line. Suppose in the following this file is called //list//, and an example .pav file is called //example0.pav.// \\ 2) start the GUI in IDL, click on the LOAD button and load the file //list//. The output files for all scans will be called //list_l0l1.res.// \\ 3) The program will start showing results for the first .pav file, with the top panel displaying UT time versus V2, and the bottom panel UT time versus S/N (calculated in real-time (RT), i.e. the number you see in the PAVO server during observing). In the top panel each wavelength is shown as a white dot, and white squares are the average V2 over all wavelengths. Green squares are frames which are kept with the current rejection criteria. A screenshot of this for good 1-bl data can be found {{:chara:files:l0l1_1bl.jpg?linkonly|here}}. \\
 4) Outlier rejection is based on 3 criteria: S/N, seconds after lock on fringes is lost (NSEC) and deviation from mean in sigma (SIGMA LIMIT); The default values for this should be fine in most cases; S/N cuts are probably the most sensible to be adjusted if data is particularly bad/good. \\ 4) Outlier rejection is based on 3 criteria: S/N, seconds after lock on fringes is lost (NSEC) and deviation from mean in sigma (SIGMA LIMIT); The default values for this should be fine in most cases; S/N cuts are probably the most sensible to be adjusted if data is particularly bad/good. \\
-5) The bottom row shows a range of diagnostics that can be used to determine the quality of data such as group delays, cart positions, V2C/V2 (measure of t0, good if high) and histograms. An example for a histogram display for 3-bl data can be found [[:chara:file_view_l0l1_3bl.tiff_232655724_l0l1_3bl.tiff|here]]. The top right window will display the fraction of datapoints rejected with the current settings. \\+5) The bottom row shows a range of diagnostics that can be used to determine the quality of data such as group delays, cart positions, V2C/V2 (measure of t0, good if high) and histograms. An example for a histogram display for 3-bl data can be found {{:chara:files:l0l1_3bl.jpg?linkonly|here}}. The top right window will display the fraction of datapoints rejected with the current settings. \\
 6) Once you're satisfied with the rejection settings for the scan press OUTPUT FILE, which will show V2 vs lambda using all frames that survived the outlier rejection. This step will create and entry in the output file //list_l0l1.res//, as well as an individual file //example0.pav_UT??_UT??.dat//, depending on the UT range that goes into the scan. \\  \\ Note: If you are adjusting outlier rejection criteria, it is probably a good idea to use a set of best settings for all scans of a single night (rather than adjusting them star-by-star) in order to avoid bias in your calibration. Ideally you shouldn't have to adjust anything, and simply use the graphical inspection to decide which scans are useful for calibration and which are not. \\ Note2: OUTPUT FILE also create additional files called //example0.pav.ind//  and //example0.pav.cov.//  The contain the array indices of frames that are kept for each file, as well as the covariance matrix of each scan which are used in l1_l2_gui.pro 6) Once you're satisfied with the rejection settings for the scan press OUTPUT FILE, which will show V2 vs lambda using all frames that survived the outlier rejection. This step will create and entry in the output file //list_l0l1.res//, as well as an individual file //example0.pav_UT??_UT??.dat//, depending on the UT range that goes into the scan. \\  \\ Note: If you are adjusting outlier rejection criteria, it is probably a good idea to use a set of best settings for all scans of a single night (rather than adjusting them star-by-star) in order to avoid bias in your calibration. Ideally you shouldn't have to adjust anything, and simply use the graphical inspection to decide which scans are useful for calibration and which are not. \\ Note2: OUTPUT FILE also create additional files called //example0.pav.ind//  and //example0.pav.cov.//  The contain the array indices of frames that are kept for each file, as well as the covariance matrix of each scan which are used in l1_l2_gui.pro
  
chara/pavo_analysis_manual.txt ยท Last modified: 2018/11/29 15:30 by jones