-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Look for the closest declination line and adequate NSB random forest model for DL2 production #280
base: main
Are you sure you want to change the base?
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #280 +/- ##
==========================================
+ Coverage 79.76% 81.58% +1.81%
==========================================
Files 59 57 -2
Lines 5144 4984 -160
==========================================
- Hits 4103 4066 -37
+ Misses 1041 918 -123 ☔ View full report in Codecov by Sentry. |
@moralejo, I was going to comment in today's meeting. The way we look for the adequate RF model declination track is by using the pointing information from the TCU database (specifically the target coordinates), not checking the average pointing information inside the data files as you mentioned. Is this fine? |
Since the relevant pointing is the one in celestial coordinates, the target coordinates are perfectly fine for standard observations (if we ever do something like drift scans we will anyway have to do some custom work). |
new changes regarding NSB tunning were included
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The NSB + declination directory scheme looks good to me. Just left some comments to improve the readability of the code.
I trigger again the CI, since now lstchain is available in conda forge.
EDIT on the CI run: it will not work because of an incompatibility with lstcam_calib package still requiring ctapipe_io_lst 0.24.x
I did that because the dl2 files should be saved in directories like "...tailcutXY/nsb_tuning_X.XX/", and the cleaning levels are fixed in the dl1ab step with the find_tailcuts function. |
Using as pointing declination the median of the declination of the datacheck files was not working, because by the time the sequence*.py files are written, the datacheck files have not been produced yet. Therefore, the RF model could not be determined. So I made this change to use the declination given in the run catalogs, which is actually the pointing declination of the telescope. |
Have you checked if this is available for all runs? |
No, in any case, I am testing it and this scheme doesn't work, because the function get_RF_model() is called before having even launched the r0_to_dl1 step. Consequently, no dl1a files have been created yet by the time this function is called and therefore the "find_tailcuts" function inside get_RF_model cannot be called. |
I agree, it seems like another analysis step that could fit in datasequence. |
Choose the adequate RF model in the [declination lines x NSB] MC grid.
Closes #275 (initially for just choosing the declination MC track closest to the target declination)