Skip to content

Low state blazar#483

Merged
JulienPeloton merged 55 commits intoastrolabsoftware:blazar_reviewfrom
JulianHamo:LowStateBlazar
Jan 15, 2025
Merged

Low state blazar#483
JulienPeloton merged 55 commits intoastrolabsoftware:blazar_reviewfrom
JulianHamo:LowStateBlazar

Conversation

@JulianHamo
Copy link
Collaborator

IMPORTANT: Please create an issue first before opening a Pull Request.
Linked to issue(s): Closes put link

If this is a new release, did you issue the corresponding schema in fink-client?

otherwise you'll break the livestream service!

What changes were proposed in this pull request?

How is the issue this PR is referenced against solved with this PR?

How was this patch tested?

JulianHamo and others added 30 commits December 18, 2024 12:08
Creation of the low state detection module file
Computation from ZTF data release 22
Description:
- 3FGL Name: Name of the source inthe 3FGL catalog
- ZTF Name: ZTF tag associated beforehand
- Array of Medians: Medians used to standardize the flux (np.nan if no median could be computed)
- Computed Threshold: 10th percentile of the standardized flux from the data release
- Observed Threshold: Measured flux during a previous redshift detrmination attempt
- Redshift: Redshift found during the previous spectroscopic observation
- Final Threshold: Minimum between the Computed Threshold and the Observed Threshold
Refont after utils.py creation
Edit documentation of low_state_
CTAO blazar comparison file (parquet)
Computation from ZTF data release 22
Description:
- 3FGL Name: Name of the source inthe 3FGL catalog
- ZTF Name: ZTF tag associated beforehand
- Array of Medians: Medians used to standardize the flux (np.nan if no median could be computed)
- Computed Threshold: 10th percentile of the standardized flux from the data release
- Observed Threshold: Measured flux during a previous redshift detrmination attempt
- Redshift: Redshift found during the previous spectroscopic observation
- Final Threshold: Minimum between the Computed Threshold and the Observed Threshold
Page setting
Update documentation
Fix name in standardized_flux_
Fix CTAO_PATH
Fix CTAO_PATH
@JulianHamo JulianHamo requested review from JulienPeloton and removed request for JulienPeloton January 10, 2025 13:15
Copy link
Member

@JulienPeloton JulienPeloton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @JulianHamo ! I left two minor comments :-)

rm -f /tmp/forest_*.onnx
./run_tests.sh
./run_tests.sh --single_module fink_science/standardized_flux/processor.py
./run_tests.sh --single_module fink_science/blazar_low_state/processor.py
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now you can remove this :-)

Array of ratios for:
Mean over threshold of the last but one alert
Mean over threshold of the last alert
Measurement over threshold of the last alert
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to specify default values of -1 in case of problem.

@JulienPeloton JulienPeloton changed the base branch from master to blazar_review January 15, 2025 14:49
Copy link
Member

@JulienPeloton JulienPeloton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @JulianHamo -- all good except the failure is due to the fact that the data file is not in the correct place. I'm merging and fixing the issue.

@JulienPeloton JulienPeloton merged commit fb72a95 into astrolabsoftware:blazar_review Jan 15, 2025
JulienPeloton added a commit that referenced this pull request Jan 15, 2025
* Low state blazar (#483)

* Create processor.py

Creation of the low state detection module file

* CTAO blazar comparison file (parquet)

Computation from ZTF data release 22
Description:
- 3FGL Name: Name of the source inthe 3FGL catalog
- ZTF Name: ZTF tag associated beforehand
- Array of Medians: Medians used to standardize the flux (np.nan if no median could be computed)
- Computed Threshold: 10th percentile of the standardized flux from the data release
- Observed Threshold: Measured flux during a previous redshift detrmination attempt
- Redshift: Redshift found during the previous spectroscopic observation
- Final Threshold: Minimum between the Computed Threshold and the Observed Threshold

* First writing draft of processor.py

* Create utils.py

* Update processor.py

Refont after utils.py creation

* Update utils.py

Edit documentation of low_state_

* Create utils.py

* Add files via upload

CTAO blazar comparison file (parquet)
Computation from ZTF data release 22
Description:
- 3FGL Name: Name of the source inthe 3FGL catalog
- ZTF Name: ZTF tag associated beforehand
- Array of Medians: Medians used to standardize the flux (np.nan if no median could be computed)
- Computed Threshold: 10th percentile of the standardized flux from the data release
- Observed Threshold: Measured flux during a previous redshift detrmination attempt
- Redshift: Redshift found during the previous spectroscopic observation
- Final Threshold: Minimum between the Computed Threshold and the Observed Threshold

* Create processor.py

* Update utils.py

* Create __init__.py

* Create __init__.py

* Create README.md

* Update README.md

Page setting

* Create README.md

* Update processor.py

Update documentation

* Update utils.py

Fix name in standardized_flux_

* Update processor.py

Fix CTAO_PATH

* Update processor.py

Fix CTAO_PATH

* Update of CI script to run only on single modules

* Update of CI script to run only on single modules

* Update of CI script to run only on single modules

* Update of standardized_flux/utils.py

* Change from 'low' to 'quiescent'

* Documentation update

* PEP8 check test

* PEP8 fix

* __init__.py fix

* PEP8 fix test

* PEP8 fix test

* PEP8 fix test

* PEP8 fix test

* PEP8 fix test

* Datatest creation

* Shrinking of datatest size

* PEP8  fix

* Datatest path change

* Example fix

* Example fix

* Example fix

* Modification of tester.py

* Modification of CTAO_blazars path

* Modification of CTAO_blazars path

* Modification of CTAO_blazars path

* Modification of CTAO_blazars path

* Modification of CTAO_blazars path

* Example fix attempt

* Example fix attempt

* Example fix attempt

* PATH change

* Test addition

* Test addition

* Test addition

* Test addition

* Minor corrections

---------

Co-authored-by: Julian <julian@>

* Move Blazar file

* Fix Illegal Parquet type: INT64 (TIMESTAMP_MICROS) error by recreating the file

---------

Co-authored-by: JulianHamo <hamo@ijclab.in2p3.fr>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants