Define API for reader and image_mapper

[TjarkMiener]

This PR suggests APIs for the reader and image_mapper. The configuration system and component scheme of ctapipe is adopted. Besides we adopt astropy tables for the batch generation. Reading is working in monoscopic and stereoscopic mode for DL1 images and R1 waveforms. The code properly process data with different array and telescope (divergent) pointings.

A subclass designed for the adv. trigger system processing R0 waveforms will be added in a separated PR.

–––
Closes #31 #104

[Pablitinho]

setup.cfg has a deprecated line.
Now:

[tool:pytest]
pep8ignore =

Action (remove pep8ignore line):
[tool:pytest]

If you dont remove this line you will have a warning in pytest like this:

`============================================================================================================================ warnings summary =============================================================================================================================
../../../miniconda3/envs/ctlearn/lib/python3.11/site-packages/_pytest/config/init.py:1441
/Users/pabloguzmansanchez/miniconda3/envs/ctlearn/lib/python3.11/site-packages/_pytest/config/init.py:1441: PytestConfigWarning: Unknown config option: pep8ignore

self._warn_or_fail_if_strict(f"Unknown config option: {key}\n")

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html`

After remove the pep8ignore line , the warning is out.

[Pablitinho]

Add an empty __init__.py inside "tests" folder and add a minimal test, like this one:

`from dl1_data_handler.reader import DLDataReader

def test_inputs():
dl1dh_reader_type = "DLImageReader"
input_url_signal = ["./asdasd.h5"] # Simulated missing file
input_url_background = []

try:
    reader = DLDataReader.from_name(
        dl1dh_reader_type,
        input_url_signal=sorted(input_url_signal),
        parent=None,
    )
    # If no exception occurs, log a success message
    print("Reader initialized successfully.")
except FileNotFoundError as e:
    print(f"FileNotFoundError caught: {e}")  # Log the error

`
RUN:
$ pip install pytest
$ pytest ./tests

It is working for me.

[TjarkMiener]

I piggybacked on ctapipe for the test data in order to implement a minimal unit test. Can you please check the latest commit @Pablitinho thanks!

[Pablitinho]

I piggybacked on ctapipe for the test data in order to implement a minimal unit test. Can you please check the latest commit

After check the log. Says that " ModuleNotFoundError: No module named 'tensorflow'" So.. In .github folder you should add tensorflow to be installed and also in environment.yml. After install tensorflow I am getting another error that I am checking "> assert features["input"].shape == (1, 110, 110, 2)
E IndexError: only integers, slices (:), ellipsis (...), numpy.newaxis (None) and integer or boolean arrays are valid indices

dl1_data_handler/tests/test_loader.py:35: IndexError". Let's me take a look

[TjarkMiener]

@Pablitinho thanks for noticing, I just moved the loader class to ctlearn because of the keras/tensorflow dependency. This is solving the tests. I will merge #142 and rebase this branch.

[TjarkMiener]

Thanks a lot @rcervinoucm. CI is passing now with 'minimal' meaningful unit testing. This PR also includes the preparation for dl1dh v0.13.0. Anything missing or can we go ahead? @Pablitinho @nietootein @rcervinoucm

[Pablitinho]

@TjarkMiener

UnclosedFileWarning:

/Users/pp/miniconda3/envs/ctlearn/lib/python3.11/site-packages/tables/file.py:114: UnclosedFileWarning: Closing remaining open file: /private/var/folders/qk/qydpv_9n4b5g2pl834gyrcw80000gn/T/pytest-of-pabloguzmansanchez/pytest-31/r1_0/gamma.r1.h5 warnings.warn(UnclosedFileWarning(msg)) /Users/pp/miniconda3/envs/ctlearn/lib/python3.11/site-packages/tables/file.py:114: UnclosedFileWarning: Closing remaining open file: /private/var/folders/qk/qydpv_9n4b5g2pl834gyrcw80000gn/T/pytest-of-pabloguzmansanchez/pytest-31/dl1_0/gamma.dl1.h5 warnings.warn(UnclosedFileWarning(msg))

In order to avoid this problem (the files are not closed), the most appropiate solution is the next:

`
...
import atexit

...
class DLDataReader(Component):

def __init__(
    self,
    input_url_signal,
    input_url_background=[],
    config=None,
    parent=None,
    **kwargs,
):
     ....
     atexit.register(self.__destructor)
      ....

def __destructor(self):
    """Destructor to ensure all opened HDF5 files are properly closed."""
    if hasattr(self, "files"):  # Ensure self.files exists before attempting to close
        for file_name in list(self.files.keys()):
            try:
                if self.files[file_name].isopen:  # Check if file is still open
                    print(f"Closing file: {file_name}")
                    self.files[file_name].close()
            except Exception as e:
                print(f"Error closing file {file_name}: {e}")

`
Dont use functions like del or exit . del is called when the user del the object and exit is when is out of the scope.

This is a suggestion, apply it if you wish.

[nietootein]

Thanks so much, @TjarkMiener and everyone involved!