Example upload task#15

Open

RubelMozumder wants to merge 16 commits intomainfrom

ExampleUPloadTask

Collaborator

RubelMozumder commented Jan 30, 2025

No description provided.

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/reader_config_setup.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/reader_config_setup.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/reader_config_setup.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated


		processes_list = []

		for input_params in SPM_PARAMS_OBJ_L:

sanbrock Feb 26, 2025

This seems to be the reimplementation of NOMAD which has the parallel machinery for processing files including the conversion from vendor format to nexus.. Note that by mounting directories of experiment data to NOMAD, one does not even need to copy data over.

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/upload_srcript.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/nomad_upload_api.py Outdated Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

src/pynxtools_spm/nomad_uploader/files_movers.py Show resolved Hide resolved

sanbrock reviewed

View reviewed changes

dev-requirements.txt Outdated Show resolved Hide resolved

RubelMozumder force-pushed the ExampleUPloadTask branch from e48e605 to a2f5a7c Compare

March 6, 2025 08:43

RubelMozumder force-pushed the ExampleUPloadTask branch 2 times, most recently from 32cc18b to b205725 Compare

May 2, 2025 14:46

mkuehbach changed the title ~~Example u pload task~~ Example upload task

Copilot AI review requested due to automatic review settings

December 4, 2025 10:55

RubelMozumder force-pushed the ExampleUPloadTask branch from ea85c68 to b8dac1e Compare

December 4, 2025 10:55

Copilot started reviewing on behalf of RubelMozumder

December 4, 2025 10:56

Copilot finished reviewing on behalf of RubelMozumder

December 4, 2025 11:05

Copilot AI reviewed

View reviewed changes

Contributor

Copilot AI left a comment

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

RubelMozumder force-pushed the ExampleUPloadTask branch 2 times, most recently from 833eaca to 17d4a45 Compare

February 10, 2026 14:35

RubelMozumder added 7 commits

February 10, 2026 15:36


          Upload scripts for Palmas.

e46467d


          Rebase on main.

4b56d89


          Remove unecessary pint statement and add some TODOs.

b486b41


          temp commit.

380764e


          Special Commit for local example to test the tools.

265573e


          Special Commit for local example to test the tools.

30cda64


          fist docs and logger.

e37561d

RubelMozumder added 6 commits

February 10, 2026 15:37


          Rebase on main.

97bf036


          Logger can write the log data into two separate files: one for conver…

c830d4b

…ter log and one for upload steps.


          Fully reviewed and tested.

b9622a9


          Add metadata to upload.

10f8f62


          Rebase on main.


          Uploading of the example files in nomad production successfully tested.

98b7c5f

Separate upload script in script folder.

RubelMozumder force-pushed the ExampleUPloadTask branch from 17d4a45 to 98b7c5f Compare

February 10, 2026 14:42

RubelMozumder added 2 commits

February 10, 2026 15:51


          Include info for cron job.

8f0b883


          pylint and pytest.

488b916

coveralls commented Feb 10, 2026 •

edited

Loading

Pull Request Test Coverage Report for Build 21873656902

Details

37 of 37 (100.0%) changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+3.5%) to 95.349%

Totals
Change from base Build 20129629698:	3.5%
Covered Lines:	82
Relevant Lines:	86

💛 - Coveralls


          cspell and mypy.

5058a80

RubelMozumder force-pushed the ExampleUPloadTask branch from 10ec818 to 5058a80 Compare

February 10, 2026 16:37

RubelMozumder mentioned this pull request

Cron job for running automated script to upload and publish (as an option) AFM, STM and STS experiment data #35

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet