Skip to content

Modify test script for SLURM pipeline execution; update .gitignore#36

Merged
alejoe91 merged 1 commit intoAllenNeuralDynamics:mainfrom
vncntprvst:main
May 13, 2025
Merged

Modify test script for SLURM pipeline execution; update .gitignore#36
alejoe91 merged 1 commit intoAllenNeuralDynamics:mainfrom
vncntprvst:main

Conversation

@vncntprvst
Copy link
Contributor

No description provided.

@alejoe91
Copy link
Collaborator

alejoe91 commented Apr 4, 2025

Thanks @vncntprvst

Are you testing out the pipeline? Feedback is welcome :)

Note that I'll be pushing some changes in the next couple of weeks to simplify the definition of resources and parameters, so stay tuned!

@vncntprvst
Copy link
Contributor Author

Hey Alessio,
Staying tuned :)
As for the feedback:
In term of making the pipeline run, I think the most difficult part was to write and test custom code to generate the subject and data_description json files that follow the aind-data-schema specification. The documentation for that is helpful but not sufficient. Luckily, I had already some code for that purpose, but still had to spent a few hours to make that work for the pipeline. The pipeline actually failed at a later NWB conversion step:
image
I'm not sure what to do to fix that.
The second thing is that, although I was able to load some of the output (e.g., spikes), I didn't manage to create a proper SortingAnalyzer object. I'll post an issue on that topic.
Otherwise, great work !
We can talk more later this week, I'll be in Seattle for the ODIN conference.

@alejoe91
Copy link
Collaborator

alejoe91 commented Apr 7, 2025

We can talk more later this week, I'll be in Seattle for the ODIN conference.

Unfortunately I won't be able to make it this year :( I'd be happy to schedule a chat though so I can try to help you out! Can you send me an email so we can organize?

@vncntprvst
Copy link
Contributor Author

Definitely!

@alejoe91 alejoe91 merged commit 478724d into AllenNeuralDynamics:main May 13, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants