Skip to content

Conversation

@alexvanadio-databricks
Copy link
Contributor

This PR is for Issue #13 .

@QuentinAmbard and team, if it helps, you can interact with the notebooks here.

The one thing I'm not confident about is the budle_config.py. I added a cluster section but I'm not sure how to actually test it with dbdemos.

Things I did not do:

  • Perform any major changes to the full-multi-tables notebook. I strongly recommend we rearchitect this to use workflows instead of python multi-threading.

Other notes:

  • I cherry picked (in git) my commit to fix Method Encapsulation Issue #11 . I was going to pull main into my feature branch, but it had a lot more changes than the bugfix. There shouldn't be any merge conflicts with the cherry-pick approach. You can ignore those changes in the diff.

@alexvanadio-databricks
Copy link
Contributor Author

I spoke to @QuentinAmbard about this PR yesterday. We're going to move forward with testing these changes, but revert the new gold use case due to complexity. This more advanced gold use case will be added to a new notebook, and referenced with a link in the current one. I will create a separate PR for that work.

@QuentinAmbard
Copy link
Collaborator

QuentinAmbard commented Jul 22, 2024

hi @alexvanadio-databricks ! FYI I cherry picked the commit - but not everything is merged yet (not the agg) - I need to review that

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Method Encapsulation Issue

2 participants