Skip to content

Conversation

ricardoV94
Copy link
Member

@ricardoV94 ricardoV94 commented Jan 30, 2025

A user on discourse recently raised the question of why we can't eval logp graphs during their construction. We have some tagging Ops that raise on the perform method, that prevent this.

https://discourse.pymc.io/t/how-to-implement-bivariate-poisson-logbp/16400/7?u=ricardov94

This PR allows evaluating them, but issues a warning. I've felt the need to get values in interactive debug many times.


📚 Documentation preview 📚: https://pymc--7666.org.readthedocs.build/en/7666/

@ricardoV94 ricardoV94 force-pushed the allow_debugging_logp_graphs branch from 2fed5fd to 0fba15c Compare January 30, 2025 08:27
and breaking the dependency of `b` on `a`. The new nodes isolate the graphs between conditioning points.
"""

view_map = {0: [0]}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs view_map so PyTensor knows not to do inplace operations on this. The other Op already had the view_map defined

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting that you have to use view_map to do that. Somewhat hidden functionality? I thought pytensor only does inplace on things that proactively define a destroy_map.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If I don't say this output returns a view of the input, and this output is not itself a graph output, PyTensor will assume it can be safely destroyed as it is just an intermediate operation.

@codecov
Copy link

codecov bot commented Jan 30, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 92.70%. Comparing base (268e13b) to head (0fba15c).
⚠️ Report is 128 commits behind head on main.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##             main    #7666   +/-   ##
=======================================
  Coverage   92.70%   92.70%           
=======================================
  Files         107      107           
  Lines       18391    18397    +6     
=======================================
+ Hits        17049    17055    +6     
  Misses       1342     1342           
Files with missing lines Coverage Δ
pymc/logprob/abstract.py 94.52% <100.00%> (+0.23%) ⬆️
pymc/logprob/transform_value.py 98.19% <100.00%> (+0.05%) ⬆️
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Member

@jessegrabowski jessegrabowski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, just some questions


def perform(self, node, inputs, out):
raise NotImplementedError("ValuedVar should not be present in the final graph!")
warnings.warn("ValuedVar should not be present in the final graph!")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we be logging instead of warning so people can more easily turn it off?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, I want this to be loud, because it shouldn't be in the final graph.

and breaking the dependency of `b` on `a`. The new nodes isolate the graphs between conditioning points.
"""

view_map = {0: [0]}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting that you have to use view_map to do that. Somewhat hidden functionality? I thought pytensor only does inplace on things that proactively define a destroy_map.

@ricardoV94 ricardoV94 merged commit b0bdeb4 into pymc-devs:main Jul 15, 2025
25 checks passed
@ricardoV94 ricardoV94 deleted the allow_debugging_logp_graphs branch July 15, 2025 13:30
@ricardoV94
Copy link
Member Author

Your messages are coming in weird place so I can't reply.

You are reading it a bit backwards. By default an Op must never return a view or mutate an input in place. If you have an Op that does that, that's the "special case", and you have to tell PyTensor about it. That's the contract.

Otherwise every Op would have to be explicit about view_map, and most times would be view_map={}. That's fine but would be a bit of a pain in the ass to deprecate / refactor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants