-
Notifications
You must be signed in to change notification settings - Fork 11
Closed
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed
Description
Stub classes for mixed-curvature attention:
This would entail implementing all of the following:
Reference code:
There is a pre-existing implementation of sectional curvature in the supplemental materials of the pCurve Your Attention OpenReview submission](https://openreview.net/forum?id=AN5uo4ByWH). The relevant implementations are in code/encoders/FPST/networks.py. The class mappings are:
StereographicLayerNorm-->StereographicLayerNormStereographicAttention-->StereographicAttentionLayerStereographicAct--> implemented inManifold.apply()StereographicLinear--> Implemented inKappaGCNLayerwithA=NoneStereographicTransfomer-->StereographicTransformer
Paper:
See Cho et al (2024), Learning Mixed-Curvature Representations in Product Spaces for a description of the method.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is needed