Skip to content

[RMP] Add support for ranking models in PyTorch #1044

@marcromeyn

Description

@marcromeyn

Problem:

Goal:

Add support for ranking models in PyTorch.

New Functionality

  • Models
    • Support Ranking Models
  • Systems
    • Make sure torch ranking models can be served

Starting Point:

Implement base-classes of block-API in PyTorch

People: @marcromeyn

Currently the block-API is T4Rec is using a similar design to Keras to allow for modules that lazily initialize their variables. We would like to deprecate this in favor of a native way to achieve the same thing that could launched recently.

Input-blocks

People: @marcromeyn

Output-blocks

People: @edknv & @marcromeyn

Blocks

Models

  • Add DLRM Model models#1171
  • Add DCNModel
  • Export Model with Input / Output Schemas (Serve in Systems Ensemble)
    • Ensure model outputs are compatible with Triton (tensor or NamedTuple instead of dict)

Examples

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions