Skip to content

feat: added optional multiple metrics#108

Merged
voorhs merged 12 commits intodevfrom
feat/turn-off-multiple-metrics
Jan 31, 2025
Merged

feat: added optional multiple metrics#108
voorhs merged 12 commits intodevfrom
feat/turn-off-multiple-metrics

Conversation

@Darinochka
Copy link
Collaborator

No description provided.

Copy link
Collaborator

@voorhs voorhs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • decision_metric -> target_metric
  • из yaml файла еще же парсится список metrics?

@voorhs voorhs merged commit 23efe32 into dev Jan 31, 2025
21 checks passed
@voorhs voorhs deleted the feat/turn-off-multiple-metrics branch January 31, 2025 06:41
self.node_type = node_type
self.node_info = NODES_INFO[node_type]
self.metric_name = metric
self.decision_metric_name = target_metric
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

А почему у нас тут остался все равно decision_metric_name?

context: Context,
split: Literal["validation", "test"],
) -> dict[str, float | str]:
def score(self, context: Context, split: Literal["validation", "test"], metrics: list[str]) -> dict[str, float]:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Докстринги нигде не обновлены

self.decision_metric_name = target_metric

self.metrics = metrics if metrics is not None else []
if self.decision_metric_name not in self.metrics:
Copy link
Member

@Samoed Samoed Jan 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

А если он не в наших метриках то что происходит?

@Samoed
Copy link
Member

Samoed commented Jan 31, 2025

@voorhs Давай ревертнем? Этот PR не готов

@voorhs
Copy link
Collaborator

voorhs commented Jan 31, 2025

@voorhs Давай ревертнем? Этот PR не готов

А что не так?

@Samoed
Copy link
Member

Samoed commented Jan 31, 2025

Нет док стрингов и валидации названия

@voorhs voorhs mentioned this pull request Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants