Skip to content

Commit 220414c

Browse files
committed
fix(data): limit nan validation to required columns
1 parent 7b5ac23 commit 220414c

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

quanttradeai/data/loader.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -371,7 +371,12 @@ def validate_data(self, data_dict: Dict[str, pd.DataFrame]) -> tuple[bool, dict]
371371
nan_ratio_by_column = {
372372
col: float(df[col].isnull().mean()) for col in df.columns
373373
}
374-
max_nan_ratio = max(nan_ratio_by_column.values(), default=0.0)
374+
nan_ratio_required_columns = {
375+
col: nan_ratio_by_column[col]
376+
for col in required_columns
377+
if col in nan_ratio_by_column
378+
}
379+
max_nan_ratio = max(nan_ratio_required_columns.values(), default=0.0)
375380

376381
errors = []
377382
if missing_columns:

0 commit comments

Comments
 (0)