Skip to content

[WIP] feat: Weights and Biases #1513

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 19 commits into
base: dev
Choose a base branch
from
+739 −178
Open

[WIP] feat: Weights and Biases #1513

Show file tree
Hide file tree
Changes from 13 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
3f639f8
Test: modify .json file
Ihab-Asaad Nov 23, 2021
a4da2b6
Deleting _log funtion and _validate from nn_trainer.py
Ihab-Asaad Nov 23, 2021
cd142f8
add docstrings to logging_class
Ihab-Asaad Nov 30, 2021
1b9361f
correct data_path in .json file
Ihab-Asaad Nov 30, 2021
be97470
Add WandbLogger
Ihab-Asaad Dec 6, 2021
9b6f71e
Add init
Ihab-Asaad Dec 21, 2021
eaf908d
Add wandb
Ihab-Asaad Dec 22, 2021
968e00d
Testing
Ihab-Asaad Dec 22, 2021
2ce99d8
Testing
Ihab-Asaad Dec 24, 2021
fb5f950
Update logging_class
Ihab-Asaad Jan 5, 2022
6998d06
fix WandB
Ihab-Asaad Jan 6, 2022
de8df4a
Update WandB
Ihab-Asaad Jan 6, 2022
0fde139
Update init in W&B
Ihab-Asaad Jan 7, 2022
95a090c
Create logging directory and place different logger in separate modules
Ihab-Asaad Jan 22, 2022
c3ee83d
Create logging directory and place different loggers in separate mod…
Ihab-Asaad Jan 22, 2022
145c311
make std logger default logging method
Ihab-Asaad Jan 22, 2022
987da10
make std logger the default logging method
Ihab-Asaad Jan 22, 2022
6306c01
Add logging methods to configuration.rst
Ihab-Asaad Jan 23, 2022
27a940b
delete loggers init from nn_trainer.py
Ihab-Asaad Feb 18, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 39 additions & 8 deletions deeppavlov/configs/classifiers/sentiment_twitter.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
"class_name": "basic_classification_reader",
"x": "Twit",
"y": "Class",
"data_path": "{DOWNLOADS_PATH}/sentiment_twitter_data"
"data_path": "{DOWNLOADS_PATH}/sentiment_twitter_data/modified_data"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert changes

},
"dataset_iterator": {
"class_name": "basic_classification_iterator",
Expand Down Expand Up @@ -62,8 +62,8 @@
],
"main": true,
"class_name": "keras_classification_model",
"save_path": "{MODEL_PATH}/model",
"load_path": "{MODEL_PATH}/model",
"save_path": "{MODEL_PATH}/new_model",
"load_path": "",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert changes

"embedding_size": "#my_embedder.dim",
"n_classes": "#classes_vocab.len",
"kernel_sizes_cnn": [
Expand All @@ -74,7 +74,7 @@
"filters_cnn": 256,
"optimizer": "Adam",
"learning_rate": 0.01,
"learning_rate_decay": 0.1,
"learning_rate_decay": 0.01,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert changes

"loss": "binary_crossentropy",
"last_layer_activation": "softmax",
"coef_reg_cnn": 1e-3,
Expand All @@ -100,14 +100,17 @@
]
},
"train": {
"epochs": 100,
"epochs": 10,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert changes

"batch_size": 64,
"metrics": [
"accuracy",
"f1_macro",
{
"name": "roc_auc",
"inputs": ["y_onehot", "y_pred_probas"]
"inputs": [
"y_onehot",
"y_pred_probas"
]
Comment on lines +110 to +113
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"inputs": [
"y_onehot",
"y_pred_probas"
]
"inputs": ["y_onehot", "y_pred_probas"]

}
],
"validation_patience": 5,
Expand All @@ -119,7 +122,31 @@
"valid",
"test"
],
"class_name": "nn_trainer"
"class_name": "nn_trainer",
"logger": [
{
"name": "TensorboardLogger",
"log_dir": "{MODELS_PATH}/sentiment_twitter/Tensorboard_logs"
},
{
"name": "StdLogger"
},
{
"name": "WandbLogger",
"API_Key":"be5cac1976dae2abd87fd045a7a101248c0a0253",
"init":{
"project": "Tuning Hyperparameters",
"group": "Tuning lr & lr_decay",
"job_type":"lr=0.01, lr_decay=0.01",
"config": {
"description": "add any hyperprameter you want to monitor, architecture discription,..",
"learning_rate": 0.02,
"architecture": "CNN",
"dataset": "sentiment_twitter_data"
}
}
}
]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove whole logger section

},
"metadata": {
"variables": {
Expand All @@ -128,6 +155,10 @@
"MODELS_PATH": "{ROOT_PATH}/models",
"MODEL_PATH": "{MODELS_PATH}/classifiers/sentiment_twitter_v6"
},
"requirements": [
"{DEEPPAVLOV_PATH}/requirements/tf.txt",
"{DEEPPAVLOV_PATH}/requirements/fasttext.txt"
],
Comment on lines +158 to +161
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove lines

"download": [
{
"url": "http://files.deeppavlov.ai/datasets/sentiment_twitter_data.tar.gz",
Expand All @@ -143,4 +174,4 @@
}
]
}
}
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
}
}

Loading