Tweak learning rate.

rodrigogiraoserrao · rodrigogiraoserrao · commit 4a3f6b0f1e5d · 2021-07-11T18:22:49.000+01:00
diff --git a/examples/teacher_student.py b/examples/teacher_student.py
@@ -52,7 +52,7 @@ def train(net, train_data):
         Layer(16, 16, LeakyReLU()),
         Layer(16, 10, LeakyReLU()),
     ]
-    teacher = NeuralNetwork(layers, CrossEntropyLoss(), 0.001)
+    teacher = NeuralNetwork(layers, CrossEntropyLoss(), 0.01)
 
     test_data = load_data(TEST_FILE, delimiter=",", dtype=int)
     accuracy = test(teacher, test_data)

Original file line number	Diff line number	Diff line change
`@@ -52,7 +52,7 @@ def train(net, train_data):`
`52`	`52`	`Layer(16, 16, LeakyReLU()),`
`53`	`53`	`Layer(16, 10, LeakyReLU()),`
`54`	`54`	`]`
`55`		`- teacher = NeuralNetwork(layers, CrossEntropyLoss(), 0.001)`
	`55`	`+ teacher = NeuralNetwork(layers, CrossEntropyLoss(), 0.01)`
`56`	`56`
`57`	`57`	`test_data = load_data(TEST_FILE, delimiter=",", dtype=int)`
`58`	`58`	`accuracy = test(teacher, test_data)`