|
| 1 | +C:\Users\thund\Source\Repos\stock-prediction-deep-neural-learning>python stock_prediction_deep_learning.py |
| 2 | +Using TensorFlow backend. |
| 3 | +2020-07-04 11:45:59.136621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll |
| 4 | +[*********************100%***********************] 1 of 1 completed |
| 5 | + Date Close |
| 6 | +0 2004-08-19 49.982655 |
| 7 | +1 2004-08-20 53.952770 |
| 8 | +2 2004-08-23 54.495735 |
| 9 | +3 2004-08-24 52.239193 |
| 10 | +4 2004-08-25 52.802086 |
| 11 | +5 2004-08-26 53.753517 |
| 12 | +6 2004-08-27 52.876804 |
| 13 | +7 2004-08-30 50.814533 |
| 14 | +8 2004-08-31 50.993862 |
| 15 | +9 2004-09-01 49.937820 |
| 16 | +10 2004-09-02 50.565468 |
| 17 | +11 2004-09-03 49.818268 |
| 18 | +12 2004-09-07 50.600338 |
| 19 | +13 2004-09-08 50.958992 |
| 20 | +14 2004-09-09 50.963974 |
| 21 | +15 2004-09-10 52.468334 |
| 22 | +16 2004-09-13 53.549286 |
| 23 | +17 2004-09-14 55.536835 |
| 24 | +18 2004-09-15 55.790882 |
| 25 | +19 2004-09-16 56.772205 |
| 26 | +20 2004-09-17 58.525631 |
| 27 | +21 2004-09-20 59.457142 |
| 28 | +22 2004-09-21 58.699978 |
| 29 | +23 2004-09-22 58.968971 |
| 30 | +24 2004-09-23 60.184414 |
| 31 | +25 2004-09-24 59.691261 |
| 32 | +26 2004-09-27 58.909195 |
| 33 | +27 2004-09-28 63.193138 |
| 34 | +28 2004-09-29 65.295258 |
| 35 | +29 2004-09-30 64.558022 |
| 36 | +... ... ... |
| 37 | +3966 2020-05-21 1402.800049 |
| 38 | +3967 2020-05-22 1410.420044 |
| 39 | +3968 2020-05-26 1417.020020 |
| 40 | +3969 2020-05-27 1417.839966 |
| 41 | +3970 2020-05-28 1416.729980 |
| 42 | +3971 2020-05-29 1428.920044 |
| 43 | +3972 2020-06-01 1431.819946 |
| 44 | +3973 2020-06-02 1439.219971 |
| 45 | +3974 2020-06-03 1436.380005 |
| 46 | +3975 2020-06-04 1412.180054 |
| 47 | +3976 2020-06-05 1438.390015 |
| 48 | +3977 2020-06-08 1446.609985 |
| 49 | +3978 2020-06-09 1456.160034 |
| 50 | +3979 2020-06-10 1465.849976 |
| 51 | +3980 2020-06-11 1403.839966 |
| 52 | +3981 2020-06-12 1413.180054 |
| 53 | +3982 2020-06-15 1419.849976 |
| 54 | +3983 2020-06-16 1442.719971 |
| 55 | +3984 2020-06-17 1451.119995 |
| 56 | +3985 2020-06-18 1435.959961 |
| 57 | +3986 2020-06-19 1431.719971 |
| 58 | +3987 2020-06-22 1451.859985 |
| 59 | +3988 2020-06-23 1464.410034 |
| 60 | +3989 2020-06-24 1431.969971 |
| 61 | +3990 2020-06-25 1441.329956 |
| 62 | +3991 2020-06-26 1359.900024 |
| 63 | +3992 2020-06-29 1394.969971 |
| 64 | +3993 2020-06-30 1413.609985 |
| 65 | +3994 2020-07-01 1438.040039 |
| 66 | +3995 2020-07-02 1464.699951 |
| 67 | + |
| 68 | +[3996 rows x 2 columns] |
| 69 | +plotting Data and Histogram |
| 70 | +mean: [0.39079931] |
| 71 | +max 0.9999999999999999 |
| 72 | +min 0.0 |
| 73 | +Std dev: [0.2458499] |
| 74 | +2020-07-04 11:48:21.138896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll |
| 75 | +2020-07-04 11:48:22.208454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties: |
| 76 | +name: GeForce GTX 960M major: 5 minor: 0 memoryClockRate(GHz): 1.176 |
| 77 | +pciBusID: 0000:01:00.0 |
| 78 | +2020-07-04 11:48:22.223599: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check. |
| 79 | +2020-07-04 11:48:22.238423: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0 |
| 80 | +2020-07-04 11:48:22.246250: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 |
| 81 | +2020-07-04 11:48:22.278976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties: |
| 82 | +name: GeForce GTX 960M major: 5 minor: 0 memoryClockRate(GHz): 1.176 |
| 83 | +pciBusID: 0000:01:00.0 |
| 84 | +2020-07-04 11:48:22.294318: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check. |
| 85 | +2020-07-04 11:48:22.308765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0 |
| 86 | +2020-07-04 11:48:26.174138: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix: |
| 87 | +2020-07-04 11:48:26.182085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165] 0 |
| 88 | +2020-07-04 11:48:26.189684: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0: N |
| 89 | +2020-07-04 11:48:26.198153: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3040 MB memory) -> physical GPU (device: 0, name: GeForce GTX 960M, pci bus id: 0000:01:00.0, compute capability: 5.0) |
| 90 | +Model: "sequential_1" |
| 91 | +_________________________________________________________________ |
| 92 | +Layer (type) Output Shape Param # |
| 93 | +================================================================= |
| 94 | +lstm_1 (LSTM) (None, 60, 100) 40800 |
| 95 | +_________________________________________________________________ |
| 96 | +dropout_1 (Dropout) (None, 60, 100) 0 |
| 97 | +_________________________________________________________________ |
| 98 | +lstm_2 (LSTM) (None, 60, 50) 30200 |
| 99 | +_________________________________________________________________ |
| 100 | +dropout_2 (Dropout) (None, 60, 50) 0 |
| 101 | +_________________________________________________________________ |
| 102 | +lstm_3 (LSTM) (None, 60, 50) 20200 |
| 103 | +_________________________________________________________________ |
| 104 | +dropout_3 (Dropout) (None, 60, 50) 0 |
| 105 | +_________________________________________________________________ |
| 106 | +lstm_4 (LSTM) (None, 50) 20200 |
| 107 | +_________________________________________________________________ |
| 108 | +dropout_4 (Dropout) (None, 50) 0 |
| 109 | +_________________________________________________________________ |
| 110 | +dense_1 (Dense) (None, 1) 51 |
| 111 | +================================================================= |
| 112 | +Total params: 111,451 |
| 113 | +Trainable params: 111,451 |
| 114 | +Non-trainable params: 0 |
| 115 | +_________________________________________________________________ |
| 116 | +Train on 3055 samples, validate on 881 samples |
| 117 | +Epoch 1/100 |
| 118 | +2020-07-04 11:48:37.847380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_100.dll |
| 119 | +3055/3055 [==============================] - 47s 15ms/step - loss: 0.0222 - MSE: 0.0533 - val_loss: 0.0054 - val_MSE: 0.0198 |
| 120 | +Epoch 2/100 |
| 121 | +3055/3055 [==============================] - 43s 14ms/step - loss: 0.0072 - MSE: 0.0156 - val_loss: 0.0050 - val_MSE: 0.0129 |
| 122 | +Epoch 3/100 |
| 123 | +3055/3055 [==============================] - 43s 14ms/step - loss: 0.0060 - MSE: 0.0116 - val_loss: 0.0054 - val_MSE: 0.0104 |
| 124 | +Epoch 4/100 |
| 125 | +3055/3055 [==============================] - 43s 14ms/step - loss: 0.0053 - MSE: 0.0098 - val_loss: 0.0051 - val_MSE: 0.0091 |
| 126 | +Epoch 5/100 |
| 127 | +3055/3055 [==============================] - 43s 14ms/step - loss: 0.0050 - MSE: 0.0087 - val_loss: 0.0048 - val_MSE: 0.0083 |
| 128 | +Epoch 6/100 |
| 129 | +3055/3055 [==============================] - 44s 14ms/step - loss: 0.0045 - MSE: 0.0080 - val_loss: 0.0047 - val_MSE: 0.0076 |
| 130 | +Epoch 7/100 |
| 131 | +3055/3055 [==============================] - 44s 14ms/step - loss: 0.0045 - MSE: 0.0074 - val_loss: 0.0045 - val_MSE: 0.0072 |
| 132 | +Epoch 8/100 |
| 133 | +3055/3055 [==============================] - 44s 14ms/step - loss: 0.0041 - MSE: 0.0070 - val_loss: 0.0045 - val_MSE: 0.0068 |
| 134 | +Epoch 9/100 |
| 135 | +3055/3055 [==============================] - 43s 14ms/step - loss: 0.0038 - MSE: 0.0067 - val_loss: 0.0044 - val_MSE: 0.0065 |
| 136 | +Epoch 10/100 |
| 137 | +3055/3055 [==============================] - 53s 17ms/step - loss: 0.0038 - MSE: 0.0064 - val_loss: 0.0049 - val_MSE: 0.0062 |
| 138 | +Epoch 11/100 |
| 139 | +3055/3055 [==============================] - 67s 22ms/step - loss: 0.0034 - MSE: 0.0061 - val_loss: 0.0041 - val_MSE: 0.0060 |
| 140 | +Epoch 12/100 |
| 141 | +3055/3055 [==============================] - 71s 23ms/step - loss: 0.0035 - MSE: 0.0059 - val_loss: 0.0048 - val_MSE: 0.0058 |
| 142 | +Epoch 13/100 |
| 143 | +3055/3055 [==============================] - 68s 22ms/step - loss: 0.0031 - MSE: 0.0057 - val_loss: 0.0047 - val_MSE: 0.0056 |
| 144 | +Epoch 14/100 |
| 145 | +3055/3055 [==============================] - 64s 21ms/step - loss: 0.0029 - MSE: 0.0055 - val_loss: 0.0038 - val_MSE: 0.0054 |
| 146 | +Epoch 15/100 |
| 147 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0031 - MSE: 0.0054 - val_loss: 0.0036 - val_MSE: 0.0053 |
| 148 | +Epoch 16/100 |
| 149 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0027 - MSE: 0.0052 - val_loss: 0.0047 - val_MSE: 0.0051 |
| 150 | +Epoch 17/100 |
| 151 | +3055/3055 [==============================] - 63s 20ms/step - loss: 0.0028 - MSE: 0.0051 - val_loss: 0.0035 - val_MSE: 0.0050 |
| 152 | +Epoch 18/100 |
| 153 | +3055/3055 [==============================] - 65s 21ms/step - loss: 0.0024 - MSE: 0.0050 - val_loss: 0.0032 - val_MSE: 0.0049 |
| 154 | +Epoch 19/100 |
| 155 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0026 - MSE: 0.0048 - val_loss: 0.0039 - val_MSE: 0.0048 |
| 156 | +Epoch 20/100 |
| 157 | +3055/3055 [==============================] - 63s 20ms/step - loss: 0.0024 - MSE: 0.0047 - val_loss: 0.0048 - val_MSE: 0.0047 |
| 158 | +Epoch 21/100 |
| 159 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0022 - MSE: 0.0046 - val_loss: 0.0031 - val_MSE: 0.0046 |
| 160 | +Epoch 22/100 |
| 161 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0022 - MSE: 0.0045 - val_loss: 0.0030 - val_MSE: 0.0045 |
| 162 | +Epoch 23/100 |
| 163 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0023 - MSE: 0.0044 - val_loss: 0.0032 - val_MSE: 0.0044 |
| 164 | +Epoch 24/100 |
| 165 | +3055/3055 [==============================] - 72s 24ms/step - loss: 0.0021 - MSE: 0.0044 - val_loss: 0.0029 - val_MSE: 0.0043 |
| 166 | +Epoch 25/100 |
| 167 | +3055/3055 [==============================] - 76s 25ms/step - loss: 0.0021 - MSE: 0.0043 - val_loss: 0.0028 - val_MSE: 0.0042 |
| 168 | +Epoch 26/100 |
| 169 | +3055/3055 [==============================] - 86s 28ms/step - loss: 0.0022 - MSE: 0.0042 - val_loss: 0.0042 - val_MSE: 0.0042 |
| 170 | +Epoch 27/100 |
| 171 | +3055/3055 [==============================] - 64s 21ms/step - loss: 0.0021 - MSE: 0.0041 - val_loss: 0.0028 - val_MSE: 0.0041 |
| 172 | +Epoch 28/100 |
| 173 | +3055/3055 [==============================] - 65s 21ms/step - loss: 0.0021 - MSE: 0.0041 - val_loss: 0.0027 - val_MSE: 0.0040 |
| 174 | +Epoch 29/100 |
| 175 | +3055/3055 [==============================] - 67s 22ms/step - loss: 0.0022 - MSE: 0.0040 - val_loss: 0.0026 - val_MSE: 0.0040 |
| 176 | +Epoch 30/100 |
| 177 | +3055/3055 [==============================] - 64s 21ms/step - loss: 0.0020 - MSE: 0.0039 - val_loss: 0.0031 - val_MSE: 0.0039 |
| 178 | +Epoch 31/100 |
| 179 | +3055/3055 [==============================] - 65s 21ms/step - loss: 0.0019 - MSE: 0.0039 - val_loss: 0.0026 - val_MSE: 0.0039 |
| 180 | +Epoch 32/100 |
| 181 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0019 - MSE: 0.0038 - val_loss: 0.0026 - val_MSE: 0.0038 |
| 182 | +Epoch 33/100 |
| 183 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0023 - MSE: 0.0038 - val_loss: 0.0032 - val_MSE: 0.0038 |
| 184 | +Epoch 34/100 |
| 185 | +3055/3055 [==============================] - 67s 22ms/step - loss: 0.0022 - MSE: 0.0037 - val_loss: 0.0026 - val_MSE: 0.0037 |
| 186 | +Epoch 35/100 |
| 187 | +3055/3055 [==============================] - 64s 21ms/step - loss: 0.0021 - MSE: 0.0037 - val_loss: 0.0027 - val_MSE: 0.0037 |
| 188 | +Epoch 36/100 |
| 189 | +3055/3055 [==============================] - 64s 21ms/step - loss: 0.0021 - MSE: 0.0037 - val_loss: 0.0023 - val_MSE: 0.0036 |
| 190 | +Epoch 37/100 |
| 191 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0019 - MSE: 0.0036 - val_loss: 0.0025 - val_MSE: 0.0036 |
| 192 | +Epoch 38/100 |
| 193 | +3055/3055 [==============================] - 65s 21ms/step - loss: 0.0019 - MSE: 0.0036 - val_loss: 0.0022 - val_MSE: 0.0035 |
| 194 | +Epoch 39/100 |
| 195 | +3055/3055 [==============================] - 68s 22ms/step - loss: 0.0022 - MSE: 0.0035 - val_loss: 0.0022 - val_MSE: 0.0035 |
| 196 | +Epoch 40/100 |
| 197 | +3055/3055 [==============================] - 70s 23ms/step - loss: 0.0020 - MSE: 0.0035 - val_loss: 0.0023 - val_MSE: 0.0035 |
| 198 | +Epoch 41/100 |
| 199 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0019 - MSE: 0.0035 - val_loss: 0.0022 - val_MSE: 0.0034 |
| 200 | +Epoch 42/100 |
| 201 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0019 - MSE: 0.0034 - val_loss: 0.0024 - val_MSE: 0.0034 |
| 202 | +Epoch 43/100 |
| 203 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0019 - MSE: 0.0034 - val_loss: 0.0023 - val_MSE: 0.0034 |
| 204 | +Epoch 44/100 |
| 205 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0020 - MSE: 0.0034 - val_loss: 0.0021 - val_MSE: 0.0033 |
| 206 | +Epoch 45/100 |
| 207 | +3055/3055 [==============================] - 66s 22ms/step - loss: 0.0019 - MSE: 0.0033 - val_loss: 0.0020 - val_MSE: 0.0033 |
| 208 | +Epoch 46/100 |
| 209 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0019 - MSE: 0.0033 - val_loss: 0.0022 - val_MSE: 0.0033 |
| 210 | +Epoch 47/100 |
| 211 | +3055/3055 [==============================] - 63s 20ms/step - loss: 0.0020 - MSE: 0.0033 - val_loss: 0.0019 - val_MSE: 0.0033 |
| 212 | +Epoch 48/100 |
| 213 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0018 - MSE: 0.0032 - val_loss: 0.0019 - val_MSE: 0.0032 |
| 214 | +Epoch 49/100 |
| 215 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0019 - MSE: 0.0032 - val_loss: 0.0024 - val_MSE: 0.0032 |
| 216 | +Epoch 50/100 |
| 217 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0019 - MSE: 0.0032 - val_loss: 0.0019 - val_MSE: 0.0032 |
| 218 | +Epoch 51/100 |
| 219 | +3055/3055 [==============================] - 65s 21ms/step - loss: 0.0021 - MSE: 0.0032 - val_loss: 0.0018 - val_MSE: 0.0031 |
| 220 | +Epoch 52/100 |
| 221 | +3055/3055 [==============================] - 67s 22ms/step - loss: 0.0018 - MSE: 0.0031 - val_loss: 0.0018 - val_MSE: 0.0031 |
| 222 | +Epoch 53/100 |
| 223 | +3055/3055 [==============================] - 71s 23ms/step - loss: 0.0021 - MSE: 0.0031 - val_loss: 0.0017 - val_MSE: 0.0031 |
| 224 | +Epoch 54/100 |
| 225 | +3055/3055 [==============================] - 66s 22ms/step - loss: 0.0017 - MSE: 0.0031 - val_loss: 0.0018 - val_MSE: 0.0031 |
| 226 | +Epoch 55/100 |
| 227 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0020 - MSE: 0.0031 - val_loss: 0.0017 - val_MSE: 0.0031 |
| 228 | +Epoch 56/100 |
| 229 | +3055/3055 [==============================] - 66s 22ms/step - loss: 0.0018 - MSE: 0.0030 - val_loss: 0.0018 - val_MSE: 0.0030 |
| 230 | +Epoch 57/100 |
| 231 | +3055/3055 [==============================] - 63s 21ms/step - loss: 0.0018 - MSE: 0.0030 - val_loss: 0.0018 - val_MSE: 0.0030 |
| 232 | +Epoch 58/100 |
| 233 | +3055/3055 [==============================] - 62s 20ms/step - loss: 0.0017 - MSE: 0.0030 - val_loss: 0.0020 - val_MSE: 0.0030 |
| 234 | +Epoch 00058: early stopping |
| 235 | +saving weights |
| 236 | +plotting loss |
| 237 | +plotting MSE |
| 238 | +display the content of the model |
| 239 | +loss : 0.002031383795714456 |
| 240 | +MSE : 0.0029848262201994658 |
| 241 | + |
| 242 | +plotting prediction results |
| 243 | +plotting predictions |
0 commit comments