Custom data not being picked up

[dr1ver1]

Hi,

I'm trying to use my own data for Backtesting. So I've set the following:

from sysdata.config.configdata import Config   
from systems.provided.futures_chapter15.basesystem import futures_system
import matplotlib.pyplot as plt
import pandas as pd

data=csvFuturesSimData(csv_data_paths = dict(csvFuturesMultiplePricesData="private.data.futures.adjusted_prices_csv"))
data=csvFuturesSimData(csv_data_paths = dict(csvFuturesAdjustedPricesData="private.data.futures.multiple_prices_csv"))
data=csvFuturesSimData(csv_data_paths = dict(csvFxPricesData="private.data.spot.barchart"))

However, if I check the following variables immediately after the last line has executed, only one of them, csvFxPricesData, is going to my private folder the other 2 are going to the default folders:

data.db_futures_adjusted_prices_data
csvFuturesAdjustedPricesData accessing data.futures.adjusted_prices_csv
data.db_futures_multiple_prices_data
csvFuturesMultiplePricesData accessing data.futures.multiple_prices_csv
data.db_fx_prices_data
csvFxPricesData accessing private.data.spot.barchart

I assume it is because what is or isn't in the private folders. I'm only working with 5 instruments, and I've populated the 3 relevant folders in my private folder with adjusted prices, multiple prices and spot fx. How can I find out why my private folders for adjusted and multiple prices are being rejected/ignored? Is there additional error reporting I can switch on or is there particular code logic I can review / step through to understand where things are failing?

Debug output:

(.venv) dnix@HomeProd:/data/VSCode/pysystemtrade-me$  cd /data/VSCode/pysystemtrade-me ; /usr/bin/env /data/VSCode/pysystemtrade-me/.venv/bin/python /home/dnix/.vscode/extensions/ms-python.python-2022.4.1/pythonFiles/lib/python/debugpy/launcher 40659 -- /data/VSCode/pysystemtrade-me/private/my_backtest.py 
Private configuration private.private_config.yaml does not exist; no problem if running in sim mode
No key for csvFuturesAdjustedPricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesInstrumentData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFxPricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvRollParametersData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesMultiplePricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesInstrumentData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFxPricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvRollParametersData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesAdjustedPricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesMultiplePricesData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvFuturesInstrumentData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
No key for csvRollParametersData in csv_data_paths, will use defaults (may break in production, should be fine in sim)
Backend TkAgg is interactive backend. Turning interactive mode on.

[TobiasAntiGravity]

This is me with a shot in the dark, having used the mentioned classes little to nothing, but looks to me like you are declaring three different instances using the same variable name - in other words you are writing over the first two data declarations, leaving the last one in memory.

Shouldn't the declaration be;

data=csvFuturesSimData(csv_data_paths = dict(csvFuturesMultiplePricesData="private.data.futures.adjusted_prices_csv",
                                                                            csvFuturesAdjustedPricesData="private.data.futures.multiple_prices_csv",
                                                                            csvFxPricesData="private.data.spot.barchart"))

or something to that effect?

[dr1ver1]

Yep - that was it - thanks! I'm not used to that dict notation