How to convert npy file?

[minminjao]

I wonder how you did it with the configured code when you changed the dataset to npy file. Looking forward to other people's help and advice.

[minminjao]

about this repo 'https://github.com/qiboteam/qibo/tree/master/examples/anomaly_detection'

[alecandido]

It seems pretty clear how the file is being loaded

qibo/examples/anomaly_detection/train.py

Lines 114 to 115 in d10c1e3

	file_dataset = LOCAL_FOLDER / "data" / "standard_data.npy"
	dataset_np = np.load(file_dataset)

It is a NumPy-specific format, but NumPy is used widely enough to be a reasonably assumed dependency in Python code (and somewhat possible to load even beyond Python itself).

I'm possibly missing the question

[minminjao]

I wonder how you changed the csv file, which is a dataset, to the npy file. I'm trying to apply the below dataset here, but it doesn't work.

'https://zenodo.org/records/8202802'
@alecandido

[alecandido]

Converting a CSV file to NumPy format is simple with Python, and the only dependency you need is NumPy itself.

Essentially:

import numpy as np

np.save("ciao.npy", np.loadtxt("ciao.csv"))

However, you do not have to do that. What you need is often an array in memory. If your original dataset is a CSV file, you can also keep it as it is, and just load with np.loadtxt() (or Pandas, or whatever else you prefer).

Just aim for the np.ndarray object :)