Skip to content

How to encode RGB images into spike train #376

@SM1991CODES

Description

@SM1991CODES

Hi,

First - excellent work!! Probably the easiest SNN toolbox to get started with.

The examples show very clearly how to encode a Bx1xHxW input to TxBx1xHxW, where T is the number of time steps.

For delta coding, T=1, is this correct? The floats get converted to 1s and 0s?

However, what happens for a RGB type input?
For delta coding, if my above assumption is correct then the input BxCxHxW should stay BxCxHxW, just with 1s and 0s.
What would happen for other coding strategies?

Example, for rate coding, I would expect, TxBxCxHxW, so each channel get's its own time axis.
Is this correct?

But, assume we have a time series of input images (5 images in sequence) -> Bx5CxHxW
Now each pixel has a time axis (5), so I would not want to add another time axis. How to handle this situation?
Should I just use delta coding in this case?

Best Regards

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions