Skip to content

implement partial_fit #691

@solegalli

Description

@solegalli

not sure it is possible, and it is certainly a major undertaking but:

Is it possible to use something like partial_fit for feature engineering?

So that we can allow feature engineering to deal with incremental training for big dataset.

Transformers should be progressively fit on different chunks of data, and somehow retain that information and be updated with the second chunk. Need to look into how partial fit works in sklearn

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions