Add preserve_missing_values parameter to cast_value function #260
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
Adding a preserve_missing_values parameter to the cast_value function so that we can preserve the value saved as a missing value while still properly casting to the type. This is useful for situations where the identifier used for the missing value has important information that needs to preserved in the final data set, but shouldn't get in the way of properly casting the type of the field. For example, n/a might mean that no data was recorded, but another missing_value identifier might mean that the measured amount was below the threshold of the instrument's ability to measure.
This requires changes to dataflows and datapackage_pipelines to make sure it works with the dump_to_path and set_types processors.
Those PRs are here:
frictionlessdata/datapackage-pipelines#175
datahq/dataflows#119
Please preserve this line to notify @roll (lead of this repository)