v1.4.0

What's Changed

• Bump duckdb-engine from 0.6.8 to 0.7.0 by @dependabot in #188
• Bump exceptiongroup from 1.1.0 to 1.1.1 by @dependabot in #202
• Bump pydantic from 1.10.6 to 1.10.7 by @dependabot in #203
• Bump polars from 0.16.14 to 0.16.17 by @dependabot in #209
• Bump faker from 18.3.0 to 18.3.2 by @dependabot in #210
• Bump ipython from 8.11.0 to 8.12.0 by @dependabot in #212
• Bump polars from 0.16.17 to 0.17.7 by @dependabot in #227
• Bump faker from 18.3.2 to 18.4.0 by @dependabot in #218
• Bump black from 23.1.0 to 23.3.0 by @dependabot in #215
• Bump github/super-linter from 4 to 5 by @dependabot in #222
• Bump dependabot/fetch-metadata from 1.3.6 to 1.4.0 by @dependabot in #224
• Bump mkdocstrings from 0.20.0 to 0.21.2 by @dependabot in #217
• Bump mkdocstrings-python from 0.8.3 to 0.9.0 by @dependabot in #213
• Summary Charts by @emeeks in #226
• use Field aliases for summary_types by @shouples in #234
• programmatic DEX updates by @shouples in #235

New Contributors

• @emeeks made their first contribution in #226

Full Changelog: v1.3.0...v1.4.0

v1.3.0

What's Changed

• clean up dependencies by @shouples in #23
• don't interfere with other loggers by @shouples in #24
• disable stringify index values by @shouples in #27
• update display formatter registration to use display IDs by @shouples in #28
• convert filters to pandas/sql query syntax by @shouples in #31
• accept cell_id in comm msg data by @shouples in #32
• fix for nonunique index checking JSON serialization by @shouples in #35
• remove copy/paste snippet after filtering by @shouples in #33
• run workflow on push to main by @shouples in #37
• don't look up display ID if one isn't passed by @shouples in #38
• fix column cleaning and general cleanup by @shouples in #39
• only update dataframe_info with truncated dimensions by @shouples in #40
• remove ndarray from renderable types until more testing can be done by @shouples in #42
• handle conversions from np.nan and pd.NA to None in display formatter payloads by @shouples in #43
• OSS updates and some extra cleanup by @shouples in #34
• Bump JRubics/poetry-publish from 1.12 to 1.13 by @dependabot in #44
• Bump mkdocs-material from 8.5.2 to 8.5.3 by @dependabot in #45
• update for docs by @shouples in #46
• Bump faker from 14.2.0 to 14.2.1 by @dependabot in #50
• performance updates by @shouples in #48
• Bump mkdocs-jupyter from 0.21.0 to 0.22.0 by @dependabot in #53
• use duckdb instead of sqlite by @shouples in #52
• Bump faker from 14.2.1 to 15.0.0 by @dependabot in #54
• Bump mkdocs from 1.3.1 to 1.4.0 by @dependabot in #55
• fix for index not being set during resample by @shouples in #56
• Bump pytest-cov from 3.0.0 to 4.0.0 by @dependabot in #58
• Fixes #51 - handle groupby pd.Series objects with .name & .index.names conflict by @shouples in #57
• Bump dependabot/fetch-metadata from 1.3.3 to 1.3.4 by @dependabot in #60
• Bump mkdocs-material from 8.5.3 to 8.5.6 by @dependabot in #61
• Bump pytest-mock from 3.8.2 to 3.9.0 by @dependabot in #59
• Bump pytest-mock from 3.9.0 to 3.10.0 by @dependabot in #64
• Bump black from 22.8.0 to 22.10.0 by @dependabot in #65
• Dataframe renaming comms listener by @MSeal in #49
• Bump faker from 15.0.0 to 15.1.0 by @dependabot in #68
• Fixes #67 - deconflict index/column names by @shouples in #69
• Closes #47 - updated datatype handling - Decimal, datetime.date, datetime.time by @shouples in #70
• remove sqlalchemy + poetry update by @shouples in #71
• Bump mkdocs from 1.4.0 to 1.4.1 by @dependabot in #72
• Bump pandas from 1.5.0 to 1.5.1 by @dependabot in #74
• Bump mkdocs-material from 8.5.6 to 8.5.7 by @dependabot in #75
• add variable assignment comm by @shouples in #66
• Bump geopandas from 0.11.1 to 0.12.0 by @dependabot in #76
• Bump pytest-benchmark from 3.4.1 to 4.0.0 by @dependabot in #77
• Bump pytest from 7.1.3 to 7.2.0 by @dependabot in #78
• downgrade pydantic dep requirement from ^1.9.1 to ^1.9 by @shouples in #79
• change column sampling method from random to outer by @shouples in #80
• add variable name to metadata by @shouples in #84
• Bump geopandas from 0.12.0 to 0.12.1 by @dependabot in #85
• Bump mkdocs from 1.4.1 to 1.4.2 by @dependabot in #88
• Bump faker from 15.1.1 to 15.1.3 by @dependabot in #89
• Bump ipython from 8.5.0 to 8.6.0 by @dependabot in #86
• Bump dependabot/fetch-metadata from 1.3.4 to 1.3.5 by @dependabot in #91
• update is_default_index logic by @shouples in #92
• remove index=default_index_used so schema fields & data columns match by @shouples in #93
• Bump mkdocs-material from 8.5.7 to 8.5.8 by @dependabot in #95
• Bump faker from 15.1.3 to 15.3.1 by @dependabot in #96
• Bump mkdocs-material from 8.5.8 to 8.5.9 by @dependabot in #97
• Bump nox-poetry from 1.0.1 to 1.0.2 by @dependabot in #98
• Bump mkdocstrings-python from 0.7.1 to 0.8.0 by @dependabot in #99
• Bump mkdocs-material from 8.5.9 to 8.5.10 by @dependabot in #100
• Bump duckdb from 0.5.1 to 0.6.0 by @dependabot in #101
• cast orig_size_bytes/truncated_size_bytes as int instead of np.int64 by @shouples in #103
• Bump faker from 15.3.1 to 15.3.2 by @dependabot in #102
• Bump JRubics/poetry-publish from 1.13 to 1.14 by @dependabot in #104
• Bump JRubics/poetry-publish from 1.14 to 1.15 by @dependabot in #105
• Bump mkdocstrings-python from 0.8.0 to 0.8.2 by @dependabot in #106
• Bump structlog from 22.1.0 to 22.2.0 by @dependabot in #107
• Bump nox from 2022.8.7 to 2022.11.21 by @dependabot in #108
• Bump faker from 15.3.2 to 15.3.3 by @dependabot in #109
• Bump duckdb-engine from 0.6.4 to 0.6.5 by @dependabot in #110
• Bump pandas from 1.5.1 to 1.5.2 by @dependabot in #111
• Bump structlog from 22.2.0 to 22.3.0 by @dependabot in #112
• Bump ipython from 8.6.0 to 8.7.0 by @dependabot in #113
• Bump jupyter-core from 4.11.1 to 4.11.2 by @dependabot in #114
• add exceptiongroup to dependencies by @shouples in #115
• Bump mkdocs-material from 8.5.10 to 8.5.11 by @dependabot in #116
• DEX metadata modeling and tons of documentation by @shouples in #90
• Bump faker from 15.3.3 to 15.3.4 by @dependabot in #117
• Add site_url by @willingc in #119
• Add options to snippets in mkdocs config file by @willingc in #120
• add ALLOW_NOTEABLE_ATTRS setting by @shouples in #122
• add handler for datetime.timezone-aware datetime values by @shouples in #123
• Bump duckdb from 0.6.0 to 0.6.1 by @dependabot in #125
• Use mkdocs-material preferred ci and use pip for docs not poetry by @willingc in #126
• Bump certifi from 2022.9.24 to 2022.12.7 by @dependabot in #128
• remove explicit duckdb dependency by @shouples in #129
• Bump black from 22.10.0 to 22.12.0 by @dependabot in #130
• Bump isort from 5.10.1 to 5.11.1 by @dependabot in #132
• Bump geopandas from 0.12.1 to 0.12.2 by @dependabot in #131
• Update CONTRIBUTING.md by @mattupstate in #133
• fixes for bugs associating display IDs across cells by @shouples in #135
• Bump isort from 5.11.1 to 5.11.2 by @dependabot in #136
• fix for subset handling -> display ID updates by @shouples in #137
• handle duplicate columns by @shouples in #138
• Bump isort from 5.11.2 to 5.11.3 by @dependabot in #141
• Bump duckdb-engine from 0.6.5 to 0.6.6 by @dependabot in #142
• add dedicated uuid4 generator/handler functions by @shouples in #14...

v1.2.0

What's Changed

1.2.0

2022-08-21

Added

• pd.Series as a default renderable type (to go with the existing pd.DataFrame and np.ndarray types)
• Support for the following data types inside pd.DataFrame columns:
  • type and np.dtype
  • shapely.geometry objects
  • pd.Timedelta and datetime.timedelta
  • pd.Period
  • pd.Interval
  • complex numbers
  • ipaddress.IPv4Address and .IPv6Address
• Extra dataset generation functions for development/testing under dx.utils.datatypes
  • dx.quick_random_dataframe(n_rows, n_columns) to get a pd.DataFrame of 0.0-1.0 floats (convenience wrapper for pd.DataFrame(np.random.rand(n_rows, n_columns)))
  • dx.random_dataframe() with different boolean values to enable based on available datatypes (dx.DX_DATATYPES)
• settings_context context manager to allow temporarily changing a setting (or multiple)
• Logging via structlog (default level: logging.WARNING)

Changed

• Default sampling method changed from outer to random

Fixed

• Displaying a dataframe with an out-of-order index (like with .sample()) no longer resets the index before sending data to the frontend.
• Index/column flattening and string-formatting is behind settings and is handled more explicitly
• dx should no longer interfere with other media type / mime bundles (e.g. matplotlib) formatted by the existing IPython display formatted

---

• 1.1.3 updates by @shouples in #19
• fix github workflow for publishing to pypi by @shouples in #15
• display ID registration prep, formatter registration fixes, index updates, dtype handlers, expanded data generators by @shouples in #16

Full Changelog: v1.1.2...v1.2.0

1.1.2

What's Changed

• 1.1.2 dtype hotfix & github workflows by @shouples in #14

Fixed

• outer sampling method no longer alters column dtypes by adding ... placeholder row/column

Full Changelog: v1.1.1...v1.1.2

v1.1.1

What's Changed

Fixes

• settings.SAMPLING_METHOD assignment will no longer resolve as True during dataframe truncating

Adds

• support for pd.NA values
• pre-render dataframe stats sent in the metadata to the frontend

Full Changelog: v1.1.0...v1.1.1

v1.1.0

What's Changed

Added

• Direct support for application/vnd.dataresource+json media type display formatting
• reverting all settings to pandas defaults with dx.reset() or switching to the DISPAY_MODE setting to default
• pydantic dependency for BaseSettings use
  • pandas-inspired dx.set_option(setting_name, setting_value)
  • dx.set_display_mode() convenience function for globally switching between simple (simpleTable/DEX), enhanced (GRID), and default (vanilla pandas)
• Auto-truncating rows and columns of pd.DataFrame objects based on DISPLAY_MAX_ROWS, DISPLAY_MAX_COLUMNS, and MAX_RENDER_SIZE_BYTES (1MB default) size limits before rendering (for simple & enhanced display modes), with blueprintjs flavored warnings
  • SAMPLING_MODE setting to better control how truncating happens ("first", "last", "outer", "inner", and "random" options)
  • RANDOM_SEED setting for random sampling

Fixed

• Support for non-string column and index values (possibly temporary) to allow build_table_schema to work with pd.MultiIndex values

Full Changelog: v1.0.4...v1.1.0

v1.0.4

What's Changed

• update readme; add screenshots by @shouples in #7
• add testing by @shouples in #4
• lower minimum ipython version from 8.2.0 to 7.31.1 by @shouples in #9

Full Changelog: v1.0.3...v1.0.4

v1.0.3

First release! The notes below cover changes from v1.0.0 to v1.0.3, but future release notes will be version-specific.

---

Fixed

• dx.register() (dx.enable(), deprecated) and dx.deregister() (dx.disable(), deprecated) will now update the default display formatting for pandas DataFrame objects as intended
• Updated minimum python version to 3.8 (down from 3.9.6 in 1.0.0)

Added

• Custom IPython formatter for Noteable environments
• Additional data type support for display() / dx():
  • any tabular structure (lists of dicts, dict of {column: [values]}, etc) that can be loaded into a pandas DataFrame
  • .csv and .json file paths

Full Changelog: https://github.com/noteable-io/dx/commits/v1.0.3
PyPI: https://pypi.org/project/dx/1.0.3/