Mar. 3 2022

[dovahcrow]

What's worked on last week

ConnectorX:

• adding ODBC support in connectorx @Verus121
• Identify the bug in bigquery library usage @Yizhou150
• Website deployment @Wukkkinz-0725
• Switch building and releasing workflow to maturin @wangxiaoying

EDA:

• Add the sorting feature to create_diff_report @devinllu
• Dask upgrade related issue @jinglinpeng
• Get used to create_db_report and resolve column page issue @khoatxp

Clean:

• Add more clean functions to the frontend @yixuy
• Support more clean functions on the backend @qidanrui
• New document and video of clean gui @qidanrui
• Release work @qidanrui

Integrate:

• Comparing Code test with Data quality test
• Investigating how to implement data quality rules based on Dataprep
• Creating the parser from sql_metadata and performed some tests @zshandy

The followings are discussed during the meeting

• Try another release of 0.4.3 and also release to conda after we fall back to python-levenstein.

What's going on this week

ConnectorX:

• ODBC end-to-end benchmark @Verus121
• Resolve the bug in bigquery @Yizhou150
• Work on issue Support client authentication for postgres connector-x#222 @Wukkkinz-0725
• Benchmarking on replacing pandas.read_sql with connectorx in modin and dask @wangxiaoying

EDA:

• Analysis feature similar to sweetviz @devinllu
• Fix full na column error for plot_missing @jinglinpeng
• Fix some create_db_report issue and add table page @khoatxp

Clean:

• Add all clean functions to the frontend Add clean functions in the selection UI #847 @yixuy
• Fix log expression of clean_df on clean GUI fix the log expression of clean df on clean gui #839 @qidanrui
• Investigate the way of precompiling python-crfsuite and Levenstein @qidanrui @yixuy
• Generate synthetic dataset for testing clean functions @qidanrui @yixuy

Integrate:

• Fix small bugs with the parser and create a MIMIC DB for more overall testing @zshandy
  Investigating how to implement data quality rules based on Dataprep