Skip to content

Conversation

@mrocklin
Copy link
Owner

@mrocklin mrocklin commented Apr 24, 2023

cc @jorisvandenbossche @phofl after our chat while walking the other night I thought I should write up something.

This is a very early draft. It just has some basic thoughts down. It's not near finished. (The thoughts are not laid out in an interesting way yet).

Still though, I thought it would be good to get both of your input. I think that there might be some value is naming a movement here like "Modern Pandas".

Critical feedback / broad ideas welcome

@mrocklin
Copy link
Owner Author

Mostly the message I want to get across eventually is

  • There's a lot of innovation and exciting potential in the python dataframe space right now
  • Pandas is a surprisingly good contender for a lot of that innovation and excitement

My hope is that by bundling together a bunch of related features and giving it a name (like "Modern Pandas") that we can build some excitement around the project.

What I've written here is ok, but not anything special. I think that this topic deserves something special. I'd welcome both of your thoughts on the subject.

Copy link

@phofl phofl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of Modern Pandas we could focus more on the evolution part? Not sure if this would land better.

I like the message that you are delivering. I'd focus a bit more on the downstream libraries part. This is a big part of our ecosystem.

One of the speakers who gave a Polars talk referenced the 10 points from this post: https://wesmckinney.com/blog/apache-arrow-pandas-internals/


## Will Polars and DuckDB replace Pandas?

Polars and DuckDB both provide 10x speedups, the ability to operate
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Haven't played much with DuckDB but 10x is a bit too optimistic for polars

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants