On May 28, 2014 Phillip Cloud, core contributor for the Pandas data analytics Python library, spoke at a joint meetup of the New York Quantitative Python User’s Group (NY QPUG) and the NY Finance PUG. Enthought hosted and about 60 people joined us to listen to Phillip present some of the less-well-known, but really useful features that have come out since Pandas version 0.11 and some that are coming soon. We all learned more about how to take full advantage of the Pandas Python library, and got a better sense of how excited Phillip was to discover Pandas during his graduate work.
After a fairly comprehensive overview of Pandas, Phillip got into the new features. In version 0.11 he covered:
- indexers loc/at, iloc/iat,
- dtypes,
- using numexpr to evaluate arithmetic expressions for large objects, focusing mainly on numexpr. Then in version 0.12 he went into some depth on read_html. In the process he read data from a website and re-created a plot from the website. His examples are valuable as a way to see how an expert uses the Pandas package. He also goes over read_json and others new features as well, again with some really interesting examples.
Phillip covered some experimental features in version 0.13 including query/eval, msgpack IO and Google BigQuery IO. He then wrapped up with a sneak peak at some version 0.14 (soon to be released) features including MultiIndex slicing. His MultiIndex slicing example comes from his work on neuroscience (his cool data collection system is in the figure below).
You can watch his presentation below, and you can get his iPython Notebooks from the talk as well.
The Latest and Greatest Pandas Features (since v 0.11) from NYQPUG.
Related Content
Concurrent Materials Design, Accelerated by AI
The 'acceleration' through Concurrent Materials Design is not incremental; it's transformative.
6 Predictions: How AI Will Transform Scientific R&D In The Next Decade
AI is reshaping every industry, but scientific research and development—drug discovery, materials innovation, specialty chemicals and more—is about to undergo one of the most profound...
Reshaping Materials R&D: Navigating Margin Pressure in the Specialty Chemicals Industry
Since undifferentiated portfolios can no longer deliver required returns for growth, specialty chemical product portfolios and R&D strategies must change.
The Emergence of the AI Co-Scientist
The era of the AI Co-Scientist is here. How is your organization preparing?
Revolutionizing Materials R&D with “AI Supermodels”
Learn how AI Supermodels are allowing for faster, more accurate predictions with far fewer data points.
Understanding Surrogate Models in Scientific R&D
Surrogate models are reshaping R&D by making research faster, more cost-effective, and more sustainable.
R&D Innovation in 2025
As we step into 2025, R&D organizations are bracing for another year of rapid-pace, transformative shifts.
What to Look for in a Technology Partner for R&D
In today’s competitive R&D landscape, selecting the right technology partner is one of the most critical decisions your organization can make.
Digital Transformation vs. Digital Enhancement: A Starting Decision Framework for Technology Initiatives in R&D
Leveraging advanced technology like generative AI through digital transformation (not digital enhancement) is how to get the biggest returns in scientific R&D.
Digital Transformation in Practice
There is much more to digital transformation than technology, and a holistic strategy is crucial for the journey.