Future of DataFrames and Data Systems with Wes McKinney (creator of pandas and Apache Arrow)
HTML-код
- Опубликовано: 29 июн 2024
- Wes McKinney, the creator of pandas, Apache Arrow, and Ibis, will discuss the future of dataframes and composable data systems. I (@ChipHuyen) am really excited about this talk, as Wes is both a really thoughtful person and a great engineer!
00:00 Intro
02:13 Presentation on composable data systems
26:05 Out of all the work you've done, what are you most proud of?
27:57 Why pandas became popular
31:43 How to decide which dataframe library to use
34:30 How close are we to a truly unified dataframe API?
36:53 How GPUs will change data engineering interface
40:45 Why CPU performance will hit a wall for data workloads
44:25 Will everything be able to run on a single node?
49:30 Biggest challenges for data engineering
53:50 What skills should data engineers and data scientists learn
Please post your questions on Discord: / discord
RSVP: lu.ma/vkd8h5nu
For more events hosted by Chip in the future: lu.ma/chiphuyen
Very informative session, thanks Wes
Who is the artist on the youtube thumbnail for this video?
Beautiful isn't it😄👏🏽👏🏽