Pandas Should Go Extinct eddie.codes ↗

Eddie Atkinson: Pandas slows badly past 10GB, pushing teams to costly tools like Spark when most “big data” is really medium data that fits on one machine. On a billion row benchmark, Pandas took 4m28s and 38GB of memory; DuckDB did it in 5.19s under 2GB.