Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

My point is that it is still not a magnitude change. And it (probably?) introduces bugs and incompatibilities.

Many cloud providers now offer serverless SQL and Spark capacities (serverless=no set up for you). This is the magnitude change for me.

With pandas you can maybe process 10 million rows, with polars maybe 50 million. But with a distributed service maybe 100 times more?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: