fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · hace 9 mesesPandasmander.xyzimagemessage-square40linkfedilinkarrow-up1358arrow-down19
arrow-up1349arrow-down1imagePandasmander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · hace 9 mesesmessage-square40linkfedilink
minus-squareQuizzaciousOtter@lemm.eelinkfedilinkEnglisharrow-up13·hace 9 mesesI really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
minus-squareKausta@lemm.eelinkfedilinkEnglisharrow-up9·hace 9 mesesYeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.
I really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
Yeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.