Selected post
💡 Blosc2 tip: repeated text? use dictionary(): one int32 code per row, one copy of each value.
On 1 Mrow with 100 distinct titles: group_by 22x faster, isin() 5.7x, 5.6x smaller on disk.
blosc.org/python-blosc2/guides/optimization_tips.html#repeated-text-store-it-as-dictionary
Enjoy data 🚀
at://did:plc:uf3ergommn6w3gsyfupv4ytn/app.bsky.feed.post/3mtvf2txb722k
