I loaded a large JSON file in Python and watched memory jump from 43 MB to 808 MB. Here’s what happened and how streaming changed everything.
Our NER pipeline, despite its simplicity in setup, did a pretty good job.
Hands-on with graphify on httpx: a 2,233-node code graph in 2.1 s with zero LLM tokens, and explain at 628 tokens vs 13,659 to read the file.