AI Signal 378
condense-json 1.0
Engineers storing large JSON logs—especially from LLM interactions—can use this to cut storage when the same strings recur across records. The library offers reversible compression that trades structural simplicity for space savings, which is practical for SQLite logging or similar persistence layers where duplicated strings are common.
Written by elseif from the cluster below · every claim links back to a sourceThe three things worth knowing
The library replaces recurring strings or substrings with a {"$r": ...} syntax based on a user-provided replacements dictionary, and the operation is reversible via uncondense_json.
Willison uses it specifically to save space in SQLite logs generated by LLM, indicating it addresses a real storage problem in AI tooling workflows.
The 1.0 release marks stability after a year and a half of development, with what Willison calls "sensible and non-disruptive fixes" applied before this milestone.
THE CLUSTER