Save tokens with headroom

Quick post today.

This week I finally solved a problem that I had very often: reaching the quota of my Chat GPT subscription.

So, to solve this I installed a tool called headroom. A context compression tool that works as a proxy between your model provider and you harness.

Model Provider -> Local Headroom instance -> Harness.

This will let the tool to compress some bloat, and reduce the token input and output.


WIP