RLE or LZ4 compression for satellite and cross-region TLogs?

I’m using a 2 region strategy in AWS with secondary region and satellite TLogs in separate AZs. Cross AZ traffic in AWS is stupid expensive. I think lightweight compression like RLE or LZ4 would cut network costs by 70%+ if the current protocol doesn’t do any compression already. I can understand why this wasn’t originally implemented as it may add latency, but with advances in CPUs it might not be noticeable.

Is this something worth my energy to prototype, or has it been tried and rejected in the past, or is the current TCP protocol already compressed? Or is it likely too difficult for someone to touch as their first time in the codebase?

1 Like