Add Accept-Encoding

[lbilli]

What about adding compression by default?

The empty string "" instructs libcurl to add an Accept-Encoding: header containing all built-in supported encodings.

[codecov-io]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 92.96%. Comparing base (88a217c) to head (a1461f9).
⚠️ Report is 99 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master      #93      +/-   ##
==========================================
+ Coverage   92.94%   92.96%   +0.01%     
==========================================
  Files           5        5              
  Lines         482      483       +1     
==========================================
+ Hits          448      449       +1     
  Misses         34       34              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[StefanKarpinski]

It seems that setting this option not only affects what libcurl advertises as accepting but has the side effect of actually doing the decoding before the data is passed to the caller. That might be good but it's certainly worth considering whether we want to do that. It may also be a breaking change since callers that are setting the Accept-Encoding header already and expecting encoded data will no longer get encoded data.

[tecosaur]

What if we just checked the headers passed, and only set this to do "automatic decompression" when there is no explicit Accept-Encoding header?