Apply optimization introduced in #2879 for other aggregations

[fulmicoton]

In #2879, we introduced a performance improvement for cardinality over string in a nested aggregations.

In reality, this optimization is relevant for ANY nested aggregations that require dictionary encoding.
If we have time, this coudl also prompt for a refactoring of aggregations.