Multiagent Atari not working with non-DQN based presets

[cpnota]

E.g.:

> all-multiagent-atari pong_v3 ppo ppo
Traceback (most recent call last):
  File "/home/cnota/miniconda3/envs/all/bin/all-multiagent-atari", line 33, in <module>
    sys.exit(load_entry_point('autonomous-learning-library', 'console_scripts', 'all-multiagent-atari')())
  File "/home/cnota/repos/autonomous-learning-library/all/scripts/multiagent_atari.py", line 45, in main
    presets = {
  File "/home/cnota/repos/autonomous-learning-library/all/scripts/multiagent_atari.py", line 46, in <dictcomp>
    agent_id: getattr(atari, agent_type)
  File "/home/cnota/repos/autonomous-learning-library/all/presets/builder.py", line 33, in hyperparameters
    return self._preset_builder(hyperparameters=self._merge_hyperparameters(self._hyperparameters, hyperparameters))
  File "/home/cnota/repos/autonomous-learning-library/all/presets/builder.py", line 54, in _merge_hyperparameters
    raise KeyError("Invalid hyperparameter: {}".format(key))
KeyError: 'Invalid hyperparameter: replay_buffer_size'

Even removing this, other issues emerge.