Skip to content
View pseudo-rnd-thoughts's full-sized avatar
286 followers · 62 following

Organizations

@ray-project @anyscale @Farama-Foundation

Block or report pseudo-rnd-thoughts

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
pseudo-rnd-thoughts/README.md

Hey, I'm Mark 👋

Reinforcement Learning Engineer @ Anyscale | Open Source Maintainer | PhD in Deep Explainable RL

🚀 RL Engineer at Anyscale, working on RLlib to scale reinforcement learning from research to production

🏛️ Led maintainer of Gymnasium & Gym — the standard APIs powering RL research worldwide | Core team @ Farama Foundation

🎓 Completed a PhD in Explainable RL at the University of Southampton in 2025 exploring how to explaining agent's decision-making about their future intentions.

Pinned Loading

  1. Farama-Foundation/Gymnasium Farama-Foundation/Gymnasium Public

    An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

    Python 11.7k 1.3k

  2. temporal-reward-decomposition temporal-reward-decomposition Public

    Implementation of "Explaining an Agent’s Future Beliefs through Temporally Decomposing Future Reward Estimators"

    Python 4

  3. Farama-Foundation/Arcade-Learning-Environment Farama-Foundation/Arcade-Learning-Environment Public

    The Arcade Learning Environment (ALE) -- a platform for AI research.

    C++ 2.4k 465

  4. ray-project/ray ray-project/ray Public

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python 42.2k 7.5k