[roadmap] RL-Insight Q3 Roadmap

[tardis-key]

Online Monitoring of Reasoning Trajectories Based on Uni-Agent

verl-project/verl#7509
Overall design: RFC doc

• New data reporting interface in RL-Insight, aligning sample data format with uni-agent [monitor-api] feat: add direct and async trace span reporting #132
• Grafana-based rendering for trajectory visualization [monitor-config] feat: Agent Loop trajectory nested Repeat static dashboard #135
• Uni-agent data reporting integration [tools, agents] feat: Instrument Uni-Agent with RL-Insight Agent Loop Observability uni-agent#124

Support for Additional RL Frameworks

• Slime framework integration
• AReal framework integration
• ROLL framework integration

Support for service-oriented deployment

• Single-server, multi-client deployment

Experimentation and refinement of online monitoring capabilities

• Docker support
• RL-Insight performance tuning guide
• Multi-hardware metrics collection and dashboards (CPU, NPU, GPU)
• Update and optimize readthedocs [doc] refactor: optim readdocs #146

[ETOgaosion]

Thinking that we can provide a metrics list that we currently supported collection and prepare to support? And then we will be clear that if there are other requirements. And for fully async or agentic scenario, current verl's metrics and timeline may not provide enough insights.

[mengchengTang]

Thinking that we can provide a metrics list that we currently supported collection and prepare to support? And then we will be clear that if there are other requirements. And for fully async or agentic scenario, current verl's metrics and timeline may not provide enough insights.

I will provide a full set of metrics before verl-project/verl#6680 is merged.

[12138flash]

I can take ownership of Grafana-based HTML rendering for trajectory visualization.
My initial analysis and implementation work are documented in #106: #106
I’ll continue advancing this based on that approach and post progress updates in this roadmap issue.

[mengchengTang]

Roadmap update:

Docker support
Single-server, multi-client deployment
RL-Insight performance tuning guide
Multi-hardware metrics collection and dashboards (CPU, NPU, GPU)

[mengchengTang]

Roadmap update:

Update and optimize readthedocs