Skip to content

Add Automated Integration Testing Framework using Python (pytest) #3

@AdityaK-github

Description

@AdityaK-github

Currently, there does not appear to be an automated mechanism to verify that the protocol emulators (Telnet, UPnP, MQTT, CoAP) and the endlessh SSH tarpit correctly trap connections and expose the expected metrics via the Prometheus exporter.

As the framework expands to support additional protocols and handle real-world edge cases, relying solely on manual testing through Docker Compose becomes increasingly error-prone and slows down refactoring efforts.

I propose developing an automated integration testing suite using Python and pytest that would:

  • Spin up emulator services in a controlled environment
  • Simulate client connections to each protocol
  • Verify that connections are correctly trapped
  • Assert that corresponding metrics are exposed via the Prometheus endpoint
  • Optionally integrate into CI (e.g., GitHub Actions) for continuous validation

This would significantly improve the reliability and robustness of the EventHorizon framework and reduce regression risk as new features are added.

If this direction aligns with the project roadmap, I would be happy to draft a more detailed testing plan and begin implementation.

Cheers,
Aditya

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions