Flink On Bolt

[luozenglin]

We believe that implementing Flink control-flow handling in Bolt is costly while delivering minimal benefit. Therefore, we plan to implement only data-stream processing in Bolt, allowing Bolt to focus on compute acceleration.

In our design, both a Flink Operator Chain and a Bolt Operator Chain will coexist, with a one-to-one correspondence between operators in the Flink Operator Chain and those in the Bolt Operator Chain. Operators in the Flink Operator Chain will invoke the corresponding bolt operators to handle control signals and will be responsible for propagating those control signals, while the Bolt Operator Chain is responsible for data computation and data propagation.

For more details, please refer to the design document: https://docs.google.com/document/d/1gNf-9VJEyMw1icEh3UnNsGwoGYuZu3qC3RIChWeS3F4/edit?usp=sharing

[yangzhg]

I suggest we briefly introduce the simple architecture in the discussion.

[zhanglistar]

@luozenglin Great doc. Please give me permission to discuss on the doc.

[zhanglistar]

@luozenglin Good doc, look forward to the code.