OEP alert: Apache Kafka vs Redis Streams

Apparently, edX is looking to start using Kafka as an event bus, and is bringing it up for discussion via OEP-52.

I’ve never used it, but Regis says it’s complicated to deploy, defending that Redis Streams are a better fit for pretty much all Open edX users except edx.org. The idea is to try and convince edX that the backend should be abstracted, the decision between the two being left as a deployment detail.

If you have any experience with either (or some other event bus backend), mind pitching into the discussion, particularly here? At the very least, we should probably side with Regis in that we want to keep the deployment story as simple as possible.

1 Like