The Kafka protocol is a disaster. No one wants to use raw TCP and poorly-maintained clients. We want HTTP and the entire ecosystem around it. We should be able to curl Kafka endpoints, and use a modern RPC framework with it. We should get consistent SDKs in every language we care about out of the box. And this should come with no performance penalty.
Enter Protokafka: the definitive Protobuf API for Kafka. Buf decided that this is something the world needs, so it took its decades of Protobuf expertise and just built it.
Protokafka has all of the power of the Kafka API: all of the admin API, and full transaction and EOS support. No compromises, yet so much simpler. Protokafka works using Connect, meaning Protokafka endpoints can be called either using gRPC or simple HTTP/1.1 with JSON.
More Information:
- buf contains the actual Protobuf APIs, also available for perusal at buf.build/bufbuild/protokafka.
- docs contains additional documentation.
- internal/examples contains example usage.
This API is in alpha, and is subject to change.
If you have a question, issue, feature request, or any other feedback about this API, please let us know!
You can:
Offered under the Apache 2 license