2018-07-29 17:06:25 +00:00
|
|
|
# Koff
|
|
|
|
|
|
|
|
Kafka consumer (group) offset tracker.
|
|
|
|
|
|
|
|
### WIP
|
|
|
|
|
|
|
|
Work in progress, there's plenty of stuff left to figure out. You have been
|
|
|
|
warned.
|
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
So far it is only cable of printing parsed messages. For usage eample take a
|
|
|
|
look at the main command.
|
|
|
|
|
|
|
|
```
|
2018-07-30 19:50:16 +00:00
|
|
|
go run cmd/printer/main.go -brokers 127.0.0.1:9092
|
2018-07-29 17:06:25 +00:00
|
|
|
```
|
|
|
|
|
|
|
|
### Design
|
|
|
|
|
|
|
|
Starting with Kafka version 0.9 consumer offsets are stored and managed by the
|
|
|
|
Kafka server. Internally offsets are stored in the `__consumer_offsets` topic.
|
|
|
|
It is not designed to be used by third party software but nothing stops us from
|
|
|
|
doing that really.
|
|
|
|
|
|
|
|
This topic is not only used to store individual consumer offsets, it also
|
|
|
|
contains consumer group metadata: list of group members and their subscriptions
|
|
|
|
and assignments, leader details and plenty of other things. Given that the topic
|
|
|
|
provides realtime updates on consumer offsets and consumer group structure and
|
|
|
|
state, it makes it a very convenient foundation for consumer or group tracking
|
|
|
|
and monitoring.
|
|
|
|
|
|
|
|
### Licence
|
|
|
|
|
|
|
|
MIT
|