Skip to content

"Klarna's Brod Kafka client wrapped into GenStages."

License

Notifications You must be signed in to change notification settings

ocerny/kafka_gen_stage

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

KafkaGenStage

Fast GenStages for reading and writting into Apache Kafka. GenStages are built using excelent feature-full Klarna's Brod Kafka client.

Unfortunately both Kafka & GenStage are using consumer/producer naming. Note that what is consumer from Kafka's perspective, is producer from GenStage's.

KafkaGenStage.Consumer (so:producer GenStage) is buffering events as well as demand.

KafkaGenStage.Producer (coming soon) is controlling demand manually, synchronizing GenStage's ask with brod's ack.

Example

{:ok, consumer} = KafkaGenStage.Consumer.start_link(:started_brod_client, "topic_id", read_until: :latest)

About

"Klarna's Brod Kafka client wrapped into GenStages."

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Elixir 100.0%