Monday, October 31, 2016
Wednesday, October 26, 2016
Daily Tag 10/27/2016
-
Apache Kafka and Strom Clojure implementation - Stack Overflow
- As for the documentation, that's the kind of explanation that's only "strait forward" to people who have done it many times...
-
-
Kafka High Level Vs Low level consumer - Stack Overflow
- Low level consumer : I want to have a custom partition data consuming logic, e.g. start reading data from newly created topics without a need of consumer reconnection to brokers.
-
-
FAQ - Apache Kafka - Apache Software Foundation
-
- Use a single-writer per partition and every time you get a network error check the last message in that partition to see if your last write succeeded
- Include a primary key (UUID or something) in the message and deduplicate on the consumer.
- If the consumer is periodically checkpointing its position then if it fails and restarts it will restart from the checkpointed position. Thus if the data output and the checkpoint are not written atomically it will be possible to get duplicates here as well.
-
Subscribe to:
Posts (Atom)