Prior to R93, Stream Enrich would unnecessarily crash when the Kinesis stream that Stream Enrich was writing to was resharding and Stream Enrich was itself undergoing auto-scaling.
This issue was solved in R93 by Stream Enrich failing to instantiate the Kinesis sink until the stream had finished resharding. However, R93’s Stream Enrich would unfortunately continue to read raw events and checkpoint those reads, resulting in missing enriched events.
In fact, it is completely fine to write to a stream in the process of resharding (#3452), so this behavior has been corrected in R94, fixing the underlying bug.
There is a comprehensive guide to this issue on Discourse, in case you have been affected by it or would like to discuss it further.
The latest version of Stream Enrich is available from our Bintray here.
Upcoming Snowplow releases will include:
For more details on this release, please check out the release notes on GitHub.
If you have any questions or run into any problem, please visit our Discourse forum.