At Snowplow we have been working with Kinesis since its first announcement, and we were keen to organize a Kinesis-centric meetup for the tech community here in London and the South-East. And it looks like our excitement about Kinesis is widely shared - there were almost 40 “Kinetics” attending the first meetup. Huge thanks to Just Eat for hosting all of us in their offices and keeping us all fed with pizza and beer!
More on the talks after the jump:
There were two talks at the event:
- Ian Meyers, Solutions Architect at AWS, gave an excellent introduction to Amazon Kinesis. Ian took us through the main envisaged use cases, the key technical concepts and some example application architectures, before fielding a great set of questions
- I gave a talk on “Snowplow and Kinesis”. I briefly introduced Snowplow, explained why we were excited about Kinesis (drawing on my “three eras” blog post) and then set out how we are updating Snowplow to run on Kinesis. I concluded with a live demo of what we have running on Kinesis so far
It was particularly encouraging to see so many great questions asked by the participants - there was clearly a ton of stream processing and message queue expertise in the room! It was also great to chat to people already trialling Kinesis.
The slides I presented are below:
The live demo gave a sneak peak at the two new Kinesis-based Snowplow components coming in version 0.9.0:
- The new Scala Stream Collector - running on my laptop, receiving Snowplow raw events over HTTP and putting them to a Kinesis raw events stream
- The new Scala Kinesis Enrich - running on an EC2 box, receiving Snowplow raw events from Kinesis and putting them to a Snowplow enriched events stream
I’m afraid that I don’t (yet!) have a way of recreating or sharing the live demo - this is something we will hopefully come back to following the 0.9.0 release.
It was a great evening - and hopefully the first of many as the Kinesis community takes shape here in the UK! A big thank you to Peter Mounce and the Just Eat Engineering team for being such excellent hosts, and a warm thanks for Ian Meyers for giving us the inside track on Amazon Kinesis!