Session Details

Big Data for the Small Fry - Bootstrapping from onsite to Cloud by scaling down Netflix's ideas

Regular Session

There’s been a loud drum-beat about how Big Data is changing the world - but if you come from the traditional company, the kind where your main product is something other then data, odds are you've been mostly on the sidelines, trying to figure out if this is real-or-hype, and if its real, how to do you step into it. This presentation is following my company, Samtec (a mid-sized manufacturing company) adventure into the "Big Data" space - specifically because we want to leverage these technologies to level-up our data processing capabilities so ML/AI processing become accessible to our data analysis - people who mostly think in Excel and SQL queries. We were inspired by a Netflix blog post https://medium.com/netflix-techblog/notebook-innovation-591ee3221233 explaining how Jupyter notebooks could become the core/connecting-interface for your "big data" stack - we were also flummoxed by a number of element in their stack that were just-too-big for us (or really anyone but Netflix) but we decided to try and figure it out anyway. This presentation will explain why/how the Netflix solution is compelling and then explain the ways we found to scale-down this framework so it can be used by traditional/small-fry players like us to step into the big-data world.
About

A software development conference in the Louisville, KY area on August 19 - 21, 2020 designed to cover all aspects of software development regardless of development stack.

Keep in Touch