Register for ApacheCon today at apachecon.com. Register by April 17th and save $200.
Building Apache Spark Application Pipelines for the Kubernetes Ecosystem – Michael McCune,
Apache Spark based applications are often comprised of many separate, interconnected components that are a good match for an orchestrated containerized platform like Kubernetes. But with the increased flexibility afforded by these technologies comes a new set challenges for building rich data-centric applications.
In this presentation we will discuss techniques for building multi-component Apache Spark based applications that can be easily deployed and managed on a Kubernetes infrastructure. Building on experiences learned while developing and deploying cloud native applications on an OpenShift platform, we will explore common issues that arise during the engineering process and demonstrate workflows for easing the maintenance factors associated with complex installations.
How to Manage a Nearly One Million SLOCs Project – Emmanuel Lecharny
Working on an open source project is certainly not easy, especially when it starts to be big. Past the excitement of the beginning, how do we make it going on in the long run ?
What about a project that grows bigger and bigger, up to a point we are facing hundred of thousands of single lines of code ? What about testing it across multiple platforms ? What about the toollings that are needed – debugging, data migration, etc – ? What about the documentation ?
This talk is about the few simple rules that make it easier, and successful. It also exposes a few traps that are not so easy to avoid, and how to keep people involved in the long run.
More critical, it will explain how to conduct the project so that it’s still relevant after 10 years, in a moving industry.
Keynote: Training Our Team in the Apache Way – Alan Gates
Hortonworks contributes to a number of Apache projects. When we started we depended on our many experienced Apache community members to train their fellow Hortonworkers in the Apache Way. But we grew quickly, and we found this started to break down. So we have instituted training for our teams in what Apache is, how it works, their responsibilities as part of Apache and how that meshes with their responsibilities as Hortonworkers, and a practical list of dos and don’t. This talk will share some thoughts on the need for this training, give an overview of the content, and review some early results.