KubeCon 2015 has ended
Back To Schedule
Tuesday, November 10 • 9:50am - 10:10am
Moving to Kubernetes – Tales from SoundCloud

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Like many other companies, SoundCloud migrated to a microservices architecture over the last couple of years. Today, there are several hundreds of services with thousands of container instances running in our datacenters. In this talk, I’ll give a brief overview of the current state of our infrastructure and how a typical service is deployed and can communicate with other services.

To make it simple for teams to prototype, deploy and operate several services on their own, we built our own container runtime environment, called Bazooka. I’ll give an overview of Bazooka, its features and design decisions, but also the shortcomings and problems we faced over time:

  • automated scheduling.
  • resource management for services with different load profiles.
  • monitoring of highly dynamic deploys or the requirements of stateful services.

With the rise of Docker and a general shift towards container-based environments, SoundCloud started to build more and more of its development workflows based on these new solutions. When it became clear that our existing system needed an overhaul to support additional requirements and overcome its shortcomings, we started to look into other container management technologies and available open-source options. In the second part, I’ll present our evaluation process and some of the requirements we defined for a suitable candidate. The attendee will learn which features and properties of Kubernetes make it the ideal choice for us.

Finally, I’ll talk about the current state of our Kubernetes migration, some challenges we need to solve to integrate Kubernetes in our existing infrastructure, and present some open issues we are working on in order to eventually deploy and run all our services with Kubernetes.

avatar for Tobias Schmidt

Tobias Schmidt

Production Engineer, SoundCloud
Tobias is a Production Engineer at SoundCloud and the maintainer of SoundCloud's original container runtime environment. He currently works on SoundCloud's migration to Kubernetes as well as contributing to the Prometheus monitoring project and helping product teams to build reliable... Read More →

Tuesday November 10, 2015 9:50am - 10:10am PST
Palace Hotel - Ralston Ballroom 2 New Montgomery St, San Francisco, CA 94105

Attendees (0)