Loading…
Sydney, Australia
December 12–13, 2019
Click here for more information and registration
Back To Schedule
Thursday, December 12 • 10:30 - 10:55
Running Massively Parallel Deep-learning Inference Pipelines on Kubernetes - Suneeta Mall & Martin Abeleda, Nearmap

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Nearmap captures terabytes of aerial imagery daily. With the introduction of artificial intelligence (AI) capabilities, Nearmap has leveraged Kubernetes to generate AI content based on tens of petabytes of images effectively and efficiently.

This talk covers how using Kubernetes as the backbone of our AI infrastructure, allowed us to build a fully automated deep-learning inferential pipeline that despite not being embarrassingly parallel is actually massively parallel. This talk explains the architecture of this auto-scalable solution that has exhausted all K80 spot GPUs across all US data centres of AWS for weeks. This system has already produced semantic content on over a million km2 area at resolution as high as 5cm/pixel in just 2 weeks. In this talk, you will learn about the joys of building and running this system at scale, challenges encountered, their resolution, & future work.
Speakers
avatar for Martin Abeleda

Martin Abeleda

Graduate Engineer, Nearmap
Martin is mechatronic engineering graduate currently working at Nearmap's Artificial Intelligence division. He has worked on various challenging problems across the Data Science spectrum such as maturing Nearmap's Deep Neural Network training pipeline and monitoring model performance... Read More →
avatar for Suneeta Mall

Suneeta Mall

Senior Data Scientist, Nearmap
Suneeta Mall is a Senior Data Scientist at Nearmap. She is leading the engineering efforts of Artificial Intelligence division at Nearmap. In the past, she has led the efforts of migrating Nearmap's engineering framework to Kubernetes. In her 12 years of software industry experience... Read More →

Offline Inference at Scale KubeSydForum 2019 pdf
Thursday December 12, 2019 10:30 - 10:55 AEDT
Keynote + Advanced Session Hall
  Advanced Sessions, Machine Learning & Data
  • Session Slides Included Yes