Priyanka is back this week, joining Mark as we talk big data with our guests Prabhu Palanisamy and Jarrett Garcia. Iron Mountain, a data management company, securely stores hard-copy and online data for enterprise customers. SpringML aides enterprises in the use of data analytics and machine learning to transform their projects. With the help of SpringML and Google Cloud, Iron Mountain migrated much of their data to datalakes and cloud storage for easier access and manipulation of the data.
Jarrett and Prabhu talk about the process of migrating so much data, including the main goals of their partnership. First, they established systems that could be repeated and help Iron Mountain understand when data is moved, destroyed, migrated, and more. We discuss the next steps taken, learning how Iron Mountain moved so much data to the cloud. Using Google products like DataFlow, BigQuery, and Cloud Composer, SpringML was able to take the data from Iron Mountain’s landing zone and transform it. Prior planning meant that the system was optimized and ready from the beginning, complete with automation and tools to make a fast, effective migration of data without any restructuring. Later, the data visualization is done by GSuite, Google Data Studio, and Looker so Iron Mountain and their customers can use the data for analysis.
Later in the show, Jarrett describes real-life situations in which Iron Mountain has helped manage, migrate, and store data for customers. Prabhu details the lessons SpringML learned while working on this project and offers advice to other developers. He talks about the future of the project, explaining that now that the data has been migrated, more detailed analytics can be performed and machine learning projects added on to augment Iron Mountain’s offerings.
Jarrett Garcia recently joined Iron Mountain as the Director of Enterprise Data. At Iron Mountain, Jarrett is working closely with the executive leadership team to build a robust Enterprise Data Platform in the cloud. His partnership with Google Cloud is a critical component to the transformation journey. Before coming to Iron Mountain, Jarrett worked as a Lead Architect at Nielsen within their Technology R&D team to create an AI/ML platform in the cloud. Jarrett has been at the forefront in introducing modern technologies into the organization such as Docker, TensorFlow, and Kubernetes. Before that, he lead the Data Science technology team where he spent over a decade building analytic tools and ushering in new technology.
Prabhu Palanisamy is co-founder of SpringML. He has a long history of running data-driven consulting organizations from Software AG to Appirio. Building on relationships he created leading integration and analytics services, Prabhu co-founded SpringML, a next generation data analytics company that serves data intensive industries. Prabhu constantly questions the conventional way of doing things and finds ways to be creative and innovative for customer business problems.
Nick Orlove tells us a bit more about what to think about when optimizing BigQuery: