Overview

Department: IT

Challenge: To modernize the age-old legacy data systems-based scripts and ETL codes into a cloud-based platform with Google BigQuery and Spark Scala.

Solution: Implemented DataSwitch’s DS Migrate No-Code platform to convert complex Teradata and ETL scripts into BigQuery’s equivalent.

Business Outcome:

• Offered end-to-end migration and conversion solutions in less than 3 months.
• Quickened time-to-market and cut the expenses to 5X times lesser than our competition.
• Became the go-to modernization platform of choice for the organization.

Technology Used: 

Legacy Platforms: 

• Informatica
• Teradata

Cloud Platforms:

• Google BigQuery
• Spark Scala
• Apache Airflow
  

A Brief History of the Conglomerate

Our client is an e-commerce and retail giant with the world’s largest selection of products and services. Additionally, the MNC has also forayed into the lucrative app development segment and has left an indelible imprint on the industry.

The Challenge

A Multinational Conglomerate had deployed Legacy systems like Teradata and Informatica for their Data Analytics and Management. With the Legacy data management system, new-age employees found it difficult to follow the complex scripts and codes that were set in place decades ago.

With the world seeing a digital revolution, the IT team of the company saw an enormous opportunity in the cloud.

As a result, the company went on a quest in search of a robust, modern data management solution to migrate their entire data warehouse and ETL solutions into the cloud. It is also to be kept in mind that the model facilitated easy access while at the same time managing the humongous inflow of data.

In their relentless pursuit of choosing the right organization to handle what seems to be a daunting task, after undergoing rigorous evaluations, and understanding that we worked at a much higher efficiency than others, the project fell into the adept hands of DataSwitch.

The Solution

Migrating years of data from the non-scalable Legacy Systems is indeed not a task for the uninitiated. First things first, a dedicated team from DataSwitch took it upon themselves to provide end-to-end responsibility of successful conversion, migration and digital transformation of their database in its entirety. The first big task at hand was to convert scores of Legacy Teradata, Informatica, ETL and BTEQ scripts into BigQuery and Spark Scala.

We devised an innovative and ingenious solution for data modernization and this includes (but is not limited to) a migration strategy for schema, data, and ETL processes.

We leveraged the DS Migrate Process Converter solution to convert the age-old Informatica ETL codes to Spark Scala. And before we knew it, we had converted more than 1,400 codes. Furthermore, with the help of DS Migrate our team of experts devised and simplified the tedious process of converting the complex Teradata scripts.

Ever tried Google Translator wherein you input a sentence in English and get it translated to your preferred language? Well, we devised an automated mechanism, which is quite similar in fashion where when you input a Teradata script, it gets automatically converted into its BigQuery equivalent. Additionally, this process was set in place as a mandate for future conversions, making the job easier for stakeholders in IT and Business Teams.

With our unique method of reverse and forward engineering coupled with automation, we were able to convert over 30,000 scripts into BigQuery. And as all is well that ends well, we created a revolution in finishing the project that could have taken months or even years to complete in a record-breaking time of 3 months. Furthermore, we also channelized the unstructured data by creating data pipelines to further simplify the ease of access of data for the stakeholders.

But our job doesn’t just end with our platform integration. We believe in going beyond our jurisdiction to help out our clients in case of issues. We also provided them with professional services in their preferred language and our dedicated team addressed and resolved the issues on the go.

The Business Outcome:

Since the successful implementation of DS Migrate to easily convert and migrate the organization’s Data warehouse and ETL into the cloud, it would be an understatement to say that the company has breathed a sigh of relief. With the modernized data platform, it also enabled the data to become more structured and facilitated ease of access as and when required instead of searching for a needle in the haystack.

Furthermore, as a value add, our technology also empowered 1,500+ users to utilize our enterprise-grade self-translation platform. All in all, we paved the way for the quickest migration and modernization of data solutions in the industry at a much-reduced cost. It started off as a mere project and DataSwitch went on to become the company’s trusted partner in Legacy Modernization.

The DataSwitch suite of products facilitates delivering bigger and better insights from your data.

Want a Legacy Data Modernization in your organization, too? Let’s talk!