Send us your CV
To quickly send us your details, please fill in the form below.
How Software Engineer Associate Renuka transformed a global insurance company's automated data ingestion pipeline.
Renuka helped a global insurance company, who employ 50,000 people across 120 countries, to develop an automated data ingestion pipeline.
Working alongside the Senior Data Engineer, Renuka was tasked with developing a pipeline infrastructure to adapt to the client's newly developed system that utilises Python and Spark, whilst assisting the operations department with data validation from high-net-worth clients.
The client had the following challenges:
With such a large subscriber base, one of the main challenges the client faced was the sheer magnitude of datasets, meaning running scripts would take significant periods of time.
Different stakeholders within the business needed data to make informed decisions, a process that involved manipulating and building large datasets and evaluating and presenting the results to the wider team.
The client wanted to know how they could target their campaigns to the appropriate customers and increase engagements using historical data. This would need to be done by creating machine learning models using extremely large volumes of data.
Renuka worked across multiple departments to provide specialist coding and data transformation skills.
Support the operations department to automate their lengthy data validation procedure which required several iterations of reviews across various teams.
Develop the necessary configuration and Python code to produce load-ready files within seconds to combat the lengthy data validation processes.
Provide critical python skills to a senior engineer from an adjacent department on a time-critical project to write a script to perform specific UI actions.
Renuka reduced the time taken for ingesting complex data, which typically took over a week, to just under a few seconds.
Her Python code skills addressed a skills gap in a different department and helped transform the customer's user experience.
The client's legacy processes, which were in place for seven years, were transferred by Renuka to an environment using Spark and Python, creating an efficient ingestion process across the whole organisation.
"Renuka has not only delivered this work to a high standard but has also built on and improved the existing framework from her knowledge and experience working with Python. She has been instrumental in improving a previously time consuming and laborious process."
Senior Data Engineer
This is Alex & Stephen.
They went from Python developers to data scientists at a major UK telecommunications company.
This is Keasha.
She's been enhancing financial crime analytics capabilities for the world's largest consultancy.
Ready to build great teams? Let's get started.