Yogesh Jagtap

8 years of experience India

Dynamic Team Lead Data Engineer with a proven track record of driving results through innovative solutions. Skilled in leading teams to success
and developing cutting-edge data strategies. Passionate about leveraging data to make informed decisions and drive business growth. Excited
about the opportunity to contribute to a company that shares my vision for harnessing the power of data to achieve strategic goals.

Python Scala AWS Big Data MongoDB PySpark Apache Cassandra GCP

Experience

Team Lead

May, 2023 - Present

NucleusTeq

Working on migrating mainframe into big data technology using pyspark Get data from multiple tables and cache to identify accurate
transactions Based on other factors to get rewards to register card members Designed and optimised data pipelines to efficiently process and
analyze customer spending patterns Collaborated with cross-functional teams to integrate Big Data solutions seamlessly into existing credit card
systems
•
•
•
•
•
•
•
Processed vast datasets, integrating {several TBs} of data across card member profiles, merchant databases, and offers.
Optimised on-premise clusters for handling {TBs of transactional data} without detailing the efficiency achieved.
Improved Spark performance by {15%} by developing partitioning strategies, memory management, and query optimisation.
Boosted rewards allocation accuracy by {20%} using distributed computing to identify transaction periods affected.
Enhanced data integrity by implementing a process via Spark SQL to nullify {thousands of duplicate transaction entries}.
Managed on-premise clusters, ensuring {99.9%} availability and scalability for {large data volume} processing.
Automated complex data workflows by establishing an event-driven job scheduling system capable of handling {multiple tasks}
Technologies: Scala, Python, AWS, PySpark

Senior Software Engineer

Mar, 2018 - Aug, 2019

Vigour Soft

- Worked with the development team to implement Spark Graph-X library.
- Worked on data pipeline in an AWS environment.
- Worked on large scale data pipeline flows.
Technologies: Scala, Python, Apache Cassandra, AWS

Senior Software Developer

Apr, 2016 - Mar, 2018

MuGenesys

- Built text parsing algorithms using GATE library.
- Architected and implemented Sentiment analytic (emotion, polarity, custom and visualization using Natural Language Processing - NLP).
- Implemented Chat bot using Api.ai.
Technologies: Scala, Framework Design, MongoDB

Senior Software Developer

Aug, 2013 - Aug, 2016

CloudInsights Pvt Ltd

- Planned, coordinated and conducted multiple complex software engineering activities.
- Designed the database structure.
- Worked on software development and writing unit tests.
- Responsible for systems integration and testing.
Technologies: Scala, Framework Design, MongoDB, AWS

Software Developer

Feb, 2012 - Aug, 2013

Innoplexus Pvt Ltd

- Created sophisticated, imaginative, and efficient back-end solutions for a large-scale, discussion forum.
- Designed reusable components by utilizing various standard frameworks.
Technologies: Scala, MongoDB, JavaScript

Education

MCA

2007 - 2010

University of Pune

Bachelor of computer science

2004 - 2007

University of Pune