[email protected]

Rohit Joshi

Rohit Joshi

12 years of experience India

Dedicated and driven engineer with 10+ years of wide-range experience. Rohit is capable of following a complete Software Development lifecycle, and has demonstrated experience in enhancing brand image acceptability and positioning, doing code reviews and implementing industry standard codebase for products. He is solution-oriented and enjoys working on finding the best way to solve problems and answer clients' needs.

Rohit is an excellent mentor who enjoys helping others. He is always working on upgrading his skills and likes sharing knowledge and experiences. Personally, he is passionate about all kinds of indoor and outdoor sports, and loves reading and writing in his free time.

Python Scala Java Big Data Amazon EC2 EMR CI/CD Pipelines Data Engineering

Experience

Cloud Data Architect
May, 2022 - Present
Accenture
  • • Responsible for requirement gathering and converting RFPsto Technical Design and Architecture (High & low level) for data engineering using big data and AWS Cloud services.
    • Currently working on On-Primacies migration and upgrade of applications for a client, Managing a diverse
    team of data engineers across India and US time in an offshore and onshore model.
    • Provided various solutions for On-Primacies to Cloud Migration of existing applications for data lake, data warehouse and ETL design and operations on batch as well as real time data analytics report generation.
    • Performing additional duties such as client engagement, resource management, technical mentorship throughout the
    project lifecycle.
  • Technologies: Python, AWS, Big Data Architecture, Vertica, Scala
Technical Lead
Aug, 2020 - May, 2022
Quick Heal
  • • Designed and developed security product EDR – End Point Detection and Response from scratch.
    • Analysing all the endpoint processes and events and provide threat detection analysis along with preventive alerts on potential threat.
    • Utilising AWS SAAS services and serverless architecture for both UI and Backend modules like Lambda, EC2, Elasticsearch, EMR, CICD for deployment across environments along with Java and Python for programming.
    • Collaborated for all the Deliverables along with mentoring a team of 5 data engineers, troubleshooting, gathering requirement and creating technical design and participate in architecture design of the product.
  • Technologies: Python, Scala, Java, Amazon EC2, Elasticsearch, AWS CloudFormation, AWS Lambda, EMR, CI/CD Pipelines, AWS Kinesis, Spark Streaming, Spark SQL
Senior Technical Specialist
Mar, 2019 - Jul, 2020
Wolters Kluwer India
  • • Worked as Senior Technical Specialist for Big data and Azure cloud related services and technologies.
    • Responsible for Data Engineering role on Tax and Accounting related products with Azure Cloud services and Big Data Hadoop eco system to implement Analytical solutions for product.
    • Analysing returns filed by an individual or organisation over the years with any tax and accounting firm to provide useful insights and analysis in order to increase business use cases and sales of the respective firm, for product used across all the major firms in US and UK to support around 50 million returns in total on average.
    • Used Azure HD Insight services data pipeline for product deployment and for implementation used java along with spark and Hadoop eco system.
  • Technologies: Azure Pipelines, Azure HDInsight, Java, Apache Hive, Big Data, Data Engineering, Data Modeling
Product Manager
Oct, 2017 - Mar, 2019
Nielsen
  • • Worked as Product Manager for Digital Ad Rating product of Nielsen which is built on big data Hadoop Spark • Utilising AWS platform and services.
    • Nielsen is known for highest user of AWS S3 Service to store all its data in a data lake.
    • As a part of Data Engineering team, designing use cases for specific clients, understanding business requirements and also part of implementation of product customisation design and architectural changes.
    • Product uses AWS services for batch and real time analytics to provide insights on data used by data science team for further business use cases.
    • Used AWS EMR, Spark and Big data technologies for product implementation.
    • Implementation of Reporting tools using AWS BI services like quicksight and AWS Athena for generating global level reports for Digital Ad Rating product to be utilize by Data Science team and customers.
  • Technologies: Scala, Python, Java, Amazon EC2, Amazon S3, AWS IAM, AWS CloudWatch, CI/CD Pipelines, Data Engineering, Data Warehousing, Hadoop, Big Data, Spark Streaming, Spark SQL, Product, Business Analysis
System Analyst
Mar, 2017 - Oct, 2017
Atos
  • • As part of center of excellence team working on latest big data analytics track like spark, kafka, AWS and Hbase to provide various business solutions through POC’s.
    • Delivered project for client: Carrefour - a known retail chain in Europe.
    • The project used EMR with kafka to publish everyday store bills a message and after processing it using kafka receive it as a stream in spark to process and keep the extracted information in data lake for further analysis.
  • Technologies: AWS EMR, Kafka, HBase, Java
Senior Associate Consultant
May, 2015 - Mar, 2017
Infosys
  • • Worked as a part of Apple Music team, the data warehouse of apple music stores for all the users and activities being performed on iTunes all data.
    • Used big data Hadoop ecosystem to perform complete analytics on iTunes data which contains user transaction information.
    • Developed various aggregations on content and transaction data of user to provide usage of iTunes application.
    • Data Optimization performance improvement designing scalable application for further business analysis using Hive and Oozie.
    • Built data quality and management framework to ensure the quality of data at the time of enrichment.
  • Technologies: Hadoop, Big Data, Cloudera, Apache Hive, Apache Oozie, Business Analysis
Technical Associate
Mar, 2012 - Apr, 2015
Sears IT and Management Services
  • • As a part of pricing and application team of sears and Kmart, deciding the price of hardline items and Softline items along with updating price on daily basis upon other competitors' prices and analysis (like Amazon, Walmart etc.)
    • Migrated major pricing applications from mainframe system to Hadoop eco system.
    • Created a complete ETL system using on premises Hadoop Eco system.
  • Technologies: Java, Java, JSP, MS SQL Server, Hadoop, Apache Pig, Apache Hive, Apache Oozie, Cloudera, IBM Db2, DataStage, Control-M, SVN

Education

Post Graduate Diploma in Advance Computing
2011 - 2012
CDAC, Pune, Maharashtra, India
Bachelor of Engineering
2008 - 2011
Pune University, India
Diploma in Computer Engineering
2005 - 2008
Maharashtra state board of Technical Education India

Achievements

Accomplishments

Achiever Award - Customer Experience
Dec, 2020
Award given for an outstanding delivery in a very crunch time along with prompt resolutions on technical front to reduce cost and improve performance of EDR product.