Description

Lead data engineering efforts and design scalable cloud data solutions in Bengaluru.

Responsibilities

• Design and implement scalable data solutions using fundamental design principles.
• Build and manage ETL pipelines and automated testing platforms.
• Develop and maintain AWS CI/CD pipelines using CodeBuild, CodeCommit, CodeDeploy, and CodePipeline.
• Write clean, maintainable, and well-commented code and reusable libraries.
• Implement automated testing using PyTest.

Required Skills

• 10+ years of overall professional experience.
• 8+ years in Data Engineering.
• 6+ years of experience with PySpark.
• 5+ years of experience with AWS services, including Glue and Redshift.
• 5+ years of experience with AWS CI/CD tools.
• Strong proficiency in Python, Hadoop, Spark, and PySpark.
• Hands-on experience with AWS S3, EC2, EMR, SNS, Lambda, Step Functions, and EventBridge.
• Proficiency in ETL tools and code versioning tools like Git, SVN, or TFS.

Education

• Bachelor's degree in BE, B.Tech, or MCA.

Key Skills

Education

BE