Description

You will design and manage data processing systems within a cloud environment, focusing on reliable data flows and large-scale processing.

Responsibilities

• Build and maintain ETL/ELT data pipelines on a cloud platform.
• Operationalize data processing systems to ensure reliable data flows.
• Develop automation scripts using Python to support data engineering workflows.
• Implement distributed data processing frameworks to handle large-scale datasets.
• Automate CI/CD pipelines using Jenkins, GIT, or Control-M.

Required Skills

• 5+ years of experience building ETL/ELT data pipelines in a cloud platform.
• 5+ years of experience building and operationalizing data processing systems.
• Advanced Python scripting experience.
• Experience with distributed data processing using Beam, Spark, or MapReduce.
• Cloud platform experience (GCP knowledge strongly preferred).
• Working knowledge of NoSQL databases.
• Experience with data platforms including Data Warehouses, Data Lakes, or ODS.
• Ability to work with Python, R, Scala, Java, Hive, Spark, or Kafka.

Preferred Skills

• 2+ years of experience with NoSQL databases.
• 2+ years of experience with data platform architectures.
• 2+ years of experience with CI/CD automation tools.

Key Skills

Education

Any Graduate