Description

You will design, build, and deploy data pipelines to support complex business applications and machine learning delivery.

Responsibilities

• Design and implement end-to-end data pipelines using Big Data and cloud technologies.
• Own features from inception through testing and deployment.
• Perform pre and post validation of data, including reconciliation of large datasets across systems.
• Present technical solutions to project teams, management, and client stakeholders.
• Conduct impact analysis regarding system changes or issues.

Required Skills

• Senior-level proficiency with Google Cloud Platform (GCS, Bigtable, BigQuery).
• Strong programming skills in Python and Scala for data pipeline automation.
• Hands-on experience with UNIX shell, Perl, and JavaScript.
• Expertise in Airflow orchestration and preparing DAGs.
• Experience building streaming pipelines using Kafka.
• Practical knowledge of Relational Modeling, Dimensional Modeling, and Unstructured Data modeling.
• Experience with end-to-end implementation of DW BI projects, specifically data warehouse and mart development.
• 4+ years of experience in the software development life cycle and project life cycle activities.
• Bachelor’s Degree in Computer Science, Computer Engineering, or a closely related field.

Preferred Skills

• Container technology experience with Docker and Kubernetes.
• Knowledge of CI/CD tools like Concours or Jenkins and monitoring tools like App Dynamics.

Key Skills

Education

Any Graduate