Description

You will design and implement data integration methodologies and scalable data pipelines within the AWS ecosystem.

Responsibilities

• Build and maintain data pipelines using DBT, AWS Glue (PySpark), and Databricks.
• Develop data integration solutions utilizing APIs and microservices.
• Implement data modeling techniques to support various data warehouse and data lake architectures.
• Manage data governance, data management, and data quality processes.
• Apply DevOps and DataOps practices using Git-based platforms.

Required Skills

• Proficiency in Python for data engineering applications.
• Experience with AWS Glue (PySpark based) and Databricks.
• Hands-on experience with DBT and data pipeline orchestration.
• Working knowledge of Snowflake, Amazon Redshift, and Redshift Spectrum.
• Experience with cloud-based SQL and NoSQL databases.
• Practical use of AWS components including S3, Athena, and Lambda.
• Familiarity with data lakes and S3-based architectures.
• Experience with Git-related platforms for DevOps and DataOps.
• AWS certifications.

Preferred Skills

• Experience in a consulting role delivering independent technical solutions.

Key Skills

Education

ANY GRADUATE