Description

Independently design, build, and launch data extraction, transformation, and loading processes in production. Identify data requirements for business problems and implement logging to ensure availability. Troubleshoot issues with data infrastructure and resolve them. Build data expertise to leverage controls for privacy, security, compliance, quality, and operational efficiency. Design and launch new data models to support evolving business needs. Support existing production processes and implement optimized solutions with limited guidance in large-scale environments.

Responsibilities

• Design and deploy ETL pipelines for production data extraction, transformation, and loading.
• Implement logging mechanisms to monitor data availability and troubleshoot infrastructure issues.
• Enforce data controls to ensure privacy, security, compliance, quality, and operational efficiency.
• Design and launch new data models to address evolving business requirements.
• Optimize existing production processes and resolve issues in large-scale data environments.

Required Skills

• 5+ years of experience in data engineering or similar roles.
• Proficiency in Python, Scala, SQL, and scripting languages.
• Experience with Big Data platforms including Databricks, EMR, and Hadoop.
• Hands-on experience with SQL database design and ETL tools.
• Experience working with cloud environments such as AWS, GCP, or Azure.
• Technical expertise in data models, data mining, and segmentation techniques.

Key Skills

Education

Any Graduate