Description

You will independently design, build, and launch new data extraction, transformation, and loading processes in production. You will identify the data needed for business problems and implement logging to ensure data availability. You will work with data infrastructure to troubleshoot and resolve issues. You will build data expertise and leverage data controls to ensure privacy, security, compliance, data quality, and operational efficiency. You will design, build, and launch new data models to support evolving business needs. You will support existing processes running in production and implement optimized solutions with limited guidance, working with large-scale data environments.

Responsibilities

• Design and launch new data extraction, transformation, and loading processes in production.
• Implement logging and data controls to ensure privacy, security, compliance, and quality.
• Design and build new data models to support evolving business needs.
• Troubleshoot and resolve data infrastructure issues in collaboration with infrastructure teams.
• Optimize existing production processes within large-scale data environments.

Required Skills

• Minimum 5 years of relevant experience in data engineering or similar roles.
• Proficiency in Python, Scala, SQL, and scripting languages.
• Hands-on experience with Databricks, EMR, and Hadoop.
• Experience with Big Data platforms including AWS, GCP, or Azure.
• Technical expertise with data models, data mining, and segmentation techniques.
• Hands-on experience with SQL database design and ETL tools.

Preferred Skills

• Experience working with limited guidance to implement optimized solutions.

Key Skills

Education

Any Graduate