Description

You will design and build end-to-end architectures for Data Lakes, Data Warehouses, and Data Marts. You own the full development lifecycle, including coding, testing, debugging, and deployment.

Responsibilities

• Build and maintain end-to-end data architectures for Data Lakes, Data Warehouses, and Data Marts.
• Manage data ingestion, preparation, integration, and operationalization using relational data processing technologies.
• Own the full development lifecycle, including coding, testing, debugging, and deployment.
• Collaborate with teams to prioritize tasks and adapt to evolving data requirements.
• Lead technical projects while contributing as an individual performer.

Required Skills

• 5+ years of experience in data engineering.
• Extensive hands-on experience with PySpark.
• Proficiency in Delta Lake, Spark SQL, and SQL Server.
• Experience with MS SQL and relational data processing.
• Strong knowledge of ETL, Data Warehousing concepts, and methodologies.
• Expertise in Data Modelling, Design, and Architecture.
• Experience with orchestration tools and GitHub.
• Ability to work with both structured and unstructured data.
• Background in Cloud and Data Integration.

Preferred Skills

• Experience in designing end-to-end data integration strategies.

Key Skills

Education

Any Graduate