Description

You will lead the Data Engineering team hands-on, driving technical design decisions for big data solutions.

Responsibilities

• Lead the Data Engineering team on big data initiatives.
• Design and implement ETL processes and data warehousing solutions.
• Manage data lineage and apply Medallion Architecture patterns.
• Execute complex data analysis and manage data migrations.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert proficiency in Databricks, PySpark, and Medallion Architecture.
• Strong command of SQL, including Stored Procedures, Views, and User Defined Functions.
• Demonstrated experience with Azure Cloud services, including ADF, Storage, and Data Lake.
• Proficiency in Python and PySpark for data processing.
• Experience with SQL Server environments.
• Solid understanding of CTEs and data warehousing concepts.
• Experience with Big Data frameworks like Hadoop and Hive.

Preferred Skills

• Experience with Snowflake or Amazon Redshift.
• Familiarity with Scala.

Key Skills

Education

Any Graduate