Description
You will design and implement data warehousing and data lake solutions on cloud platforms.
Responsibilities
- Design schemas and dimensional data models to support business requirements.
- Build and maintain ETL/ELT pipelines using tools like ADF, Informatica, or Talend.
- Develop data processing logic using PySpark and Spark SQL.
- Implement data warehousing solutions using Azure Synapse, Azure SQL, Redshift, Snowflake, or BigQuery.
- Apply data warehouse best practices and development standards across the lifecycle.
Required Skills
- 5+ years of experience in modern data engineering, data warehousing, or data lakes.
- Proven expertise in SQL and schema design.
- Strong experience with Databricks and Spark.
- Proficiency in PySpark and Spark SQL.
- Hands-on experience with Azure Synapse and Azure SQL.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Ability to work independently to meet project objectives.
- Any Graduate degree.
Preferred Skills
- Knowledge of Power BI, Azure DevOps, and CI/CD deployments.
- Experience with SAP ECC, S/4, and Hana.
- Familiarity with Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, or Cosmos DB.
- Knowledge of cloud migration methodologies.