Description

You will develop and maintain data pipelines within a large-scale enterprise data environment.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Databricks (PySpark, Spark SQL, Delta Lake).
• Build and optimize data warehouse solutions, focusing on performance tuning and query optimization.
• Develop interactive dashboards and reports using Power BI, Tableau, or Databricks SQL.
• Implement data lakehouse architecture for integrating structured and unstructured data.
• Ensure data quality, governance, and security across all data assets while collaborating in an Agile setting.

Required Skills

• 10+ years of strong, hands-on experience with Databricks, PySpark, and Spark SQL.
• Proficiency in building reports using Power BI and Tableau, and using Databricks SQL.
• Experience with cloud data platforms (Azure, AWS, or GCP) and data warehousing solutions (Snowflake, Synapse, BigQuery, Redshift).
• Knowledge of Delta Lake, Lakehouse architecture, and data modeling (Star/Snowflake schemas).
• Proficiency in SQL and optimizing large-scale queries.
• Familiarity with CI/CD pipelines, Git, and DevOps practices for data.
• Strong understanding of ETL/ELT processes, data ingestion, and orchestration tools (ADF, Airflow, DBT).
• Excellent problem-solving and communication abilities.

Key Skills

Education

Any Graduate