Description

Design and maintain large-scale data pipelines and lakehouse architectures using Databricks.

This role is remote.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Databricks, PySpark, and Spark SQL.
• Build and optimize data warehouse solutions with a focus on performance tuning and query optimization.
• Develop interactive dashboards and reports using Power BI, Tableau, or Databricks SQL.
• Implement data lakehouse architecture to integrate structured and unstructured data.
• Ensure data quality, governance, and security while collaborating in an Agile setting.

Required Skills

• 10+ years of hands-on experience with Databricks, PySpark, and Spark SQL.
• Proficiency in building reports using Power BI and Tableau, and using Databricks SQL.
• Experience with cloud data platforms (Azure, AWS, or GCP) and data warehousing solutions (Snowflake, Synapse, BigQuery, Redshift).
• Knowledge of Delta Lake, Lakehouse architecture, and data modeling (Star/Snowflake schemas).
• Proficiency in SQL and optimizing large-scale queries.
• Familiarity with CI/CD pipelines, Git, and DevOps practices for data.
• Strong understanding of ETL/ELT processes, data ingestion, and orchestration tools (ADF, Airflow, DBT).

Key Skills

Education

Any Graduate