Description

You will design and develop end-to-end business intelligence solutions using AWS and Databricks.

This role is remote.

Responsibilities

• Build and maintain ETL pipelines, data models, and data warehousing solutions using Databricks and Apache Spark.
• Integrate data from relational databases, APIs, and cloud storage into centralized warehouses.
• Develop interactive dashboards and reports in Power BI to provide actionable insights.
• Implement and configure AWS services like S3 and AWS DMS to support CDC and analytics workloads.
• Monitor and optimize ETL processes, data models, and BI reports for efficiency and scalability.

Required Skills

• 5+ years of experience in data engineering.
• Strong proficiency in SQL, Python, and Apache Spark.
• Hands-on experience with Databricks and Delta Lake for real-time processing.
• Expertise in ETL development and data modeling.
• Proficiency with Power BI for data visualization.
• Experience with AWS services including S3, Lambda, AWS DMS, and API Gateway.
• Experience with Terraform for infrastructure.
• Experience with Azure DevOps for CI/CD pipelines.
• Knowledge of on-prem to AWS data connectivity.

Preferred Skills

• Understanding of machine learning concepts and their application in BI.
• Familiarity with data governance and data quality frameworks.

Key Skills

Education

Any Gradute