Description

You will architect and implement a scalable data hub on AWS, defining data models, lineage, and quality standards. You will own the design of data ingestion pipelines, governance frameworks, and analytics enablement using Power BI.

This role is remote.

Responsibilities

• Architect scalable data hub solutions on AWS, selecting services like S3, Glue, Redshift, and Athena based on performance requirements.
• Design and build ETL/ELT pipelines to ingest data from databases, APIs, and flat files, implementing cleansing and normalization.
• Establish data access controls, security policies, and governance frameworks using IAM roles and Lake Formation.
• Create data catalogs, metadata systems, and dashboards in Power BI to facilitate data discovery and visualization.
• Monitor pipeline performance and optimize data storage and processing costs within the AWS environment.

Required Skills

• 5+ years of experience in data engineering or architecture.
• Deep expertise with AWS data services: S3, Glue, Redshift, Athena, Lambda, CloudWatch, and EventBridge.
• Proficiency in data modeling, including dimensional and snowflake schemas for data warehousing and lakes.
• Strong programming skills in Python and SQL; PySpark experience is required.
• Experience with ETL/ELT processes, data transformation, and data quality checks.
• Knowledge of data governance best practices, including classification, access control, and lineage tracking.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Experience with Informatica IICS and ICDQ.
• Familiarity with data lakehouse architectures and visualization tools like Tableau.

Referral Bonus: ₹50,000

Key Skills

Education

Bachelor's degree