Description

Design and maintain large-scale data architectures and processing frameworks.

Responsibilities

• Build and manage batch and real-time data pipelines.
• Design and develop ETL frameworks to support data movement.
• Implement data modeling using cloud-based platforms.
• Develop reusable data sources and dashboards for self-service analytics.
• Write production-grade Python and SQL for data processing and analysis.

Required Skills

• 6+ years of hands-on data engineering experience.
• Expertise with AWS services: S3, Redshift, EMR, Glue, Kinesis, and DynamoDB.
• Proficiency in Python and SQL coding for data processing.
• Experience with data modeling on Redshift, Snowflake, or Databricks.
• Hands-on experience with AWS Athena, Data Lake, and Lakehouse architectures.
• Strong understanding of Big Data processing.
• Ability to work with SQL Server and general SQL coding.

Preferred Skills

• Experience using Databricks for Spark workloads or Snowflake.
• ETL development experience with Informatica, Talend, or Fivetran.
• Knowledge of CI/CD setup and Infrastructure-as-code implementation.

Key Skills

Education

Any Graduate