Description

You will build and maintain data processing systems and ETL pipelines using AWS cloud technologies.

Responsibilities

• Build data processing systems using Python, PySpark, and AWS services.
• Develop and manage ETL and ELT workflows.
• Implement data warehousing solutions using Redshift and other RDBMS.
• Deploy infrastructure using CloudFormation or Terraform.
• Monitor system performance and logs using CloudWatch.

Required Skills

• 2+ years of experience in software engineering or data engineering.
• Extensive hands-on experience with Python and PySpark.
• Strong proficiency in SQL and RDBMS (Oracle, MySQL, PostgreSQL, Snowflake).
• Deep knowledge of AWS services including Lambda, Glue, Redshift, S3, and Aurora.
• Experience with streaming data using Kafka or Kinesis.
• Practical experience with ETL/ELT development and Data Warehousing.
• Familiarity with Step Functions and API Gateway.
• Experience with Spark, Hive, and Hadoop/EMR.
• Competency in Infrastructure as Code using Terraform or CloudFormation.

Preferred Skills

• Experience with AWS QuickSight for data visualization.
• Knowledge of GCP or Azure cloud platforms.

Key Skills

Education

Any Graduate