Description

You will lead the design, construction, and optimization of scalable data pipelines and infrastructure.

Responsibilities

• Design and build efficient data solutions using Java and Python.
• Optimize data pipelines to ensure accessibility and reliability for business needs.
• Manage data infrastructure using AWS services and orchestration frameworks.
• Implement Infrastructure as Code to manage cloud resources.
• Maintain high standards of technical documentation for all engineering workflows.

Required Skills

• 9+ years of experience as a Data Engineer and Analyst on cloud platforms.
• Proficiency in Java and Python.
• Expertise in Spark and Spark SQL for cluster computing.
• Hands-on experience with AWS services including Lake Formation, Glue ETL, EMR, S3, Glue Catalog, Athena, Kinesis or MSK.
• Experience with orchestration via Airflow or Lambda, Step Functions, and Event Bridge.
• Expertise in data serialization formats such as Parquet, Iceberg, Avro, or JSON.
• Proficiency in Terraform and other IaC services.
• Knowledge of AWS security including IAM, Service roles, Encryption, KMS, and Secrets management.
• Experience with Linux scripting, Jenkins, Git, CI/CD, and Jira.
• Hands-on experience with network configuration, Kubernetes, and container orchestration.

Preferred Skills

• Any Graduate.

Key Skills

Education

Any Graduate