Description

You will design and develop cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.

Responsibilities

• Design and develop scalable data models from scratch for structured and unstructured data.
• Build and manage ETL pipelines and data infrastructure on AWS.
• Optimize large, complex SQL statements and manage relational database configurations.
• Orchestrate clusters and troubleshoot common database issues.
• Plan resource requirements based on high-level technical specifications.

Required Skills

• 5 to 7 years of experience in data engineering and solution design.
• Proficiency in Python, Java, or Scala.
• Strong expertise in SQL and its variations across popular databases.
• Hands-on experience with Spark, Hive, HDFS, and MapReduce (MR).
• Experience with Apache Kafka or AWS Kinesis.
• Experience working within AWS cloud environments.
• Working knowledge of version control tools like Git or Subversion.
• Experience using automated CI/CD build systems.
• Understanding of data structures, algorithms, and ML model deployment.

Preferred Skills

• Experience with TDD/BDD methodologies.

Key Skills

Education

Any Graduate