Description

Design and maintain scalable data pipelines and infrastructure to support business requirements.

Responsibilities

• Design, construct, test, and maintain scalable data management systems.
• Develop and implement ETL processes, data pipelines, and integration workflows.
• Build and optimize data models and schemas for efficient storage and retrieval.
• Ensure data quality, integrity, and security across all pipelines.
• Monitor and optimize the performance of data systems and workflows.

Required Skills

• 5+ years of experience as a Data Engineer or in a similar role.
• Strong programming skills in Python, Java, or Scala.
• Hands-on experience with Hadoop, Spark, and Kafka.
• Proficiency in SQL and database management systems including MySQL, PostgreSQL, or MongoDB.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of data warehousing, data modeling, and ETL development.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with data visualization tools like Tableau or Power BI.
• Familiarity with machine learning concepts and frameworks.
• Knowledge of DevOps practices and tools including Docker and Kubernetes.

Key Skills

Education

Bachelor's degree in Computer Science