Description

Lead the design and implementation of scalable data integration systems and migration projects in Chennai.

Responsibilities

• Develop scalable, fault-tolerant ETL and integration systems meeting security, logging, and alerting requirements.
• Evaluate existing data ecosystems and document platform capabilities.
• Configure CI/CD pipelines and assist with infrastructure setup.
• Manage data migration projects and communicate technical requirements across teams.
• Collaborate with architects and project managers to evaluate data systems and project requirements.

Required Skills

• 7+ years of experience in a Data Engineer role.
• Advanced proficiency in Alteryx Designer.
• Strong experience with relational SQL and NoSQL databases.
• Proficiency in Python, Java, or Scala.
• Experience with AWS services including Lambda, EC2, and AMI.
• Experience with ETL technologies such as Talend, Apache Ni-fi, or AWS Glue.
• Experience with cloud services including EMR, RDS, Redshift, or Snowflake.
• Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field.

Preferred Skills

• Experience with big data tools like Hadoop, Spark, and Kafka.
• Knowledge of workflow management tools such as Airflow, Azkaban, or Luigi.

Key Skills

Education

Bachelor's degree