Description

You will build and maintain scalable big data solutions within a development team following SRE principles.

This role is on-site.

Responsibilities

• Design, develop, and implement ETL processes for large datasets.
• Perform data analysis and profiling to ensure data quality and integrity.
• Maintain technical documentation and conduct code reviews.
• Collaborate with data scientists, business analysts, and product managers to solve complex business problems.

Required Skills

• 3+ years of experience in big data engineering.
• Strong proficiency in SQL, Hive, and Spark.
• Experience with ETL processes and working with large data sets.
• Proficiency in Unix shell scripting.
• Knowledge of Big Data technologies, Ansible, and Java.
• Understanding of data modeling and data warehousing concepts.
• Ability to work in shifts as required.

Preferred Skills

• Experience with NiFi, PySpark, Pig, or Go.
• Knowledge of distributed computing, the Hadoop ecosystem, and NoSQL databases.
• Experience working on AMEX projects or within the FSS domain.

Key Skills

Education

Any Graduate