Description

You will design and implement enterprise-scale data solutions and transformation pipelines. You translate technical and business requirements into functional implementations, managing data ingestion, transformation, and schema modeling. You build and optimize big data lifecycles to improve system efficiency while applying secure development methodologies and automated QA practices. You operate within Agile frameworks to deliver robust software solutions.

Responsibilities

• Design and manage data ingestion, transformation, and schema modeling processes.
• Build and optimize big data lifecycles to improve system efficiency.
• Translate technical and business requirements into functional technical implementations.
• Apply secure application development methodologies and automated QA practices to data workflows.
• Operate within Agile development methodologies to deliver software solutions.

Required Skills

• 7-8 years of experience delivering enterprise software solutions.
• Proficiency in Spark, Scala, Python, and AWS Cloud technologies.
• 3+ years of experience with Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, and Kafka.
• Strong object-oriented design and analysis skills.
• Experience with data modeling and schema design.
• BS degree in Computer Science, Computer Engineering, or equivalent.

Key Skills

Education

Any Graduate