Description

You will design and implement software architecture for new data solutions while evaluating multiple technical approaches.

Responsibilities

• Design software architecture and evaluate competing technical solutions through whiteboard sessions and tradeoff analysis.
• Drive the execution of business plans by identifying operational needs and removing performance barriers.
• Lead discussions with business and development teams to align requirements with technical implementation.
• Oversee tasks for junior programmers and provide system troubleshooting support.
• Create technical training documentation and mentor team members.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Hadoop and Spark.
• Strong experience with Scala and PySpark.
• Hands-on expertise with Kafka and streaming technologies.
• Advanced SQL and data warehousing capabilities.
• Experience with Cloud platforms (GCP or Azure).
• Solid understanding of Data Modeling and Airflow.
• Knowledge of CI/CD, Data Structures, and Algorithms.
• Experience with Backend development using Spring.
• Familiarity with BI tools including Looker (Views, Models, Explores, and Looks/Charts).

Key Skills

Education

Any Graduate