Description

You will design and maintain the overall solution architecture for the enterprise-scale Data Platform, providing strategic technical leadership on technology choices, performance, and cost.

Responsibilities

• Design and maintain integration architecture across multiple platforms.
• Lead technical investigations and proofs of concept, including hands-on coding for recommendations.
• Enforce best practices in Big Data management, software selection, and architecture implementation.
• Communicate complex technical concepts clearly to both technical and non-technical stakeholders.

Required Skills

• 7+ years of relevant experience with a Bachelor’s Degree.
• 5+ years of software development experience focusing on Big Data technologies.
• 3+ years of experience in distributed data processing and building scalable solutions.
• 3+ years of expertise in database design and data model design.
• Advanced proficiency in Python for data processing and service building.
• Extensive hands-on experience with Apache Spark and Airflow.
• Practical experience with Databricks, Snowflake, Delta Lake, or Apache Iceberg.
• Expertise in designing cloud-based pipelines using AWS services including S3, RDS, EMR, and AWS Glue.
• Strong understanding of CI/CD principles.

Preferred Skills

• Familiarity with Cassandra, Hadoop, Apache Hive, and Jupyter notebooks.
• Experience with BI tools such as Tableau and PowerBI.
• Knowledge of PL/SQL and Oracle GoldenGate.

Key Skills

Education

Bachelor’s Degree