Description

You will own the design and implementation of scalable data architectures and high-performance pipelines for analytics and data science initiatives.

Responsibilities

• Design scalable data architectures and build optimized pipelines to process large datasets from diverse sources.
• Manage and optimize cloud data services on AWS, GCP, or Azure to ensure scalability and cost-effectiveness.
• Implement data quality standards to ensure accuracy, consistency, and completeness across all datasets.
• Monitor and optimize data processing workflows and database performance.
• Mentor junior data engineers and drive best practices in data engineering and architecture.

Required Skills

• 10+ years of experience as a Data Engineer or Architect.
• Bachelor’s degree in Computer Science, Information Technology, or equivalent experience.
• Proficiency in Python, Java, or Scala.
• Experience with structured and unstructured data, including relational databases, NoSQL, data lakes, and distributed storage.
• Mandatory experience with AWS data services; familiarity with GCP or Azure is preferred.
• Expertise with source formats including XML, HTML, XSLT, Unicode, DTDs, XML Schema, XQuery, XPath, PDF, and TIFF.
• Strong knowledge of data modeling and data governance concepts.

Preferred Skills

• Experience with data streaming technologies such as Kafka or Spark Streaming.
• Experience with data warehousing and ETL/ELT tools including Snowflake, Redshift, or Databricks.
• Familiarity with machine learning algorithms, data visualization tools, and intellectual property (IP) concepts.

Key Skills

Education

Bachelor’s degree in computer science, Information Technology