Description

You will design, build, and optimize data architectures and pipelines for low and high-scale operations.

Responsibilities

• Design and iterate on database schemas using relational models and ER diagrams.
• Build and maintain ETL processes and data pipelines using Python.
• Research and implement data warehousing architectures, providing pros and cons analysis for proposed models.
• Optimize SQL queries and data transformations to ensure efficiency at scale.
• Develop, seed, and manipulate datasets for data exploration and testing.

Required Skills

• 5+ years of experience in data engineering roles.
• Advanced SQL proficiency for complex data manipulation.
• Strong experience with Python for data transformation, including dictionaries, data frames, and data streams.
• Hands-on experience with Azure and MongoDB.
• Deep understanding of ETL processes and relational normal forms.
• Proven ability in Data Warehousing Architecture design.
• Experience managing data at both low and high scales.
• Strong research skills to independently develop and validate working data models.

Preferred Skills

• MS or PhD degree.
• End-to-end understanding of data center operations and applying optimizations through data science.

Key Skills

Education

Any Gradute