You will lead the architecture and implementation of scalable data pipelines and storage solutions.
Responsibilities
- Design and implement scalable data pipelines and manage data storage solutions like databases and data lakes.
- Collaborate with data scientists and analysts to ensure data availability and quality.
- Enforce data governance, security, and compliance with industry standards.
- Establish and update disaster recovery procedures.
- Mentor junior data engineers and guide technical best practices.
Required Skills
- 5+ years of experience in data engineering.
- Proficiency in Python and SQL.
- Experience with data warehousing solutions such as Snowflake or Google BigQuery.
- Experience with data orchestration tools like Apache Airflow, Databricks Workflows, or Dagster.
- Strong understanding of SQL and NoSQL databases, specifically MySQL and MongoDB.
- Familiarity with cloud platforms including AWS, Google Cloud, or Azure.
- Hands-on experience with Apache Kafka.
- Any Graduate degree.