Description
You will design, develop, and maintain data architectures and infrastructure to support large-scale data processing.
Responsibilities
- Build and maintain data pipelines for ingestion, ETL, and storage.
- Design and develop data models to support analytics and reporting.
- Collaborate with cross-functional teams to translate complex data requirements into efficient technical solutions.
- Monitor, troubleshoot, and improve the performance and reliability of data systems.
- Manage BigQuery usage and implement cost-effective resource scaling.
Required Skills
- 8+ years of experience in data engineering or related technical roles.
- Strong proficiency in SQL and database technologies.
- Hands-on experience with Google Cloud Platform tools including BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, and Bigtable.
- Experience with big data technologies such as Hadoop, Spark, Hive, and Kafka.
- Familiarity with data warehousing and ETL tools including Amazon Redshift, Google BigQuery, or Apache Airflow.
- Knowledge of Airflow and CI/CD pipelines.
- Understanding of data warehousing and data modelling concepts.
- Exposure to data visualization tools like Looker, Power BI, or Tableau.
- Bachelor of Computer Science or equivalent degree.