You will design, develop, and implement scalable data pipelines and architectures.
Responsibilities
- Design and implement reliable data pipelines and architectures.
- Build and maintain data warehouses and data marts.
- Collaborate with data scientists and analysts to develop data solutions.
- Optimize pipeline performance and efficiency.
- Implement data security and governance measures while monitoring systems for troubleshooting.
Required Skills
- 8+ years of experience in a data engineering role.
- Expertise in SQL and Python.
- Experience with cloud platforms including AWS, Azure, or GCP.
- Hands-on experience with big data technologies like Hadoop, Spark, and Kafka.
- Proficiency with data warehousing tools such as Snowflake, Redshift, or BigQuery.
- Knowledge of data security and governance best practices.
- Strong analytical and problem-solving skills.
Preferred Skills
- Experience with machine learning and deep learning.
- Experience with data visualization tools like Tableau or Power BI.
- Experience with data streaming technologies including Kafka and Flink.