You will design, build, and manage end-to-end data pipelines and warehousing solutions.
Responsibilities
- Build and maintain ETL pipelines to process large datasets.
- Design and implement data models for efficient warehousing.
- Deliver end-to-end data projects independently from conception to production.
- Develop automated data solutions using orchestration tools.
- Manipulate and extract value from complex, large-scale data structures.
Required Skills
- 4+ years of experience in data engineering or a related specialty such as software engineering or business intelligence.
- Proficiency in SQL and at least one programming language including Python, Java, Scala, or NodeJS.
- Experience with data modeling and warehousing architectures.
- Hands-on experience building and delivering end-to-end data projects.
- Bachelor's degree in Computer Science or an equivalent technical field.
- Working knowledge of Python, SQL, Docker, and Shell scripting.
Preferred Skills
- Experience with AWS services including Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, and IAM.
- Practical use of Apache Spark, Apache Airflow, or AWS Step Functions.
- Familiarity with non-relational databases, object storage, or graph databases.
- Experience with infrastructure as code, continuous delivery, and microservices.