You will design, build, and maintain scalable data pipelines and architectures to support data processing, analytics, and business intelligence.
Responsibilities
- Design, implement, and maintain efficient data pipelines to collect, process, and store data.
- Integrate data from internal and external sources to create unified datasets for analytics.
- Build and maintain databases and data warehouses ensuring smooth data flow and accessibility.
- Ensure data consistency, integrity, and quality while optimizing performance for faster data retrieval.
- Automate repetitive data workflows and maintain documentation for all architectures and processes.
Required Skills
- 5+ years of experience in data engineering or a related role.
- Strong proficiency in SQL and Python.
- Experience with ETL Tools and data pipeline frameworks.
- Proficiency with cloud platforms including AWS, Azure, or Google Cloud.
- Familiarity with data warehousing technologies like Redshift, Snowflake, or BigQuery.
- Experience integrating data from various sources for reporting.
- Ability to collaborate with data scientists and analysts on data quality.