Description
You will build and maintain scalable data pipelines and ETL/ELT workflows to ensure efficient data processing across multiple platforms.
Responsibilities
- Design, build, and maintain scalable and efficient data pipelines.
- Develop ETL/ELT workflows using Python and SQL.
- Manage relational databases including Oracle, PostgreSQL, and SQL Server.
- Perform data modeling, performance tuning, and query optimization.
- Collaborate with analysts and stakeholders to meet data requirements and maintain integrity.
Required Skills
- 8+ years of hands-on experience in data engineering.
- Proficiency in Python for data engineering tasks.
- Strong experience with RDBMS such as Oracle, PostgreSQL, or SQL Server.
- Solid understanding of SQL and complex query performance tuning.
- Experience with ETL tools and frameworks.
- Familiarity with data warehousing concepts and data lakes.
- Any Graduate degree.
Preferred Skills
- Experience with cloud platforms including AWS, GCP, or Azure.
- Knowledge of NoSQL databases like MongoDB or Cassandra.
- Familiarity with Apache Airflow, DBT, or other orchestration tools.
- Exposure to Big Data technologies like Spark, Hive, or Hadoop.
- Knowledge of data security and compliance frameworks.