Description

You will design, develop, and maintain data pipelines for structured and unstructured data.

Responsibilities

• Design and maintain ETL/ELT pipelines for structured and unstructured data.
• Write efficient, maintainable code in Python or Java.
• Process large datasets using Apache Spark (preferably Databricks).
• Integrate data from multiple sources, ensuring data quality and consistency.
• Optimize data workflows for performance, scalability, and cost efficiency.

Required Skills

• Strong programming skills in Python and Java.
• Solid understanding of data engineering concepts: ETL/ELT, Data Modeling, and Data Warehousing.
• Hands-on experience with Apache Spark and Databricks.
• Familiarity with SQL and relational databases.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Strong problem-solving skills and attention to detail.

Preferred Skills

• Experience with Airflow.
• Background in big data and distributed systems.

Key Skills

Education

Any Gradute