Description

You will design, implement, and maintain large-scale data processing systems and real-time pipelines.

Responsibilities

• Design and implement custom ETL frameworks and end-to-end data pipelines.
• Build and manage real-time data processing pipelines using Kafka.
• Perform SQL performance tuning and end-to-end process optimization.
• Execute data quality checks and validation protocols across large datasets.
• Conduct data analysis and visualization to drive technical decisions.

Required Skills

• 5+ years of experience with Python.
• 5+ years of experience in custom ETL design, implementation, and maintenance.
• 5+ years of experience with SQL, MySQL, Elastic Search, Big Query, and database technologies.
• 3+ years of experience working with Big Data technologies and Spark.
• Experience with Kafka, Amazon RDS, Amazon Redshift, and GCP.
• 5+ years of experience in data analysis and visualization using Tableau and Splunk.
• Proven ability to process and manage large-scale datasets.
• Any Graduate degree.

Key Skills

Education

Any Graduate