Description

You will design, build, and maintain scalable data management systems and ETL/ELT pipelines.

Responsibilities

• Develop and optimize data pipelines using PySpark and Databricks to process large-scale structured and unstructured datasets.
• Manage cloud infrastructure using AWS services for data storage, computation, and orchestration.
• Analyze complex datasets to identify trends in customer behavior, network performance, and churn.
• Build reports and dashboards in Tableau or Power BI to communicate technical findings to stakeholders.
• Implement data quality checks to ensure accuracy and consistency across all platforms.
• Mentor junior engineers and collaborate with product and marketing teams on data-driven solutions.

Required Skills

• 5+ years of experience in data engineering or data analyst roles.
• Expert-level proficiency in Python and SQL.
• Hands-on experience with PySpark for big data processing.
• In-depth knowledge of the Databricks platform.
• Strong experience with AWS services including S3, EC2, Redshift, and EMR.
• Demonstrated expertise in data visualization using Tableau or Power BI.
• Experience working with large-scale data ecosystems.
• Bachelor's or Master's degree in Computer Science, Engineering, Statistics, or a related quantitative field.

Key Skills

Education

Any Graduate