← Back to jobs
Data Engineer (PySpark, Scala)
Bangalore, Karnataka, India
Posted On: 15+ days ago
Experience: 5+ years
Availability: Hybrid
Openings: 1
Category: Data Engineer
Tenure: No Preference/Any
Related Jobs
No related jobs found
Description
Build and manage data pipelines using PySpark and Scala within an AWS environment.
Responsibilities
- Develop and maintain ETL processes to support data engineering workflows.
- Build and orchestrate data pipelines using Airflow.
- Optimize SQL queries and data structures for efficiency.
- Manage data streaming and processing tasks using Apache Kafka.
Required Skills
- 3+ years of hands-on experience with AWS Cloud.
- 3+ years of expertise in PySpark and Data Engineering.
- Strong proficiency in SQL technologies.
- Experience building and managing ETL pipelines.
- Experience with Airflow for workflow orchestration.
- Proficiency in Python.
- Experience with Hive.
- Experience with Apache Kafka.
Education
Any Graduate
Related Jobs
No related jobs found
Explore More Jobs
Jobs in BangaloreJobs in KarnatakaJobs in IndiaAWS Cloud JobsPySpark JobsData Engineering JobsETL JobsAirflow JobsSQL JobsApache Kafka JobsHive JobsJobs at iitjobsJobs at NuStar TechnologiesData Engineer JobsUnsupervised Learning JobsBlockchain JobsThreat Intelligence JobsBinance Smart Chain JobsChatGPT JobsSmart Contracts JobsNFT JobsBigQuery JobsVertex AI JobsJenkins Jobs
← Back to jobs