Description

Key Responsibilities Develop, optimize, and maintain complex SQL queries and stored procedures (DB2 focus) Perform data cleanup, transformation, and validation on large datasets Work extensively with DB2 (heavy data environments) and Hive Design and implement batch data processing pipelines Use Apache Spark for scalable data processing and performance optimization Analyze data issues and ensure data quality, consistency, and integrity Collaborate with cross-functional teams for data requirements and delivery Troubleshoot performance issues and optimize ETL/data workflows Required Skills Strong expertise in SQL and Stored Procedures (DB2 mandatory) Hands-on experience with DB2 (large-scale data handling) Working knowledge of Hive and Hadoop ecosystem Experience with Apache Spark (PySpark/Scala preferred) Solid understanding of batch processing frameworks Experience in data cleansing, transformation, and validation Good problem-solving and performance tuning skills Nice to Have Experience with ETL tools (Informatica, DataStage, etc.) Exposure to cloud platforms (AWS/Azure/GCP) Knowledge of data warehousing concepts

Key Skills

Education

Bachelor's degree