Description

You will develop and manage data workflows using big data technologies on-site in Owings Mills, MD.

This role is on-site.

Responsibilities

• Design and implement ETL workflows for large-scale data processing.
• Develop data solutions using PySpark and Apache Spark.
• Model data structures to support efficient data pipelines.
• Manage and schedule data workflows using orchestration tools.

Required Skills

• 10+ years of experience in big data and distributed computing.
• Strong hands-on experience with PySpark, Apache Spark, and Python.
• Proficiency in SQL and NoSQL databases, specifically DB2, PostgreSQL, and Snowflake.
• Proven experience with data modeling techniques.
• Hands-on experience with workflow schedulers like Airflow.
• Experience deploying and managing data platforms on AWS.

Preferred Skills

• Experience with additional NoSQL databases beyond those listed.

Key Skills

Education

Any Graduate