Description
You will build and maintain data pipeline architectures to support business and technology stakeholders.
Responsibilities
- Create and maintain optimal data pipeline architecture.
- Extract, transform, and load data from diverse sources using Python and SQL.
- Provide dataset access via REST and Python APIs.
- Categorize, catalog, cleanse, and normalize datasets.
- Communicate technical requirements and data availability to business users.
Required Skills
- 4+ years of experience in data engineering or a related quantitative field.
- Strong Python programming skills.
- Proficiency with data analysis libraries including Pandas, NumPy, and SciPy.
- Hands-on experience with relational SQL database development.
- Experience working in Unix/Linux environments.
- Bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field.
Preferred Skills
- Experience with Java, C++, AWS (EC2, RDS, Athena, Lambda), Snowflake, Kafka, or PostgreSQL.
- Knowledge of Apache HTTP Server, SQL Server, Kerberos, OAuth 2.0, or LDAP.
- Understanding of financial instruments such as credit, fixed income, derivatives, futures, or FX.