Description

Job Description

1. Data Source Understanding

• Ability to read and interpret source documentation.
• Understand data format structure and access methods.
• Assess feasibility of data ingestion from given sources.

2. API Testing Validation

• Strong understanding of REST APIs GET, POST, authentication methods.
• Hands-on experience with Postman or similar tools.
• Ability to:
  • Test API endpoints.
  • Validate responses against documentation.
  • Handle authentication (API key, OAuth, etc.).
  • Identify issues in API accessibility or data mismatches.

3. SFTP File-Based Sources

• Understanding of SFTP concepts: host, port, credentials.
• Ability to:
  • Connect and access SFTP servers using tools or scripts.
  • Navigate directories and locate required data files.
  • Basic scripting knowledge (Python, Shell) for access testing preferred.

4. Website Manual Source Extraction

• Ability to navigate websites and identify relevant datasets.
• Understand file availability patterns (daily, monthly, etc.).
• Knowledge of:
  • Manual or automated file downloads.
  • Working with formats like CSV, Excel, PDF.

5. Basic Technical Skills

• SQL for data validation and quick checks.
• Basic Python for testing or automation preferred.
• Understanding of data formats: JSON, XML, CSV, Excel, PDF.

6. Analytical Problem-Solving Skills

• Identify gaps or inconsistencies in source documentation.
• Ask relevant clarifications and suggest solutions.
• Evaluate alternative ways to access data when needed.

Good to Have

• Experience in data ingestion, ETL, Data Engineering.
• Exposure to Azure or data pipeline frameworks.
• Awareness of authentication security and data access controls.

Ideal Candidate Profile

• Data Ingestion Analyst / Data Source Analyst.
• Junior Data Engineer (source analysis focused).
• Strong practical exposure to API, SFTP, and file-based sources

Key Skills

Education

Any Graduate