Description
Build and maintain serverless data pipelines and APIs using .NET, AWS Lambda, and Kafka.
This role is on-site.
Responsibilities
- Write production-grade .NET code for AWS Lambda functions, focusing on clean structure, error handling, and logging.
- Design and deploy serverless applications using AWS SAM or CDK, managing concurrency, timeouts, and cold-start optimization.
- Integrate with third-party REST APIs, implementing pagination, rate-limit handling, retry strategies, and secure credential management via AWS Secrets Manager.
- Produce and consume messages on Amazon MSK (Kafka) using AVRO serialization and Schema Registry for contract-first design.
- Design DynamoDB schemas for state persistence, implementing TTL policies, conditional writes for idempotency, and cursor-based tracking.
Required Skills
- 4+ years of production experience with .NET and the AWS Lambda managed runtime.
- Practical experience with AWS Lambda, Step Functions, and deployment via SAM or CDK.
- Strong understanding of AWS CloudWatch Logs and Lambda Insights for monitoring.
- Hands-on experience with Apache Kafka on Amazon MSK, including producer configuration and AVRO serialization.
- Proficiency in AWS DynamoDB schema design, capacity management, and conditional writes.
- Experience consuming REST APIs with robust error handling and authentication.
- Understanding of data pipeline patterns, including idempotency, deduplication, and SQS buffering.
- Strong unit testing discipline and experience with integration testing using mocks or LocalStack.