Description

Skills- Infrastructure as Code (IaC)- Terraform, CI/CD automation, AWS Cloud Infrastructure Provisioning , EKS/Kubernetes administration, AWS services- EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, CloudWatch, Java, Spring boot, microservices Job Description- · Design and manage AWS infrastructure for the IIA Data Lake including S3 storage, Glue data catalog, Athena query engine, and EMR compute clusters. · Manage cross-account connectivity, VPC networking, security groups, and IAM roles/policies to enable secure data flow between IIA, upstream data providers, and downstream consumers. · Build and maintain infrastructure for AI agent runtime environments, including compute resources for Lang Graph agents deployed via Lang Smith Deployments. · Build and maintain CI/CD pipelines for AI agent deployments using GitLab CI/CD, Docker, and Artifactory. · Support and maintain existing ETL pipelines written in Scala/Spark, including troubleshooting, enhancements, and onboarding new data sources. · Ensure production environment stability through monitoring, alerting, and incident response. Maintain SLAs for data pipeline availability and agent uptime. · Strong experience with infrastructure-as-code (Terraform preferred, CloudFormation acceptable) · Experience managing cross-account AWS architectures, VPC peering, Private Link, and transit gateway configurations · Experience with IAM policy design, least-privilege access patterns, and service account management · Experience with containerization (Docker) and container orchestration · Experience with CI/CD pipelines (GitLab CI preferred) · Experience with event-driven architectures and messaging systems (e.g., Kafka, SNS/SQS, Event Bridge) · Proficiency with Linux-based operating systems and shell scripting · Experience with monitoring and alerting tools (CloudWatch, Prometheus, Grafana, or similar) · Understanding of networking fundamentals: DNS, CIDR, NAT, VPC endpoints, firewalls, security group · Demonstrated ability to work across teams and coordinate with external platform owners on connectivity and access requirements · Proficiency in Python (or a comparable general-purpose language) for building automation, tooling, and applications · Solid software engineering fundamentals: Git-based workflows, code review, modular and reusable design, dependency management, and writing maintainable, documented code · Experience writing automated tests (unit/integration) for application and infrastructure code, and integrating those tests into CI/CD · Ability to write integration code against REST APIs and cloud SDKs (e.g., AWS SDK / boto3)

Key Skills

Education

Any Graduate