Lead AWS Data Platform Engineer

Job Description

Job Description

Position: Lead AWS Data Platform Engineer

Location: Boston, MA (100% Onsite) – Local Candidates Highly Preferred.

Description:

1. The Data Platform Engineering team supports CI/CD and infrastructure for our integrated Data Fabric platform. This Data Fabric is a strategic core asset underpinning the operational success of our Firm.
2. The Data Platform Engineer will design and implement efficient procedures and pipelines for software development and infrastructure deployment, manage and deploy various key data systems and services.
3. The Data Platform Engineer will work with cloud engineers, data engineers, system administrators, data administrators and architects to find opportunities to leverage DevOps technologies to process large volumes of data.
4. The Data Platform Engineer will implement CI/CD workflows for Infrastructure as Code (IaC) and automated deployments. This role requires a motivated individual with strong technical ability, data capability, excellent communication, and collaboration skills including the ability to develop and troubleshoot a diverse range of problems.

Responsibilities

1. Implement continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline) for data infrastructure using Terraform and GitHub Actions.
2. Implement and deploy GitHub Actions tools and workflows.
3. Implement various development, testing, automation, and data infrastructure tools

QUALIFICATIONS

1. Bachelor’s degree in computer science or engineering
2. Minimum of 10 years of experience in DevOps engineering
3. Git version control
4. Minimum of 5 years of experience with GitHub Actions
5. Minimum of 5 years of experience with Terraform
6. Minimum of 5 years of AWS Cloud experience that includes: Lambda, EC2, and VPC
7. Experience with big data platforms such as Amazon Redshift, Snowflake, Apache Iceberg, Apache Spark, AWS Glue, RDS
8. Experience with containers: Docker, Amazon ECS, and/or Kubernetes
9. Experience with data engineering, data analysis, and/or ETL
10. Experience with programming languages such as Python
11. Experience with OS-level scripting languages such as Bash and PowerShell
12. Experience with use of advanced features of AI tools: ChatGPT, custom GPTs, and/or other models such as Claude Sonnet.