Data Engineering & Infrastructure Lead ID88014

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! :)

We are looking for a part-time Data Engineering and Infrastructure Lead to audit AWS architecture, CI/CD processes, and ETL pipeline decisions in an advisory capacity. This person weighs managed tooling against custom builds, reviews SageMaker-based MLOps pipelines, and mentors the team on engineering standards. Evaluating AI-assisted development workflows is part of the role.

WHAT YOU WILL DO

- Audit the current AWS architecture across live applications (MAT / Signal IQ and the Impact Engine), including ECS/ECR, RDS (Postgres), S3, VPC, CloudFront/SSO, and SageMaker-based MLOps pipeline design.

- Review the CI/CD process and end-to-end app development lifecycle, recommending SDLC governance layers (schema versioning, environment separation, release gating).

- Evaluate how the team uses Claude Code (PR generation, automated reviews, token/cost management) to confirm output meets professional engineering standards.

- Provide an early technical opinion on ETL / data-ingestion pipeline architecture (managed ELT tooling vs. custom build).

- Mentor and accelerate the day-to-day infrastructure build team, focusing on AWS, DevOps, CI/CD, and data engineering practices.

- Set out recommendations and technical direction where the audit surfaces necessary changes to the current build.

- Report findings and recommendations directly to leadership, framing high-level risk and readiness.

- 6+ years of deep, current hands-on experience with AWS: ECS/Fargate, ECR, RDS (Postgres), S3, SageMaker, EventBridge, VPC/ALB/CloudFront, IAM.

- Fluency in Infrastructure-as-code, specifically Terraform.

- Proven track record designing or auditing CI/CD pipelines and SDLC governance (e.g., Alembic for schema/version control, environment separation, release gating).

- Strong data engineering depth to provide defensible opinions on ETL / ingestion architecture (managed tools vs. custom builds).

- Experience evaluating AI-assisted / LLM-assisted development workflows (e.g., Claude Code) from an engineering-quality and cost-governance standpoint.

- Comfortable operating in a part-time advisory capacity (50% stepping down to 25%) as a strong communicator who can mentor less experienced engineers.

- Upper-intermediate English level.

NICE TO HAVES

- Prior experience working with small, fast-moving engineering teams.

- Understanding of MLOps pipelines and data science infrastructure.

- Media/AdTech domain knowledge is helpful but not required.

- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

- Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

- A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

- Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.