AWS Glue

Mandatory Skills : AWS Glue, AWS Lambda, Python, Snowflake
Good to Have Skills : Apache Spark, Databricks

Engineer with strong data background and specific handson experience in AWS Glue Lambda Python Snowflake building and orchestrating production data pipelines including serverless ingestion and medallion architecture Skilled in sourcing data from across LOB systems and conforming it to enterprise standards and governed definitions

Experience with API based ingestion native connector integrations and data warehouse design Able to partner with the business to elevate operations to the next level by translating requirements into scalable data solutions

Primary Skills AWS Glue Lambda Python Snowflake

Secondary Skills Databricks

Design develop and maintain scalable ETLELT pipelines using AWS Glue and Python

Build eventdriven and serverless solutions using AWS Lambda Step Functions S3 SNS and SQS

Develop and optimize Snowflake data models stored procedures tasks streams and data ingestion frameworks

Implement data transformation cleansing validation and reconciliation processes

Design and maintain data lake and data warehouse architectures on AWS and Snowflake

Optimize pipeline performance scalability reliability and cost efficiency

Develop reusable framework components and automation utilities

Troubleshoot production issues and perform root cause analysis

Implement CICD pipelines using GitHub Jenkins Terraform or similar tools

Collaborate with business stakeholders architects and analytics teams to deliver data solutions

Ensure adherence to data governance security and compliance standards

Create technical documentation and support knowledge transfer activities