AWS Data Engineer

EXL Talent Acquisition Team
Apply Now ↗
📍 Pune, Maharashtra, India

About this role

We are seeking a highly skilled AWS Data Engineer with deep expertise in AWS cloud architecture, big data processing, real-time streaming, and modern data lake technologies. The ideal candidate will have strong hands-on experience in Spark (PySpark), Iceberg, EMR, Starburst/Trino, and event-driven architectures, along with experience building real-time and API-driven data applications who can design and build generic solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Management. This is high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer’s critical systems. 

Key Responsibilities 

  • Design and implement scalable, secure, and cost-optimized AWS data architectures.
  • Develop and maintain ETL pipelines using AWS Lambda and AWS Glue ETL.
  • Configure and manage AWS Glue Crawlers, Glue Data Catalog, and schema evolution.
  • Build, optimize, and unit test applications on the Apache Spark framework using PySpark.
  • Design and optimize data lakes using Apache Iceberg on AWS, including table compaction and Iceberg performance tuning.
  • Work extensively with data formats such as Avro, Parquet, JSON, XML, and CSV.
  • Orchestrate event-driven workflows using AWS Step Functions and Amazon EventBridge.
  • Connect and integrate Starburst from Lambda and Glue ETL jobs for federated querying.
  • Implement CI/CD pipelines for automated testing and deployment.
  • Perform unit testing using PyTest, and performance tuning of Spark and Python applications
  • Strong understanding of AWS architecture best practices, scalability, security, and cost optimization strategies.
  • Strong hands-on experience with AWS services including Lambda, Glue ETL, Athena, S3, DynamoDB, Step Functions, EventBridge, SNS, and SQS.
  • Deep experience in Apache Spark (PySpark/Scala) development, unit testing, and performance optimization.
  • Strong Python programming skills using libraries such as pandas, requests, json, and awswrangler.
  • Experience on Apache Kafka and Confluent Kafka.
  • Experience designing and optimizing data lakes using Apache Iceberg, including compaction and Iceberg optimization techniques.

Frequently Asked Questions

Is the salary disclosed for the AWS Data Engineer position at EXL Talent Acquisition Team?
The salary for this AWS Data Engineer role at EXL Talent Acquisition Team is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the AWS Data Engineer position at EXL Talent Acquisition Team located?
This AWS Data Engineer role at EXL Talent Acquisition Team is based in Pune, Maharashtra, India. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
How do I apply for the AWS Data Engineer position at EXL Talent Acquisition Team?
Click the "Apply Now" button on this page. You will be redirected to EXL Talent Acquisition Team's official application portal hosted on oraclecloud where you can submit your application directly.
When was the AWS Data Engineer job at EXL Talent Acquisition Team posted?
This AWS Data Engineer position at EXL Talent Acquisition Team was posted on Sep 8, 2026. Apply as soon as possible — early applications are often reviewed first.
AWS Data Engineer
EXL Talent Acquisition Team
Apply for this role ↗

You'll be redirected to EXL Talent Acquisition Team's official application page on oraclecloud.