Data Pipeline Engineer

peerislandsยท Technology
Apply Now โ†—
๐ŸŒ Remote๐Ÿ“ Chennai, Tamilnadu, India๐Ÿ“ RemoteActive

About this role

Location: India
Employment Type: Full-Time
Experience: Senior (7+ Years)

Roles & Responsibilities

  • Design, build, and maintain scalable batch and real-time data ingestion pipelines.
  • Develop and manage Bronze, Silver, and Gold (Medallion) data layers.
  • Implement CDC, watermarking, checkpointing, and batch-to-stream data processing.
  • Build robust data quality, validation, reconciliation, and monitoring frameworks.
  • Develop identity resolution, deduplication, and Golden Record (MDM) solutions.
  • Create and maintain source-to-canonical data mappings and crosswalks.
  • Ensure schema validation, versioning, and data contract enforcement.
  • Collaborate with cross-functional teams to onboard new data sources and optimize data pipelines.

Mandatory Skills

  • 7+ years of experience in Data Engineering / Data Pipeline development.
  • Strong experience with Apache Kafka (Producers, Consumers, Replay, DLQ, Exactly-once/Idempotent processing).
  • Strong SQL and ETL/ELT fundamentals.
  • Hands-on experience in Java and/or Python.
  • Experience with CDC, Batch & Streaming pipelines, and Medallion/Lakehouse architecture.
  • Experience implementing Data Quality, Validation, and Reconciliation frameworks.
  • Knowledge of Master Data Management (MDM), Identity Resolution, Deduplication, and Golden Record concepts.
  • Experience with source-to-target mapping, canonical data models, YAML/JSON configuration, and Git.

Good to Have

  • Experience with probabilistic record matching and record linkage.
  • Schema Registry (Avro/Protobuf).
  • Experience extracting data from legacy/Mainframe systems.
  • Financial reconciliation experience.
  • Healthcare or Benefits Administration domain experience.

Frequently Asked Questions

Is the salary disclosed for the Data Pipeline Engineer position at peerislands?
The salary for this Data Pipeline Engineer role at peerislands is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Is the Data Pipeline Engineer job at peerislands remote?
Yes, this Data Pipeline Engineer position at peerislands is remote, with team members based in Chennai, Tamilnadu, India, Remote. You can work from home or anywhere in the supported regions.
Is the Data Pipeline Engineer role at peerislands full-time or part-time?
This is listed as a Active position. It is posted as a Data Pipeline Engineer role in the Technology department at peerislands.
Which team or department does the Data Pipeline Engineer at peerislands belong to?
This Data Pipeline Engineer position is part of the Technology department at peerislands. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Data Pipeline Engineer position at peerislands?
Click the "Apply Now" button on this page. You will be redirected to peerislands's official application portal hosted on bamboohr where you can submit your application directly.
When was the Data Pipeline Engineer job at peerislands posted?
This Data Pipeline Engineer position at peerislands was posted on Jul 15, 2026. Apply as soon as possible โ€” early applications are often reviewed first.
Data Pipeline Engineer
peerislands
Apply for this role โ†—

You'll be redirected to peerislands's official application page on bamboohr.