CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Senior Data Engineer (with AI/ML experience) India

IDT Verified employer

Full time Remote
Experience
6–7 years
Work mode
Remote
Posted 9 months ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Role at a glance

You will
  • Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores…
  • Design, optimize, and maintain robust ETL/ELT pipelines and data structures within our cloud data warehouse (Snowflake/Redshift) to support…
  • Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced…
Experience
6–7 years
Must-have skills
AWSAgileApache SparkData EngineeringHadoopJSON
Work mode
Remote

How well do your skills match this job?

Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.

Job description

Location: Pune; Bangalore
Department: IDT Corporation

IDT (www.idt.net) is a communications and financial services company founded in 1990 and headquartered in New Jersey, US. Today it is an industry leader in prepaid communication and payment services and one of the world’s largest international voice carriers. We are listed on the NYSE, employ over 1800 people across 20+ countries, and have revenues in excess of $1.5 billion.

We are looking for a skilled Senior Data Engineer (with AI/ML exposure)  to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. If you're looking for a company that will give you the maximum flexibility in choosing a location to work, this opportunity is for you!

 * The interview process will be conducted in English.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
  • Design, optimize, and maintain robust ETL/ELT pipelines and data structures within our cloud data warehouse (Snowflake/Redshift) to support core Business Intelligence. 
  • Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
  • Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
  • Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
  • Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
  • Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
  • Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
  • Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.

Requirements:

  • Senior Data Engineer with 6-7+ years of experience in building scalable data infrastructure and 1-2 years of hands-on exposure to AI/ML workflows.
  • Excellent English communication skills.
  • Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion. 
  • Experience designing complex data pipelines extracting data from RDBMS, JSON, API and Flat file sources.
  • Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift.
  • Effective oral and written communication skills with BI team and user community.
  • Demonstrated experience in utilizing python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.
  • Deep understanding of vector databases and RAG architectures, and how they drive semantic retrieval workflows.
  • Skilled at integrating open-source LLM frameworks into data engineering workflows for end-to-end model training, customization, and scalable inference. 
  • Experience with cloud platforms like AWS or Azure Machine Learning for managed LLM deployments.
  • Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, and experience with Agile methodologies.
  • Proficiency in version control systems, with experience in managing code repositories, branching, merging, and collaborating within a distributed development environment.
  • Interest in business operations and comprehensive understanding of how robust BI systems drive corporate profitability by enabling data-driven decision-making and strategic insights. 

Pluses:

  • Experience with vector databases such as DataStax AstraDB, and developing LLM-powered applications using popular open source frameworks like LangChain and LlamaIndex–including prompt engineering, retrieval-augmented generation (RAG), and orchestration of intelligent workflows. 
  • Familiarity with evaluating and integrating open-source LLM frameworks–such as Hugging Face Transformers/LLaMA-4 across end-to-end workflows, including fine-tuning and inference optimization.
  • Knowledge of MLOps tooling and CI/CD pipelines to manage model versioning and automated deployments.

What we offer:

  • Remote work opportunity!
  • B2B Employment ($, gross) or full-time employment option.
  • Stable job with long-term growth perspective.
  • Competitive salary with annual performance review.
  • Really good hardware.
  • An exciting and challenging job with talented people around.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Referral program – get rewarded for helping us grow the team with talented people.
  • Company-supported English classes to enhance your professional growth.

Please attach CV in English.

The interview process will be conducted in English.

Only accepting applicants from INDIA

Key skills

Required

AWSAgileApache SparkData EngineeringHadoopJSONKafkaLinuxMachine LearningMicrosoft AzurePythonSQLUnix

Preferred

CI/CDMLOpsPrompt Engineering

Soft skills

CommunicationDecision Making

Job market insights

539active AWS jobs in India
183active Agile jobs in India
71active Apache Spark jobs in India

Jobs asking for AWS in India also ask for

  • Python59%
  • Microsoft Azure55%
  • Google Cloud Platform (GCP)51%
  • CI/CD43%
  • Kubernetes41%

From live job posts on CoreHRx, updated 1 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

How much experience does this job need?

The post asks for 6–7 Yrs experience.

Where is this job based?

It is a remote job.

What kind of job is this?

It is a full time job.

This page is for Indian job seekers preparing for cloud engineer, DevOps, backend and solutions architect roles that list AWS as a skill, whether you are a fresher with a first certification or an experienced engineer moving into a senior role. It covers 60 questions in three levels: core services and concepts, then design and configuration choices for one to three years of experience, and finally scenario, security, cost and troubleshooting questions asked in senior rounds. Read each answer, explain it aloud in your own words, and try the CLI commands in a practice account with a billing alert set.

Questions you may be asked

  1. What is the difference between an AWS Region and an Availability Zone?
  2. Explain the AWS shared responsibility model.
  3. What is Amazon EC2, and how do you read an instance type name like m7g.large?
  4. What is Amazon S3, and what are its main storage classes?

Get IT jobs you can do remotely by email

Create a free profile and we email you new IT jobs you can do remotely, at most once a week.

Similar jobs

Php Developer

Speedhire Consultancy
noida
AWSCI/CDPHP
Full time On-site 14 days ago

Accounts Executive

ThinkNext Innovations Pvt Ltd
Ludhiana
AccountingTallyCommunication
Full time On-site 4 days ago

Free · takes a minute · your resume fills your profile