CoreHRx Jobs

Apply in one click, save jobs and take free mock tests.

Register free Log in
Hiring? Post jobs with CoreHRx
My account
user

View & update profile

Senior Data Engineer

ADM

Full time
Location
Bangalore
Work mode
Not stated
Posted 16 days ago

Free · takes a minute · your resume fills your profile

CoreHRx never asks candidates for money. If anyone does, .

Job description

Job Description
Job Title: Senior Data Engineer
Overview:
We are seeking a skilled and motivated Azure Databricks Data Engineer to join our dynamic team. The ideal candidate will have strong experience with Python, Spark programming, and expertise in building and optimizing data pipelines in Azure Databricks. You will play a pivotal role in leveraging Databricks workflows, Databricks Asset Bundles, and CI/CD pipelines using GitHub to deliver high-performance data solutions. A solid understanding of Data Warehousing and Data Mart architecture in Databricks is critical for success in this role. If youre passionate about data engineering, cloud technologies, and scalable data architecture, wed love to hear from you!
Key Responsibilities:
Python and Spark Programming: Develop and maintain scalable data pipelines using Apache Spark within Azure Databricks/ Python/ Pyspark. Write optimized, high-performance Spark jobs to process large volumes of data efficiently. Utilize PySpark for distributed data processing, transformation, and aggregation tasks.
Databricks Workflows: Design and implement Databricks Workflows to automate data pipeline execution, orchestrating complex workflows and batch jobs. Set up task dependencies, triggers, and notifications to ensure smooth and reliable execution. Monitor, troubleshoot, and optimize Databricks workflows for optimal performance and minimal failures.
Databricks Asset Bundles: Create and manage reusable components such as Databricks Asset Bundles, including notebooks, libraries, and models. Share and reuse asset bundles across teams to increase efficiency and ensure consistency in development.
CI/CD for Databricks Artifacts using GitHub: Implement CI/CD pipelines using GitHub Actions for the continuous integration and deployment of Databricks notebooks, jobs, and libraries. Automate the testing, building, and deployment processes to ensure smooth, consistent code delivery across environments. Collaborate with teams to implement version control practices and code reviews using GitHub.
Data Warehousing & Data Mart Design: Design and implement Data Warehousing and Data Mart solutions using Databricks, ensuring high-performance storage and retrieval of structured data. Integrate data from multiple sources into a central data warehouse using Spark-based transformations, ensuring efficient schema design and query performance. Implement dimensional modeling, including star and snowflake schemas, within Azure Databricks for data marts to support business intelligence and reporting. Data Pipeline Optimization and Management: Continuously monitor and optimize Databricks-based data pipelines for performance, scalability, and cost efficiency. Implement best practices for data partitioning, caching, and query optimization within the Databricks platform. Troubleshoot and resolve issues related to data integrity, performance, and workflow execution.
Collaboration and Stakeholder Communication: Work closely with data scientists, analysts, and other teams to understand requirements and build data solutions that meet business needs. Communicate technical concepts effectively to both technical and non-technical stakeholders. Provide mentorship and guidance to junior data engineers on Databricks best practices, data architecture, and efficient coding techniques.
Preferred Qualifications:
Cloud Certifications: Azure certifications, particularly in Databricks, Data Engineering, or Cloud Solutions, are a plus. Big Data Technologies: Familiarity with other big data tools such as Kafka, Hadoop, or Flink for streaming and real-time data processing is a plus.
Data Science/ML Experience: Exposure to machine learning workflows and model management within Databricks (e.g., using MLflow) is beneficial.

Job market insights

1 more open job at ADM

Most IT Jobs posts in Bangalore ask for 3–6 years of experience (42% of 651 that say).

Hiring most for IT Jobs in Bangalore

  • Brillio114 open jobs
  • Databricks60 open jobs
  • Extreme Networks29 open jobs

From live job posts on CoreHRx, updated 1 Nov 2026. Skill figures count posts that list their skills; salary figures only posts that show a salary.

Questions about this job

Where is this job based?

In Bangalore.

What kind of job is this?

It is a full time job.

Preparing for an IT or software developer interview in India? This guide covers the rounds companies run, the technical and HR interview questions asked most often for freshers and experienced developers, sample answers you can adapt, and a simple preparation plan.

Questions you may be asked

  1. Tell me about yourself.
  2. Explain the four pillars of object-oriented programming.
  3. What is the difference between a process and a thread?
  4. How do you find the second highest salary in SQL?

Get IT jobs in Bangalore by email

Create a free profile and we email you new IT jobs in Bangalore, at most once a week.

Similar jobs

Python Developer

ThinkNext Innovations Pvt Ltd
noida
PythonMySQL
Full time Remote 4 days ago

Php Developer

Speedhire Consultancy
noida
AWSCI/CDPHP
Full time On-site 14 days ago

Free · takes a minute · your resume fills your profile