Information Technology

Senior PySpark Developer

Infosys

  • Bengaluru, Karnataka
  • Onsite
  • 8–11 years experience

Posted 12 Oct 2026 · Employer deadline 31 Dec 2026

About this role

We are looking for an experienced Senior PySpark Developer with 8+ years of experience in Data Engineering and Big Data technologies. The ideal candidate should possess strong expertise in PySpark, Python, Spark SQL, ETL development, Data Warehousing, and Cloud platforms (AWS/Azure/GCP). The candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions.

Responsibilities

Key Responsibilities

Design and develop scalable data pipelines using PySpark and Apache Spark. Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data. Develop high-performance Spark applications using Spark SQL, DataFrames, and RDDs. Work closely with data architects and business teams to define data requirements. Implement data quality, validation, and governance processes.

Optimize Spark jobs for performance, memory management, and scalability. Integrate data from various sources including databases, APIs, cloud storage, and streaming platforms. Support production deployments and resolve performance bottlenecks. Mentor junior developers and participate in code reviews.

Requirements

Mandatory Skills 8+ years of IT experience. Strong hands-on experience in PySpark and Python. Expertise in Apache Spark, Spark SQL, DataFrames, and ETL Development. Strong SQL and database concepts. Experience with Hadoop Ecosystem (Hive, HDFS, YARN). Experience in Data Warehousing and Data Modeling. Hands-on experience with Unix/Linux.

Before you apply

Company Jobs India lists this vacancy from the employer's official careers website. Apply only on that website. Genuine employers do not ask for a fee, deposit, OTP or bank details to give you an interview or an offer letter.

Skills

Software & It

Role details

Work mode
Onsite
Experience
8–11 years experience
Application method
Continue to the employer’s application website

Listed from Infosys’s official careers website · last checked 17 Nov 2026.

Employer

Infosys

View the company profile and its current opportunities.

Company profile