Software Development Engineer (Python/Pyspark)

Cognizant Logo
  • Insurance
  • FullTime
  • Shift
  • Applications have closed

About the role

The Software Development Engineer (Python/Pyspark) will support and enhance batch data processing and batch letters using Python and PySpark

In this role, you will:

• Support and enhance batch data processing and batch letters using Python and PySpark

• Research, troubleshoot, and fix potential issues in existing data pipelines and Spark jobs

• Develop and maintain new ETL/ELT data pipelines to support business enhancements and regulatory mandates

• Monitor batch and streaming jobs on AWS EMR and Databricks; ensure timely issue resolution

• Support ad-hoc member/data requests and reporting needs

• Optimize Spark jobs for performance, scalability, and cost efficiency

• Implement error handling, retries, and exponential backoff for resilient services

• Assist with technical debt reduction, platform upgrades (EMR, Airflow, Spark), and refactoring

• Ensure adherence to security best practices including IAM, encryption at rest and in transit

Work Model

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

Technical Skills — Mandatory

• 6+ years of experience in Python development

• Strong hands-on experience with PySpark and Apache Spark

• Experience in ETL/ELT integration using Python

• Proficiency in AWS services:

EMR

Redshift

S3

EC2

IAM

• Strong knowledge of SQL for data transformation and analytics

• Experience with Databricks for distributed data processing

• Hands-on experience with Python testing and code quality tools (Pytest, Pylint)

• Experience in Spark cluster management, parallel processing, and big-data optimization

Proficiency Level

• AWS: Intermediate / Proficient

• EC2 / S3: Intermediate / Proficient

• IAM: Intermediate / Proficient

• EMR: Intermediate / Proficient

• Spark / PySpark: Proficient

Domain Experience

• Healthcare (Preferred)

Desired / Nice-to-Have Skills

• Experience with Apache Airflow for workflow orchestration

• Familiarity with Facets

• Experience in EMR and Spark upgrades

These will help you stand out

Desired / Nice-to-Have Skills

  • Experience with Apache Airflow for workflow orchestration

  • Familiarity with Facets

Experience in EMR and Spark upgrades

We’re excited to meet people who share our mission and can make an impact in a variety of ways. Don’t hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.

Please note, this role is not able to offer visa transfer or sponsorship now or in the future

LI-NC1

Salary and Other Compensation:

Applications will be accepted until 2/6/26.

The annual salary for this position is between $67,000 – $132,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

· Medical/Dental/Vision/Life Insurance

· Paid holidays plus Paid Time Off

· 401(k) plan and contributions

· Long-term/Short-term Disability

· Paid Parental Leave

· Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.