Software Development Engineer (Python/Pyspark)
About the role
The Software Development Engineer (Python/Pyspark) will support and enhance batch data processing and batch letters using Python and PySpark
In this role, you will:
• Support and enhance batch data processing and batch letters using Python and PySpark
• Research, troubleshoot, and fix potential issues in existing data pipelines and Spark jobs
• Develop and maintain new ETL/ELT data pipelines to support business enhancements and regulatory mandates
• Monitor batch and streaming jobs on AWS EMR and Databricks; ensure timely issue resolution
• Support ad-hoc member/data requests and reporting needs
• Optimize Spark jobs for performance, scalability, and cost efficiency
• Implement error handling, retries, and exponential backoff for resilient services
• Assist with technical debt reduction, platform upgrades (EMR, Airflow, Spark), and refactoring
• Ensure adherence to security best practices including IAM, encryption at rest and in transit
Work Model
We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.
What you need to have to be considered
Technical Skills — Mandatory
• 6+ years of experience in Python development
• Strong hands-on experience with PySpark and Apache Spark
• Experience in ETL/ELT integration using Python
• Proficiency in AWS services:
EMR
Redshift
S3
EC2
IAM
• Strong knowledge of SQL for data transformation and analytics
• Experience with Databricks for distributed data processing
• Hands-on experience with Python testing and code quality tools (Pytest, Pylint)
• Experience in Spark cluster management, parallel processing, and big-data optimization
Proficiency Level
• AWS: Intermediate / Proficient
• EC2 / S3: Intermediate / Proficient
• IAM: Intermediate / Proficient
• EMR: Intermediate / Proficient
• Spark / PySpark: Proficient
Domain Experience
• Healthcare (Preferred)
Desired / Nice-to-Have Skills
• Experience with Apache Airflow for workflow orchestration
• Familiarity with Facets
• Experience in EMR and Spark upgrades
These will help you stand out
Desired / Nice-to-Have Skills
-
Experience with Apache Airflow for workflow orchestration
-
Familiarity with Facets
Experience in EMR and Spark upgrades
We’re excited to meet people who share our mission and can make an impact in a variety of ways. Don’t hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.
Please note, this role is not able to offer visa transfer or sponsorship now or in the future
LI-NC1
Salary and Other Compensation:
Applications will be accepted until 2/6/26.
The annual salary for this position is between $67,000 – $132,000 depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
· Medical/Dental/Vision/Life Insurance
· Paid holidays plus Paid Time Off
· 401(k) plan and contributions
· Long-term/Short-term Disability
· Paid Parental Leave
· Employee Stock Purchase Plan
Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.