Alignity Solutions - PySpark Developer / Senior Data Engineer

Data Engineer is needed in India.

Client: Alignity Solutions

Location: Seri Lingampally, TG, in

Contract: Contract

Job Description

Are you looking for a career where you can Experience, Grow & Contribute while earning at least 10% above the market? If so, we are excited to have you here. Join us as we redefine the meaning of work and be part of a team praised by Clients, Job-seekers, and Employees.

If you are a PySpark Developer / Senior Data Engineer seeking excitement, challenge, and stability in your work, this may be the opportunity for you. We are an IT Solutions Integrator/Consulting Firm assisting our clients in hiring the right professional for an exciting long-term project.

Role: PySpark Developer / Senior Data Engineer

Location: HYDERABAD | BANGALORE | PUNE | CHENNAI

Experience: 6+ Years

Employment Type: Contract to hire

Notice Period: 0-30 days (If you have a negotiable notice period or buyout option, please apply)

Requirements

We are seeking an experienced PySpark Developer with strong hands-on expertise in big data processing, distributed computing, and data engineering. The ideal candidate will possess deep experience in building scalable data pipelines, transforming large datasets, and working with Spark-based ecosystems in production environments.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using PySpark and Apache Spark
• Develop efficient ETL/ELT workflows for batch and near-real-time processing
• Optimize Spark jobs for performance, reliability, and cost efficiency
• Work with large structured and unstructured datasets
• Integrate data from multiple sources such as databases, APIs, files, and cloud storage
• Write reusable, modular, and maintainable PySpark code
• Troubleshoot job failures, data quality issues, and performance bottlenecks
• Collaborate with data architects, analysts, platform teams, and business stakeholders
• Implement data validation, monitoring, and logging frameworks
• Support deployment, scheduling, and orchestration of data pipelines
• Participate in design reviews, code reviews, and technical discussions
• Mentor junior engineers and contribute to team best practices

Required Skills

• Strong hands-on experience with PySpark and Apache Spark
• Deep understanding of Spark concepts such as RDDs, DataFrames, datasets, partitioning, caching, shuffling, joins, and window functions
• Strong Python programming skills
• Experience with SQL and relational databases
• Knowledge of big data concepts and distributed data processing
• Hands-on experience with ETL/ELT pipeline development
• Good understanding of performance tuning and optimization techniques in Spark
• Experience with version control tools like Git
• Familiarity with Linux/Unix environments
• Strong debugging and analytical skills