EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Lead the development team, ensuring high-quality code delivery and adherence to architectural standards.
We are seeking a highly skilled Senior Data Lead with deep expertise in PySpark and strong experience in Azure Data Factory/Synapse. The ideal candidate will have a proven track record in building and optimizing data pipelines, implementing scalable data solutions, and working with modern DevOps practices in cloud environments.
Responsibilities
- Design, develop, and optimize large-scale data processing solutions using PySpark
- Implement and maintain advanced data pipelines and workflows in Azure Data Factory and Azure Synapse
- Develop, automate, and monitor development and build pipelines for robust data engineering solutions
- Collaborate with cross-functional teams to deliver high-quality, scalable, and reliable data solutions
- Apply best practices for code optimization, version control (Git), and infrastructure automation
- Integrate Azure Functions for data orchestration and transformation tasks as needed
- Contribute to infrastructure setup and automation using Terraform
- Document solutions and mentor junior team members
Requirements
- Minimum 8 years’ experience in Data engineering
- Extensive hands-on experience with PySpark, including writing optimized and scalable code
- Strong background in Azure Data Factory and/or Azure Synapse for data integration and orchestration
- Hands-on experience with Azure services and Azure Functions
- Experience designing and managing development and build pipelines in cloud environments
- Proficient with Git for version control and collaboration
- Familiarity with Terraform for infrastructure automation
- Experience integrating Azure Functions into data workflows
- Excellent knowledge of building development pipelines & build pipelines
- Advanced knowledge of Azure DevOps, CI/CD, infrastructure as code, and automation tools
- Excellent problem-solving, communication, and documentation skills
- Ability to work independently and mentor junior engineers
We offer
- We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge:
- Full access to cutting-edge tools and technologies
- Competitive compensation depending on experience and skills
- All-around Social package: professional & soft skills training, medical & family care programs, sports
- Relocation opportunities
- Free English classes
- Unlimited access to LinkedIn learning solutions
- Continuous experience exchange with experts and professionals worldwide
- Friendly team and comfortable working environment
- Engineering, corporate, and social events within and outside the Company
- Flexible working schedule
- Opportunities for self-realization
