EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking a Senior Data Engineer with deep expertise in Azure Fabric, PySpark and AI-driven data platforms.
This role focuses on designing, building and optimizing scalable data pipelines and analytics solutions, collaborating with architects, engineers and business stakeholders to deliver modern, AI-integrated data solutions.
Responsibilities
- Design, develop and maintain scalable data pipelines using Azure Fabric
- Implement data processing and transformation with Python, PySpark and SparkSQL
- Utilize OneLake (Delta / OpenLake) for efficient data storage and analytics
- Develop and support solutions leveraging Cosmos DB (NoSQL API)
- Contribute to Fabric workloads such as Data Engineering, Data Factory Gen2 and Lakehouse
- Implement and maintain CI/CD pipelines following DevOps best practices
- Integrate data solutions with Power BI for reporting and analytics
- Collaborate with AI, data science and product teams to support AI-driven use cases
- Ensure data quality, performance, security and reliability
- Participate in Agile ceremonies and contribute to sprint delivery
- Support production issues and drive continuous improvements
Requirements
- 5+ years of experience in Data Engineering or related engineering roles
- Strong hands-on experience with Azure Fabric
- Proficiency in Python, PySpark and SparkSQL
- Experience with Cosmos DB (NoSQL API) and OneLake / Delta Lake (OpenLake concepts)
- Knowledge of DF Gen2 and M-code
- Experience with CI/CD pipelines using Azure DevOps or equivalent
- Good understanding of Azure services and Power BI integration
- Strong problem-solving and analytical skills
- Ability to work independently on complex tasks
- Clear communication and collaboration skills
- Ownership mindset with attention to quality and performance
- Experience working in Agile or Scrum environments
- Upper-Intermediate English language proficiency (B2)
Nice to have
- Experience with code generation, including non-AI and AI-assisted approaches
- Expertise with other Cosmos DB variants such as Mongo, Cassandra or Table APIs
- Exposure to Azure AI Foundry and Data Science workflows
- Strong background in Big Data and Spark ecosystems
- Knowledge of financial instruments and financial services data
- Hands-on experience with industry-standard LLMs such as GPT, Claude or similar
We offer
- We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge:
- Full access to cutting-edge tools and technologies
- Competitive compensation depending on experience and skills
- All-around Social package: professional & soft skills training, medical & family care programs, sports
- Relocation opportunities
- Free English classes
- Unlimited access to LinkedIn learning solutions
- Continuous experience exchange with experts and professionals worldwide
- Friendly team and comfortable working environment
- Engineering, corporate, and social events within and outside the Company
- Flexible working schedule
- Opportunities for self-realization
