Senior Big Data Software Engineer (AWS + Databricks)

SoftServe is a global digital services and consulting company with over 30 years of experience and more than 11,000 professionals across 16 countries, helping businesses worldwide solve complex challenges through technology. Our Data & Analytics Center of Excellence (CoE) brings together data specialists to drive excellence in data, analytics, and business intelligence. We deliver solutions across Data Strategy & Governance, Data Platform Engineering, Data Migration, and Reporting & BI. In this role, you’ll design and develop scalable data processing solutions in AWS environments, working with large-scale, distributed data. You’ll take ownership of reliable data pipelines and contribute to data platform development, collaborating with engineering, AI, and product teams to support analytics, automation, and AI-enabled solutions. • Design, develop, and maintain scalable batch and distributed data processing pipelines to support reliable data processing and integration • Build and optimize data processing solutions, taking ownership of performance, reliability, scalability, and cost efficiency across data pipelines • Collaborate with engineering, AI, and product teams to understand requirements and support analytics, automation, and AI-enabled use cases • Develop data solutions using Python, SQL, Apache Spark, Databricks, and AWS services such as AWS Glue, Amazon Athena, and Amazon Aurora • Work with relational databases such as PostgreSQL and MySQL to support data processing and integration workflows • Develop and maintain workflow orchestration using technologies such as Apache Airflow and contribute to reliable data processing workflows • Contribute to CI/CD, Infrastructure as Code, testing, troubleshooting, and production support activities using Terraform or similar technologies • Participate in architecture discussions and contribute to the continuous improvement of data platforms and engineering practices • Strong experience in Big Data, Data Engineering, or related fields, with 5+ years of professional experience • Strong proficiency in Python and SQL, with Java experience considered a plus • Strong hands-on experience with Apache Spark, distributed data processing, and Databricks • Solid experience developing data solutions on AWS using services such as AWS Glue, Amazon Athena, and Amazon Aurora • Practical experience working with relational databases such as PostgreSQL and MySQL • Familiarity with workflow orchestration technologies such as Apache Airflow and streaming technologies such as Apache Kafka • Solid experience with CI/CD, version control, and Infrastructure as Code using Terraform or similar technologies • Familiarity with GenAI, MLOps, machine learning workflows, or AI platform integrations is considered a plus • Upper-intermediate or higher English proficiency for collaboration across teams • SoftServe University: Access continuous learning opportunities, certification support, and leadership development programs to grow your skills and advance your career • Medical insurance: Health coverage for you and your family • Food vouchers: Additional support for your everyday expenses • Extra days off: Enjoy additional time off to rest, recharge, and maintain a healthy work-life balance • Dare to Care: Our holistic well-being program, designed to support your overall wellness • Anniversary Program: Celebrating your milestones and recognizing your journey with SoftServe