Senior Big Data Engineer (Python, Scala, Spark) - Banking

CAPCO POLAND 

*We are looking for Poland based candidate. 

Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It’s important to us that we recruit and develop as diverse a range of talent as we can and we believe that everyone brings something different to the table – so we’d love to know what makes you different. Such differences may mean we need to make changes to our process to allow you the best possible platform to succeed, and we are happy to cater to any reasonable adjustments you may require. You will find the section to let us know of these at the bottom of your application form or you can mention it directly to your recruiter at any stage and they will be happy to help.

Capco Poland is a leading global technology and management consultancy, dedicated to driving digital transformation across the financial services industry. Our passion lies in helping our clients navigate the complexities of the financial world, and our expertise spans banking and payments, capital markets, wealth, and asset management. We pride ourselves on maintaining a nimble, agile, and entrepreneurial culture, and we are committed to growing our business by hiring top talent.

We also are:

• Experts in banking and payments, capital markets, wealth and asset management
• Focused on maintaining our nimble, agile, and entrepreneurial culture
• Committed to growing our business and hiring the best talent to help us get there

ROLE OVERVIEW:

We're seeking a skilled Senior Big Data Engineer to join our Team. The ideal candidate will be responsible for designing, implementing and maintaining scalable data pipelines and solutions on on-prem / migration / cloud projects for large scale data processing and analytics.

 BIG DATA ENGINEER @ CAPCO - WHAT TO EXPECT

• You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
• You’ll be part of digital engineering team that develop new and enhance existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
• You’ll be involved in digital and data transformation processes through a continuous delivery model.
• You will work on automating and optimising data engineering processes, develop robust and fault tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
• You’ll be able to work across different data, cloud and messaging technology stacks.
• You’ll have an opportunity to learn and work with specialised data and cloud technologies to widen the skill set. 

THINGS YOU WILL DO

As a Senior Big Data Engineer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.

We need somebody like you to help us in different fronts:

• You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
• You will use Scrum methodology, and be part of a high performance team
• You will document your solutions in the tools: JIRA, Confluence, ALM
• You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team deliver

SKILLS & EXPERIENCES YOU NEED TO GET THE JOB DONE

• 5+ years of experience with Python
• 2+ years of experience with Spark and Scala
• Knowledge of good practices in writing code: clean code, software design patterns, functional style of writing code, TDD
• Agile approach for software development
• Experience and expertise across data integration and data management with high data volumes
• Experience working in agile continuous integration/ DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
• Experience with different database structures, including Postgres, SQL, Hive

Preferred qualifications

• CI/CD: Jenkins, GitHub Actions 
• Orchestration: Control-M, Airflow 
• Scripting: Bash, Python 
• Software development life cycle: HP ALM
• Basics of cybersecurity and quality: Sonar, Fortify
• Basics of cloud computing: Docker, Kubernetes, OS3, Azure, AWS

WHY JOIN CAPCO?

• Employment contract and/or Business to Business - whichever you prefer
• Possibility to work remotely
• Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
• Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
• Access to 3.000+ Business Courses Platform (Udemy)
• Access to required IT equipment
• Paid Referral Program
• Participation in charity events e.g. Szlachetna Paczka
• Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
• Being part of the core squad focused on the growth of the Polish business unit
• A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
• A work culture focused on innovation and creating lasting value for our clients and employees

ONLINE RECRUITMENT PROCESS STEPS*

• Screening call with the Recruiter
• Technical interview: first stage
• Client Interview
• Feedback/Offer

We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.