94 311
15 366
Technologies-expected : Python OOP Spark SQL Hadoop technologies-optional : Google Cloud Platform Pub/Sub Big Query Kafka Juniper Apache Ni Fi Hive Impala Cloudera CI/CD about-project : Were seeking a skilled Senior Big Data Engineer to join our Team. The ideal candidate will be responsible for designing, implementing and maintaining scalable data pipelines and solutions on on-prem / migration / cloud projects for large scale data processing and analytics. *We are looking for Poland based candidate. The job is hybrid - 2 days per week in Krakow. responsibilities : Design, develop and maintain robust data pipelines using Python, Spark, Hadoop, SQL for batch and streaming data processing Collaborate with cross-functional teams to understand data requirements and design efficient solutions that meet business needs Optimize Spark jobs and data processing workflows for performance, scalability and reliability Ensure data quality, integrity and security throughout the data lifecycle Troubleshoot and resolve data pipeline issues in a timely manner to minimize downtime and impact on business operations Stay updated on industry best practices, emerging technologies, and trends in big data processing and analytics Document, design specifications, deployment procedures and operational guidelines for data pipelines and systems Provide technical guidance and mentorship for new joiners requirements-expected : Min. 5 years of experience as a Data Engineer/Big Data Engineer University degree in computer science, mathematics, natural sciences, or similar field and relevant working experience Excellent SQL skills, including advanced concepts Very good programming skills in Python Experience in Spark and Hadoop Experience in OOP Experience using agile frameworks like Scrum Interest in financial services and markets Fluent English communication and presentation skills Sense of humor and positive attitude offered : Employment contract and/or Business to Business - whichever you prefer Possibility to work remotely Speaking English on daily basis, mainly in contact with foreign stakeholders and peers Multiple employee benefits packages (My Benefit Cafeteria, private medical care, life-insurance) Access to 3.000+ Business Courses Platform (Udemy) Access to required IT equipment Paid Referral Program Participation in charity events e.g. Szlachetna Paczka Ongoing learning opportunities to help you acquire new skills or deepen existing expertise Being part of the core squad focused on the growth of the Polish business unit A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients A work culture focused on innovation and creating lasting value for our clients and employees benefits : sharing the costs of sports activities private medical care life insurance remote work opportunities integration events