Informacje o stanowisku
We are looking for aSenior Data Engineer to join our team and help us execute our ambitious vision. As a Senior PySpark Developer, you will lead the design and implementation of large-scale data processing systems, providing strategic insights that drive business success. You will mentor junior developers, influence architectural decisions, and collaborate with cross-functional teams to deliver robust and efficient data solutions.This role offers a hybrid model, with 3 days per week working from the clients office
Responsibilities
- Design scalable and resilient data architectures on Azure, leveraging services like Azure Data Lake Storage, Azure SQL Database, and Azure Data Factory
- Evaluate and implement new tools and technologies to enhance data processing capabilities
- Lead the development and optimization of complex data pipelines using PySpark and Azure Databricks
- Provide technical guidance and mentorship to junior developers, ensuring best practices and high-quality code
- Identify and drive opportunities for process improvement and automation
- Stay abreast of industry trends and emerging technologies to ensure the organization remains competitive in big data and cloud solutions
- Solve complex data challenges using innovative approaches and critical thinking
- Collaborate with business stakeholders, data scientists, and engineers to understand strategic goals and deliver data-driven solutions
Requirements
- At least 3 years of experience in big data processing and cloud technologies
- Advanced proficiency in PySpark, Python, and SQL
- Extensive experience with Azure cloud services, including Azure Databricks, Data Lake, and Azure Data Factory
- Proven experience in designing and implementing large-scale data architectures
- Strong leadership and mentoring abilities with a track record of leading successful data projects
- Excellent communication and interpersonal skills, with the ability to influence and drive change
#J-18808-Ljbffr
Praca KrakówKraków - Oferty pracy w okolicznych lokalizacjach