We are currently seeking an experienced individual to join the DataVisa Operations team within Group Data Privacy Management in the role of Data Governance Analyst. The role holder will work as part of the centralized utility which will help deliver faster, simpler and more efficient results, helping avoid duplication of work across Global Businesses and Global Functions (GBGFs) and reduce time to market for business sponsored programmes; helping in reducing the risk of breach of customer data and other data privacy risks; driving adherence to the Global Data Management Policies across HSBC, and ultimately increasing customer trust and value of customer data to the organization.
responsibilities :
Developing efficient pipelines for processing and analyzing large datasets using technologies like Apache Spark or Hadoop.
Extracting and combining data from various sources (e.g., APIs, databases) using tools like Kafka, Flume, or Sqoop.
Managing data storage systems (HDFS, Postgres, SQL, Hive) and optimizing their performance.
Optimizing processes to ensure scalability, reliability, and high system performance.
Preparing data for analytics teams and data scientists to enable insights and decision-making.
requirements-expected :
At least 2 years of experience working with Spark and Scala.
Knowledge of good practices in writing code: clean code, software design patterns, functional style of writing code, TDD.
At least 2 years of experience working with Spark with Scala, software design patterns, and TDD.
Experience in working with big data – Spark, Hadoop, Hive. Knowledge of Azure Databricks is considered as a plus.
Agile approach for software development.
Experience working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira).
Experience with different database structures, including (Postgres, SQL, Hive).
English (at least B2+).
offered :
We are open to the employment form according to your preferences
Work with experienced and engaged team, willing to learn, share knowledge and open for growth and new ideas
Hybrid working system (2 days a week in Kraków office)
Mindbox is a dynamically growing IT company, but still not a large one – everybody can have a real impact on where we are going next
We invest in developing skills and abilities of our employees
We have attractive benefits and provide all the tools required for work f.e.computer
Interpolska Health Care, Multisport, Warta Insurance, training platform (Sages)
benefits :
sharing the costs of sports activities
private medical care
sharing the costs of professional training & courses
