The heart of data analytics processing is metadata. There have been multiple metastore related products in Google Cloud Platform (GCP), there has not yet been a product that gives the best of open source compatibility while having transparent first-party integration with GCPs suite of Data Analytics tools (BigQuery, Dataproc, Dataflow, etc). This is the mission of BigLake, to create the one unified managed catalog for all of GCP.
We are riding the wave of the latest advancements in data analytics, integrating with technologies like Apache Iceberg and Apache Delta. Our work impacts the user experience across the GCP data analytics landscape - we collaborate closely with partner teams like Dataplex and Dataproc.
In this role, you will have excellent learning and growth opportunities. Youll be a part of the experienced BigQuery team, where youll be empowered to design, implement, launch and land large-scale, impactful projects with the necessary support and guidance, and a large pipeline of enterprise customers waiting to use your features. You will be instrumental in shaping the architecture and future of BigQuerys metadata management capabilities. Your role is focused around improving Federation support for BigLake, which includes support for major strategic partners such as Salesforce, open source standards such as the Iceberg Rest Catalog, and other major metastores such as Glue. You will also build an engineering team responsible for all data and metadata federation aspects and expand BigLake to other clouds, hyperscalers, and partners like SAP and Salesforce.
Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.
responsibilities :
Model strong technical leadership for the broader BigLake organization.
Work with storage, networking, and analytic engine leads to create a technical roadmap for cross cloud analytics. You will also be required to lead execution, including directly delivering some aspects.
Build, mentor, and empower an engineering team, fostering a culture of operational excellence, innovation, collaboration and continuous learning.
Work with Product Managers to create a comprehensive product that aligns to this roadmap.
requirements-expected :
Bachelors degree or equivalent practical experience.
8 years of experience with one or more general purpose programming languages such as Java, C/C++ or Python.
7 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
5 years of experience in a technical leadership role; overseeing projects.
5 years of experience in a people management, supervision/team leadership role.
benefits :
sharing the costs of sports activities
private medical care
sharing the costs of foreign language classes
sharing the costs of professional training & courses
life insurance
remote work opportunities
fruits
corporate products and services at discounted prices
