Join a new AI solutions development squad building cutting-edge applications leveraging Large Language Models.
Responsible for designing, building, and maintaining robust data infrastructure to support AI applications.
Data Engineer with Snowflake
Your responsibilities
- Collaborate with AI engineers, data scientists, product owners, and other developers in Agile teams to integrate LLMs into end-user applications.
- Design and implement scalable, high-performance data pipelines.
- Work with vector databases such as AWS OpenSearch or Azure AI Search.
- Build and maintain cloud-based data solutions using AWS or Azure.
- Design and optimize data storage and processing using Snowflake.
- Develop ETL/ELT pipelines for real-time and batch data processing.
- Collaborate with AI/ML Engineers and Data Scientists for seamless integration of data pipelines.
- Optimize data storage, retrieval, and processing strategies.
- Implement data governance, security best practices, and compliance measures.
- Set up monitoring, alerting, and logging for data pipelines.
Our requirements
- 3+ years in data engineering, preferably supporting AI/ML applications.
- Proficiency in Python, SQL and vector database native languages.
- Experience with relational, NoSQL, vector databases, and Snowflake.
- Hands-on experience with AWS or Azure.
- Experience building scalable ETL/ELT workflows using dbt or Apache Airflow.
- Ability to design and integrate RESTful APIs.
- Understanding of encryption and role-based access controls.
- Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation).
- Experience working with AI-specific data needs such as embeddings and RAG.
- Experience with other data engineering tools.
- Interest in AI and staying up to date with latest advancements.
- Strong analytical and problem-solving skills.
- Excellent verbal and written communication skills.
- Detail-oriented and highly organized.
- Willing to learn and expand skill set.
- Ability to work collaboratively in a fast-paced, dynamic environment.
What we offer
- Work collaboratively in a fast-paced, dynamic environment.
- Opportunities to work with a new AI solutions development squad.
- Exposure to cutting-edge applications leveraging Large Language Models.