Data Scientist – Model Evaluation

21338836

Obowiązki

• Critically assessing and pushing the boundaries of generative AI models and tuning of such models, focusing on LLM models
• Establishing and upholding stringent quality benchmarks
• Collaborate with the research team to develop state-of-the-art NLP solutions utilizing LLM models

Wymagania

• Professional experience in AI/ML model development and evaluation with solid foundation in linear algebra, statistics, and optimization
• Familiar with automated ML models evaluations techniques, including Large Language Models (LLMs)
• Familiar with advanced model training methodologies including prompt tuning and fine-tuning with foundational models
• Proficient in Python, with experience in coding and debugging in Python and Jupyter Notebook
• Demonstrated ability to critically assess and challenge AI (including LLM) models to ensure optimal performance
• Fluent in written and spoken English

Źródło: IBM Polska/Praca