We are seeking an experienced and talented Senior Software Engineer with expertise in Python to support the AI platform team.
Our team is composed of data scientists, software engineers, and business analysts. We handle large-scale data for diverse use cases, utilizing both classical machine learning models and modern generative AI. We are expanding rapidly in areas like chatbots and agents, leveraging advanced technology in a cloud-native environment.
This position operates in a hybrid mode, requiring three days per week at our Krakow office.
responsibilities :
Design advanced prompts tailored for document understanding and data extraction use cases
Collaborate with business stakeholders to interpret document structures, semantics, and key-value relationships
Conduct PoCs (Proofs of Concept) using Python to test prompt effectiveness and adapt as needed
Build and maintain a prompt library with a focus on quality, reusability, and adherence to security and privacy guidelines
Validate prompts, stress test scenarios, and model failover strategies for different LLMs
Evaluate LLM output quality, refine prompts, and develop model-specific strategies
Coordinate with ML engineers on fine-tuning initiatives for improved accuracy in specific document domains
Document best practices, strategies, and experimental outcomes in a clear and organized format
Address risks related to prompt injection, hallucination, or other LLM vulnerabilities
requirements-expected :
Proven experience (2+ LLM production projects) designing and deploying prompts in practical applications
Excellent understanding of prompt structures and contexts
Proficiency in Python, including work with LLM APIs, prompt engineering frameworks, and data manipulation tools like Pandas
Experience with at least one fine-tuning or RAG pipeline implementation
Familiarity with prompt evaluation tools, metrics like BLEU, ROUGE, semantic similarity, and human-in-the-loop validation
Understanding of LLM-related security issues such as prompt injection, output filtering, and API constraints
Strong communication skills and ability to convert complex document requirements into actionable prompt logic
Analytical mindset with attention to both high-level design and output precision
offered :
Engineering community of industry professionals
Friendly team and enjoyable working environment
Flexible schedule and opportunity to work remotely within Poland
Chance to work abroad for up to 60 days annually
Business-driven relocation opportunities
Outstanding career roadmap
Leadership development, career advising, soft skills, and well-being programs
Certification (GCP, Azure, AWS)
Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru