Job Type
Job Details
At Jamf, people are at the core of everything we do. We do what’s right for our customers, our employees, our communities and our world. We take pride in simplifying technology for tens of thousands of customers around the globe and helping organizations succeed with Apple.
Jamf offers remote and hybrid positions. Depending upon the role, work in the office, connect 100% remote from your home, or find the blend that works best for you.
What you’ll do at Jamf:
The AI Quality and Safety Engineer is a specialized role dedicated to ensuring the highest standards of quality, effectiveness, safety, and reliability in our Large Language Model applications and features. This position involves creating and implementing robust testing frameworks, evaluating the performance and safety of AI-driven designs, and ensuring our products adhere to ethical AI practices. The role is central to our commitment to delivering innovative, user-centric, and responsible AI solutions.
What you can expect to do in this role:
- Develop and implement comprehensive testing strategies and frameworks for LLM features, focusing on functionality, performance, user experience, and safety.
- Design and conduct comparative analyses to evaluate different LLM designs, prompt strategies, and user interactions, ensuring the most effective and user-friendly implementations are identified.
- Take the lead on AI safety and responsibility initiatives, ensuring all LLM applications comply with ethical AI principles, data privacy standards, and regulatory requirements.
- Collaborate with AI researchers, product teams, and UX designers to integrate quality and safety considerations into the product development lifecycle from inception through deployment.
- Identify, document, and mitigate risks associated with LLM features, including bias, fairness, transparency, and potential misuse.
- Develop metrics and monitoring systems to continually assess the quality and safety of LLM applications in real-world scenarios, facilitating ongoing improvement.
- Stay abreast of the latest developments in AI ethics, safety research, and quality assurance methodologies, integrating cutting-edge practices into our QA processes.
- Serve as an internal advocate for responsible AI, educating and advising the team on best practices for ethical AI development and deployment.
What we are looking for:
- Proven experience in QA engineering, with a strong understanding of software testing methodologies and frameworks.
- Familiarity with AI and machine learning technologies, especially Large Language Models, including their design, capabilities, and limitations.
- Knowledge of AI ethics and safety principles, with the ability to translate these into practical testing and evaluation strategies.
- Excellent analytical and problem-solving skills, with a detail-oriented approach to identifying and addressing quality and safety issues.
- Strong communication skills, capable of effectively collaborating with cross-functional teams and articulating technical concepts to non-technical stakeholders.
- A commitment to lifelong learning, with a keen interest in staying updated on AI advancements, QA best practices, and ethical AI discussions.
- 2 year / Associates (Required)
- 4 year / Bachelors Degree (Preferred)
- A combination of relevant experience and education may be considered
Why Jamf?
-
We constantly push the boundaries of technology, our developers support new innovations and OS releases the moment they are made available by Apple.
-
Several Jamf engineers are named in patents and with team names like CatDog, ThunderSnow and Dalek you can expect to have some fun while building cutting-edge software.
-
You will have the opportunity to work with a small and empowered team where the culture is based on trust, ownership, and respect.
-
We offer a clear career path that enables you to grow under supportive leadership and management
-
Visit our Jamf Engineering blog to learn more about the innovative projects our team is working on and what we learn from each challenge we solve. A blog written by engineers, for engineers at medium.com/jamf-engineering
You Might Also Like
Sign up for our weekly remote work round-up newsletter and have new openings from companies that care delivered right to your inbox.