Your typical day with us will involve leading the development of user-facing conversational AI features, designing and testing reusable prompts as part of a broader system, and ensuring our AI applications are optimized for efficient, natural, and personalized conversational experiences in English and Japanese. You will collaborate closely with cross-functional teams to deliver scalable and flexible experiences, all while mentoring members of non-technical staff on prompt engineering best practices and contributing to the overall technical direction of the prompt engineering team.
Responsibilities
- Design, develop, and implement a series of dynamic prompts for our conversational AI applications, ensuring high performance, scalability, and user engagement.
- Contribute to and expand the design of a system of reusable, flexible prompts that prioritize scale and personalization across myriad tenants, industries, and modalities.
- Conduct recurring tests of prompt performance prior to implementation to properly set business expectations for quality, security, and cost by model, model provider, tenant, and industry.
- Participate in on-call monitoring of AI feature performance and remedy any issues that arise due to technical difficulties.
- Educate non-technical members of the organization on prompt engineering foundational concepts, best practices, and tool usage.
- Ensure the technical feasibility of feature requests from non-technical staff, collaborating closely with the business and product teams to deliver compelling and natural conversational user experiences.
- Gather feedback on product performance, user experience, language experience, and quality from technical and non-technical staff alike, and cleanly organize data into quickly digestible reports for executive management.
- Optimize prompt performance to ensure fast output times, API calls, and overall application responsiveness.
- Collaborate with backend engineers to define API requirements, ensuring seamless integration between prompts, third party model providers, and backend systems.
- Integrate closely with product leadership to shape the vision and roadmap for AI product functionality according to business needs and cutting-edge developments in generative AI.
- Stay updated with the latest trends and technologies in prompt engineering, prompt defense, and generative AI development, continuously improving the team’s skill set and technical direction.
- Participate in cross-functional meetings to align prompt engineering with product goals, business targets, and company objectives.
Requirements
- 2+ years of professional, corporate experience in conversation design, prompt engineering, or a similar role, with a strong focus on building large-scale, high-performance, conversational applications.
- Bachelor’s degree in Linguistics, Cognitive Science, Computer Science, Human Computer Interaction, Rhetoric, Communication, Performing Arts, Anthropology, or related field.
- Deep understanding of prominent, contemporary large language models (LLMs) and their providers, with a clear perspective on the advantages and disadvantages of the contracts, capabilities, and cost of each.
- Mastery in understanding the mechanics of language, with an awareness of analyzing one’s own bias around language style, dialect, and ideology.
- Ability to communicate effectively with cross-functional teams, providing clear technical guidance and recommendations through negotiation, presentation, and conference.
- Noted experience in crafting compelling presentation slides, clear business plans, and research documentation.
- Previous experience leading or mentoring a team, with a passion for knowledge sharing and team development.
Nice to haves
While not specifically required, tell us if you have any of the following.
- Hands-on experience with Python and related tools (VS Code, Postman).
- Advanced degree in Linguistics, Cognitive Science, Computer Science, Human Computer Interaction, Rhetoric, Communication, Performing Arts, Anthropology, or related field (Master’s degree, PhD).
- Demonstrated experience in conveying complex technical and sociolinguistic concepts to non-technical members of staff as related to business goals and objectives.
- Extensive experience in systems design, especially for enterprise applications.
- Native or business proficiency in Japanese language.
- Basic knowledge of AI ethics pertaining to user protections in the United States or Japan.
- Knowledge of backend technologies and how they integrate with prompt systems.
