Convo AI Tester Lead - Manager

Total Exp: 8+ Yrs

Must Have

• Familiarity with the Conversational AI domain, conversational implementation and testing, customer experience metrics, and industry-specific challenges.
• Expertise in various NLU based testing methodologies, including conversational flow end to end testing, NLP and API testing, functional testing, regression testing, integration testing, performance testing, and user experience testing on Conversational AI systems
• Understanding of conversational (chats, emails, and calls) data to test and train Conversational AI systems
• Understanding the critical factors in Performance, Load, and Stress Testing for Platform Evaluation and Integration Assessment
• Understanding of cloud platforms (e.g., AWS, Azure, Google Cloud, Omilia Cloud Platform, Kore.ai, OneReach.ai, NICE, Salesforce, etc.) and their services for building and testing Conversational AI solutions for clients
• NLP and NLU Verticals Expertise: Text to Speech (TTS), Speech to Text (STT), SSML modeling, Intent Analytics, Proactive Outreach Orchestration, OmniChannel AI & IVR (incl.Testing), Intelligent Agent Assist, Contact Center as a Service (CCaaS), Modern Data for Conversational AI and Generative AI
• Familiarity with sentiment analysis, topic modeling, and text classification techniques
• Experience with test automation tools and frameworks, such as Cyara, Botium, Postman, Qmetry, Qtest, Selenium, IBM Watson Assistant Toolkits, Cognigy Test Case Builder or similar, to streamline and automate the testing process for chatbots.
• Strong problem-solving skills with the ability to identify, analyze, and troubleshoot issues encountered during testing
• Strong understanding of diverse testing methods across different devices to verify the Conversational AI system
• Proficiency in programming languages such as JavaScript
• Excellent communication skills
  

Nice To Have

• Proficiency in programming languages such as Python/Pyspark/R/SQL
• Proficiency in any of the data visualization tools like Tableau, Power BI, Quicksight and others
• Experience in survey analytics, organizational functions such as pricing, sales, marketing, operations, customer insights, etc.
  

Roles And Responsibilities

• Develop, evaluate, and execute on project test plans, test books to include details about unit testing, end to end testing and chatbot conversation transcripts under the guidance of project manager
• Analyze chatbot performance metrics and generate insightful reports for client presentations
• Collaborate and address identified issues with development and coach the junior team members
• Devise complex testing scenarios for quality delivery of products
• Identify and address potential vulnerabilities in Conversational AI system, ensuring data privacy and protection.
• Ability to test and deploy production ready code.
• Build storylines and make presentations for the client team and/or PwC project leadership team.
• Contribute to the knowledge and firm building activities