Off-campus WSU users: To download campus access dissertations, please use the following link to log into our proxy server with your WSU access ID and password, then click the "Off-campus Download" button below.
Non-WSU users: Please talk to your librarian about requesting this thesis through interlibrary loan.
Title
Nlubroker: A Qoe-Driven Evaluation And Broker System For Natural Language Understanding Services
Access Type
WSU Access
Date of Award
January 2020
Degree Type
Thesis
Degree Name
M.S.
Department
Computer Science
First Advisor
Weisong Shi
Abstract
Cloud-based Natural Language Understanding (NLU) services are becoming more popular with the development of artificial intelligence. More applications are integrated with cloud-based NLU services to enhance the way people communicate with machines. However, with NLU services provided by different companies powered by unrevealed AI technology, how to choose the best one is a problem for developers. Existing tools which can provide guidance to developers and make recommendations based on their needs are severely limited. In this paper, we comprehensively evaluate multiple state-of-the-art NLU services, and the results indicate that there is no absolute winner for different usage requirements. Motivated by this observation, we discuss five insights and propose NLUBroker, a QoE-driven broker system to select the proper service according to the environment. NLUBroker senses the client and service status and leverages a solution to the multi-armed bandit problem to conduct online learning, aiming to achieve maximum expected QoE. The performance of NLUBroker is evaluated in both simulation and real-world environments, and the evaluation results demonstrate that NLUBroker is an efficient solution for selecting NLU services. It is adaptive to changes in the environment, outperforms three baseline methods we evaluated and improves overall QoE up to 1.5X for the evaluated state-of-the-art NLU services.
Recommended Citation
Xu, Lanyu, "Nlubroker: A Qoe-Driven Evaluation And Broker System For Natural Language Understanding Services" (2020). Wayne State University Theses. 800.
https://digitalcommons.wayne.edu/oa_theses/800