Development of novel conversational agent using retrieval-based model and deep learning

The exponential development of technology have altered the mindset and the direction of knowledge retrieval. The use of the conversational agent to convey information on hehalf of humans has gained attention and has been commonly used in e-commerce, culture, medical, and education. As a result, a co...

Full description

Saved in:

Bibliographic Details
Main Author:	Leong, Pui Huang
Format:	Thesis
Language:	English English
Published:	2021
Subjects:	Q Science (General) QA Mathematics
Online Access:	http://eprints.utem.edu.my/id/eprint/26096/1/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning.pdf http://eprints.utem.edu.my/id/eprint/26096/2/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning_unlocked%20%281%29.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-utem-ep.26096
record_format	uketd_dc
spelling	my-utem-ep.260962023-01-13T15:39:42Z Development of novel conversational agent using retrieval-based model and deep learning 2021 Leong, Pui Huang Q Science (General) QA Mathematics The exponential development of technology have altered the mindset and the direction of knowledge retrieval. The use of the conversational agent to convey information on hehalf of humans has gained attention and has been commonly used in e-commerce, culture, medical, and education. As a result, a conversational agent was incorporated to the corporate portal, similar to engaging with the professional advisor for customer support. Despite the popularity of the conversational agents, the underlying drawbacks such as manual knowledge base creation, query misinterpretation as well as massive human intervention were still inevitable. This work automated the conventional way of performing manual knowledge base creation through the use of knowledge crawler with a one-click solution. In addition, predefined recommendations with recent popularity were introduced to minimise human error and human effort in query generation to mifigate the misinterpretation of the request. Furthermore, this work aimed to exploit the use of Deep Leaming to generate own responses to unknown queries. This research relied on the Artificial Intelligence (AI) to include Natural Tanguage Processing (NLP) by providing a paradigm focused on Refrieval-based Model and Deep Learning. The Retrieval-based Model helped the conversation agent to create better representations to match intent and content to implicitly offer quicker and more reliable answers. In contrast, Deep Learning helped the conversation agent to make smarter and better decisions to have the ability to interpret and produce its own responses. The testing was performed in the quantitative approach using Black-box Test erience (UX) Testing. The findings revealed that the conversational age: 10 select the suitable model to undergo a series of response generation which have not been seen in the conventional conversational agents. The findings from the Black-box Testing indicates the average time taken for Retrieval-based Model to generate a response was less than one second whereas the average time taken for Deep Learning to generate a response was approximately 2 seconds, In terms of accuracy, Retrieval-based Model was able to achieve high performance with 100% accuracy for Frequently Asked Questions (FAQs), 90.63% accuracy for Common Knowledge and 67.65% accuracy for Deep Learning. Apart from this, the test results from user Experience Testing indicated that 84.3% of the respondents were satisfied with the conversational agent, whereas 86% of respondents would use this conversational agent again. Both the testing showed good outcomes and proof the success of this study with enormous contributions been made in the field of artificial conversational agent. Via this innovative approach, efficiency in the growing industry could rigorously improve and indirectly capable of atracting higher pools of individuals to satisfy the service provided. 2021 Thesis http://eprints.utem.edu.my/id/eprint/26096/ http://eprints.utem.edu.my/id/eprint/26096/1/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning.pdf text en public http://eprints.utem.edu.my/id/eprint/26096/2/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning_unlocked%20%281%29.pdf text en validuser https://plh.utem.edu.my/cgi-bin/koha/opac-detail.pl?biblionumber=121347 phd doctoral Universiti Teknikal Malaysia Melaka Faculty of Information and Communication Technology Goh, Ong Sing
institution	Universiti Teknikal Malaysia Melaka
collection	UTeM Repository
language	English English
advisor	Goh, Ong Sing
topic	Q Science (General) QA Mathematics
spellingShingle	Q Science (General) QA Mathematics Leong, Pui Huang Development of novel conversational agent using retrieval-based model and deep learning
description	The exponential development of technology have altered the mindset and the direction of knowledge retrieval. The use of the conversational agent to convey information on hehalf of humans has gained attention and has been commonly used in e-commerce, culture, medical, and education. As a result, a conversational agent was incorporated to the corporate portal, similar to engaging with the professional advisor for customer support. Despite the popularity of the conversational agents, the underlying drawbacks such as manual knowledge base creation, query misinterpretation as well as massive human intervention were still inevitable. This work automated the conventional way of performing manual knowledge base creation through the use of knowledge crawler with a one-click solution. In addition, predefined recommendations with recent popularity were introduced to minimise human error and human effort in query generation to mifigate the misinterpretation of the request. Furthermore, this work aimed to exploit the use of Deep Leaming to generate own responses to unknown queries. This research relied on the Artificial Intelligence (AI) to include Natural Tanguage Processing (NLP) by providing a paradigm focused on Refrieval-based Model and Deep Learning. The Retrieval-based Model helped the conversation agent to create better representations to match intent and content to implicitly offer quicker and more reliable answers. In contrast, Deep Learning helped the conversation agent to make smarter and better decisions to have the ability to interpret and produce its own responses. The testing was performed in the quantitative approach using Black-box Test erience (UX) Testing. The findings revealed that the conversational age: 10 select the suitable model to undergo a series of response generation which have not been seen in the conventional conversational agents. The findings from the Black-box Testing indicates the average time taken for Retrieval-based Model to generate a response was less than one second whereas the average time taken for Deep Learning to generate a response was approximately 2 seconds, In terms of accuracy, Retrieval-based Model was able to achieve high performance with 100% accuracy for Frequently Asked Questions (FAQs), 90.63% accuracy for Common Knowledge and 67.65% accuracy for Deep Learning. Apart from this, the test results from user Experience Testing indicated that 84.3% of the respondents were satisfied with the conversational agent, whereas 86% of respondents would use this conversational agent again. Both the testing showed good outcomes and proof the success of this study with enormous contributions been made in the field of artificial conversational agent. Via this innovative approach, efficiency in the growing industry could rigorously improve and indirectly capable of atracting higher pools of individuals to satisfy the service provided.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Leong, Pui Huang
author_facet	Leong, Pui Huang
author_sort	Leong, Pui Huang
title	Development of novel conversational agent using retrieval-based model and deep learning
title_short	Development of novel conversational agent using retrieval-based model and deep learning
title_full	Development of novel conversational agent using retrieval-based model and deep learning
title_fullStr	Development of novel conversational agent using retrieval-based model and deep learning
title_full_unstemmed	Development of novel conversational agent using retrieval-based model and deep learning
title_sort	development of novel conversational agent using retrieval-based model and deep learning
granting_institution	Universiti Teknikal Malaysia Melaka
granting_department	Faculty of Information and Communication Technology
publishDate	2021
url	http://eprints.utem.edu.my/id/eprint/26096/1/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning.pdf http://eprints.utem.edu.my/id/eprint/26096/2/Development%20of%20novel%20conversational%20agent%20using%20retrieval-based%20model%20and%20deep%20learning_unlocked%20%281%29.pdf
_version_	1776103137470316544

Development of novel conversational agent using retrieval-based model and deep learning

Similar Items