Cited time in webofscience Cited time in scopus

Joint Optimization of Computational Accuracy and Algorithm Parameters for Energy-Efficient Recognition Algorithm

Title
Joint Optimization of Computational Accuracy and Algorithm Parameters for Energy-Efficient Recognition Algorithm
Alternative Title
에너지 효율적 인식알고리즘을 위한 알고리즘 파라매터와 계산의 정확도의 최적화
Author(s)
Lim, Hee Sung
DGIST Authors
Lim, Hee SungHwang, Jae YounMinkyu JePark, Tae Joon
Advisor
Hwang, Jae YounMinkyu Je
Co-Advisor(s)
Park, Tae Joon
Issued Date
2016
Awarded Date
2016. 2
Type
Thesis
Subject
artificial neural network (ANN)significant-driven iterative approximate multiplier (SDIAM)handwritten digit recognitionisolated spoken digit recognition. 경망곱셈기최적화문자인식음성인식
Abstract
The need for human-machine interaction such as speech and gesture recognition has steadily grown in wearable devices. As applications become more intelligent such as facial emotion recognition, a variety of recognition algorithms has been developed and evolving. However, as the recognition algorithms become more complex, the more computation is required to perform the application in a limited battery capacity of wearable devices, which means that energy-efficiency is critical issue. In this thesis, one of the widely used recognition algorithm, artificial neural network (ANN), is selected as a target algorithm and its characteristic, inherent algorithmic fault tolerance (AFT), is adopted to improve energy-efficiency. To compute the recognition algorithm (ANN), Significant-driven iterative approximate multiplier (SDIAM) is utilized. Motivated by the fact that both an iteration of multiplication and the number of hidden nodes play key roles for a trade-off between recognition accuracy and energy consumption, these two parameters are optimized for a minimum of energy consumption of ANN, allowing acceptable recognition accuracy. The evaluation shows that the joint optimization between the iteration of multiplication and the number of hidden nodes save 70% of the energy consumption, compared with using precise computation, at the same recognition accuracy target for both handwritten and isolated spoken digit recognition. Furthermore, adopting SDIAM in training phase, the recognition accuracy is more improved, which leads to 87% and 75% lower energy consumption for handwritten and isolated spoken digit recognition. ⓒ 2016 DGIST
Table Of Contents
I. Introduction 1--
II. Recognition Applications on Wearable Devices 4--
2.1. Trend on Recognition Applications 4--
2.1.1. Vision-Based Applications 4--
2.1.2. Sound-Based Application 5--
2.1.3. Other Sensor-Based Application 6--
2.2. Recognition Algorithms for Application 6--
2.2.1. Artificial Neural Network (ANN) 7--
2.2.2. Support Vector Machine (SVM) 8--
2.2.3. Hidden Markov Model (HMM) 9--
2.2.4. Deep Learning 10--
III. Artificial Neural Network 12--
3.1 Introduction to ANN 12--
3.2 Architecture and Feedforward Operation of ANN 12--
3.3 Learning Algorithm 14--
3.4 A demand for selecting the optimal number of hidden nodes 14--
IV. Energy-Efficient Hardware Accelerator for ANN 16--
4.1 Characteristics of ANN to apply SDIAM 16--
4.2 Significance-Driven Iterative Approximate Multiplier (SDIAM) 16--
4.2.1. Architecture and Operation of SDIAM 16--
4.2.2. Recognition Accuracy and Energy Consumptions 19--
4.3. Joint Optimization of N and n 19--
4.4 Training ANN with SDIAM 20--
V. Performance Evaluation 22--
5.1. Evaluation Methodology 22--
5.2. Evaluation 22--
VI. Related Works 30--
VII. Conclusion 32
URI
http://dgist.dcollection.net/jsp/common/DcLoOrgPer.jsp?sItemId=000002227453

http://hdl.handle.net/20.500.11750/1461
DOI
10.22677/thesis.2227453
Degree
Master
Department
Information and Communication Engineering
Publisher
DGIST
Related Researcher
  • 황재윤 Hwang, Jae Youn
  • Research Interests Multimodal Imaging; High-Frequency Ultrasound Microbeam; Ultrasound Imaging and Analysis; 스마트 헬스케어; Biomedical optical system
Files in This Item:
000002227453.pdf

000002227453.pdf

기타 데이터 / 1.23 MB / Adobe PDF download
Appears in Collections:
Department of Electrical Engineering and Computer Science Theses Master

qrcode

  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE