Dissertations / Theses on the topic 'Model-Based Deep Learning'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the top 43 dissertations / theses for your research on the topic 'Model-Based Deep Learning.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Browse dissertations / theses on a wide variety of disciplines and organise your bibliography correctly.
Matsoukas, Christos. "Model Distillation for Deep-Learning-Based Gaze Estimation." Thesis, KTH, Skolan för elektroteknik och datavetenskap (EECS), 2019. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-261412.
Full textDen senaste utvecklingen inom djupinlärning har hjälp till att förbättra precisionen hos gaze estimation-modeller till nivåer som inte tidigare varit möjliga. Dock kräver djupinlärningsmetoder oftast både stora mängder beräkningar och minne som därmed begränsar dess användning i inbyggda system med små minnes- och beräkningsresurser. Det här arbetet syftar till att kringgå detta problem genom att öka prediktiv kraft i små nätverk som kan användas i inbyggda system, med hjälp av en modellkomprimeringsmetod som kallas distillation". Under begreppet destillation introducerar vi ytterligare en term till den komprimerade modellens totala optimeringsfunktion som är en avgränsande term mellan en komprimerad modell och en kraftfull modell. Vi visar att destillationsmetoden inför mer än bara brus i den komprimerade modellen. Det vill säga lärarens induktiva bias som hjälper studenten att nå ett bättre optimum tack vare adaptive error deduction. Utöver detta visar vi att MobileNet-familjen uppvisar instabila träningsfaser och vi rapporterar att den destillerade MobileNet25 överträffade sin lärare MobileNet50 något. Dessutom undersöker vi nyligen föreslagna träningsmetoder för att förbättra prediktionen hos små och tunna nätverk och vi konstaterar att extremt tunna arkitekturer är svåra att träna. Slutligen föreslår vi en ny träningsmetod baserad på hint-learning och visar att denna teknik hjälper de tunna MobileNets att stabiliseras under träning och ökar dess prediktiva effektivitet.
Lim, Steven. "Recommending TEE-based Functions Using a Deep Learning Model." Thesis, Virginia Tech, 2021. http://hdl.handle.net/10919/104999.
Full textMaster of Science
Improving the security of software systems has become critically important. A trusted execution environment (TEE) is an emerging technology that can help secure software that uses or stores confidential information. To make use of this technology, developers need to identify which pieces of code handle confidential information and should thus be placed in a TEE. However, this process is costly and laborious because it requires the developers to understand the code well enough to make the appropriate changes in order to incorporate a TEE. This process can become challenging for large software that contains millions of lines of code. To help reduce the cost incurred in the process of identifying which pieces of code should be placed within a TEE, this thesis presents ML-TEE, a recommendation system that uses a deep learning model to help reduce the number of lines of code a developer needs to inspect. Our results show that the recommendation system achieves high accuracy as well as a good balance between precision and recall. In addition, we conducted a pilot study and found that participants from the intervention group who used the output from the recommendation system managed to achieve a higher average accuracy and perform the assigned task faster than the participants in the control group.
Hellström, Terese. "Deep-learning based prediction model for dose distributions in lung cancer patients." Thesis, Stockholms universitet, Fysikum, 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:su:diva-196891.
Full textLi, Mengtong. "An intelligent flood evacuation model based on deep learning of various flood scenarios." Doctoral thesis, Kyoto University, 2021. http://hdl.handle.net/2433/263634.
Full textKarlsson, Axel, and Bohan Zhou. "Model-Based versus Data-Driven Control Design for LEACH-based WSN." Thesis, KTH, Maskinkonstruktion (Inst.), 2020. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-272197.
Full textI samband med det ökande intresset för att implementera så kallade smart cities, har användningen av utbredda trådlösa sensor nätverk (WSN) blivit ett intresseområde. Bland applikationens största utmaningar, finns det fortfarande förbättringar med avseende på energiförbrukning och servicekvalité. Därmed så inriktar sig detta projekt på att utforska en mängd möjliga lösningar för att förbättra energieffektiviteten för dataaggregation inom WSN. Detta gjordes genom att strategiskt justera positionen av den mottagande basstationen samt paketfrekvensen för varje nod. Dessutom påbyggdes low-energy adaptive clustering hierarchy (LEACH) protokollet med WSN:ets laddningstillstånd. För detta examensarbete definierades ett WSN som ett två dimensionellt plan som innehåller sensor noder och en mobil basstation, d.v.s. en basstation som går att flytta. Efter rigorös analys av klustringsmetoder samt dynamiken av ett WSN, utvecklades två kontrollmetoder som bygger på olika kontrollstrategier. Dessa var en modelbaserad MPC kontroller och en datadriven reinforcement learning kontroller som implementerades för att förbättra energieffektiviteten i WSN. För att testa prestandan på dom två kontrollmetoderna, utvecklades en simulations platform baserat på Python, tillsamans med påbyggnaden av LEACH protokollet. Mängden data skickat per energienhet användes som index för att approximera kontrollprestandan. Simuleringsresultaten visar att den modellbaserade kontrollern kunde öka antalet skickade datapacket med 22% jämfört med när LEACH protokollet användes. Medans den datadrivna kontrollern hade en sämre prestanda jämfört med när enbart LEACH protokollet användes men den visade potential för WSN med en mindre storlek. Påbyggnaden av LEACH protokollet gav ingen tydlig ökning med avseende på energieffektiviteten p.g.a. en mängd avvikande resultat.
Lai, Khai Ping. "A deep learning model for automatic image texture classification: Application to vision-based automatic aircraft landing." Thesis, Queensland University of Technology, 2016. https://eprints.qut.edu.au/97992/4/Khai_Ping_Lai_Thesis.pdf.
Full textKeisala, Simon. "Using a Character-Based Language Model for Caption Generation." Thesis, Linköpings universitet, Interaktiva och kognitiva system, 2019. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-163001.
Full textMa, Xiren. "Deep Learning-Based Vehicle Recognition Schemes for Intelligent Transportation Systems." Thesis, Université d'Ottawa / University of Ottawa, 2021. http://hdl.handle.net/10393/42247.
Full textLiu, Rongrong. "Multispectral images-based background subtraction using Codebook and deep learning approaches." Thesis, Bourgogne Franche-Comté, 2020. http://www.theses.fr/2020UBFCA013.
Full textThis dissertation aims to investigate the multispectral images in moving objects detection via background subtraction, both with classical and deep learning-based methods. As an efficient and representative classical algorithm for background subtraction, the traditional Codebook has first been extended to multispectral case. In order to make the algorithm reliable and robust, a self-adaptive mechanism to select optimal parameters has then been proposed. In this frame, new criteria in the matching process are employed and new techniques to build the background model are designed, including box-based Codebook, dynamic Codebook and fusion strategy. The last attempt is to investigate the potential benefit of using multispectral images via convolutional neural networks. Based on the impressive algorithm FgSegNet_v2, the major contributions of this part lie in two aspects: (1) extracting three channels out of seven in the FluxData FD-1665 multispectral dataset to match the number of input channels of the deep model, and (2) proposing a new convolutional encoder to utilize all the multispectral channels available to further explore the information of multispectral images
Rossi, Alex. "Self-supervised information retrieval: a novel approach based on Deep Metric Learning and Neural Language Models." Master's thesis, Alma Mater Studiorum - Università di Bologna, 2021.
Find full textVellala, Abhinay. "Genre-based Video Clustering using Deep Learning : By Extraction feature using Object Detection and Action Recognition." Thesis, Linköpings universitet, Statistik och maskininlärning, 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-176942.
Full textMendes, David, M. J. Lopes, Artur Romão, and Irene Pimenta Rodrigues. "Healthcare Computer Reasoning Addressing Chronically Ill Societies Using IoT: Deep Learning AI to the Rescue of Home-Based Healthcare." Bachelor's thesis, IGI Global, 2016. http://hdl.handle.net/10174/19286.
Full textSievert, Rolf. "Instance Segmentation of Multiclass Litter and Imbalanced Dataset Handling : A Deep Learning Model Comparison." Thesis, Linköpings universitet, Datorseende, 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-175173.
Full textLiu, Zheng-Wei, and 劉政威. "Waterfall Model for Deep Reinforcement Learning Based Scheduling." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/a3yn5q.
Full text國立中央大學
通訊工程學系在職專班
107
The fourth generation of communication systems has been able to meet the multimedia application needs of mobile devices. Through the scheduling service provided by the base station, the user equipment can obtain the data packets required by the downlink of the communication system to meet and obtain better application services, so the channel resources are allocated and the calculation of the user group scheduling service is provided. The law is quite critical. This paper implements a mobile communication scheduling learning platform, and proposes a Deep Deterministic Policy Gradient model. The waterfall model concept is used to analyze the scheduling algorithm flow into three stages: sorting selection, resource evaluation and channel allocation. A waterfall scheduling method that enables more data throughput per unit time and meets more user needs in the current communication environment. The mobile communication scheduling learning platform is composed of six modular components: base station and channel resources, enhanced learning neural network, user equipment attributes, application service types, environmental information and reward functions, and phase micro-algorithms and dependency injection. . Using inversion control and dependency injection to reduce platform software coupling, it is quite easy to maintain the stage micro-algorithm and the six module components.
Chang, Chao-Mei, and 張昭美. "Taiwanese speech commands recognition model based on deep learning." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/knb7ws.
Full text國立交通大學
資訊學院資訊學程
107
Most of the recent machine learning papers are aimed at images and videos, such as face recognition, large image database identification, unmanned autopilot, object recognition, AlphaGo, object movement trajectory prediction, changing image style and creating virtual portrait style-based GAN. However, due to the development trend of voice assistants, it is necessary to closely cooperate with local language materials and culture habits. Therefore, the focus is on local language audio processing and machine learning . Benefiting from the prosperous deep learning progress, diverse languages are no longer an obstacle to communication, but rather a manifestation of diverse cultures. It is time to pay attention to regional languages such as Taiwanese. The paper uses a variety of audio pre-processing and CNN, LSTM, GRU and other attempts to use the depth model. 1. Taiwanese speech command recognition. 2. Specific Taiwanese speech keyword trigger. 3. Identify the audio segment between Mandarin and Taiwanese. 4. Use AI to write Taiwanese local drama. Finally, it is applied to the Android mobile app, so that the user can use the voice "góabeh" (I want to) "khuànn-siòng-phìnn" (See photo), "thian-im-ga̍k" (Listen to music), "khà-tiān-uē" (Make a phone call), "hip-siàng" (Photograph) evokes the corresponding application.
Huang, Kuang-Chieh, and 黃冠傑. "Predicting Remaining Useful Life of Equipment based on Deep Learning-based Model." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/2bd366.
Full text元智大學
資訊管理學系
106
With the development of smart manufacturing, in order to instantly detect abnormal conditions of the equipment, a large number of sensors were built to record the variables associated with the collection of production equipment. This research focuses on the remaining useful life(RUL)prediction. Remaining useful life is a part of the predictive maintenance(PDM), it is condition based, according to the development trend of the machine in the past to detect the machine is going to malfunction, our purpose is to detect early that the machine needs to be replaced or repaired to ensure the sustainability of the system. Existing literature methods are often difficult to extract meaningful features from sensing data. This research proposes a deep learning method, constructing an autoencoder gated recurrent unit (AE-GRU) neural network model, autoencoder extracts the important features from the raw data and gated recurrent unit picks up the information of the sequences to forecasting remaining useful life precisely. In the experiment of this research, we use for the prognostics challenge competition at the IEEE International Conference on Prognostics and Health Management (PHM08) and evaluated by 5 folds cross-validation. In the verification of root mean square error(RMSE) in our experiments, our method is better than other methods, such as deep neural network(DNN)、recurrent neural network(RNN)、long short-term memory neural network(LSTM)、gated recurrent unit neural network(GRU).
HUANG, PO-YU, and 黃柏毓. "Predicting Social Insurance Payment Behavior Based on Deep Learning Model." Thesis, 2017. http://ndltd.ncl.edu.tw/handle/04210692742079168717.
Full text逢甲大學
資訊工程學系
105
The social insurance is an important part of the social security system. In Taiwan, the social insurance system is classified by occupational groups and managed by different government agencies. According to the Executive Yuan of Taiwan, this pension system includes five separate social insurance programs covering public servants and teachers, laborers, military personnel, farmers, and a national pension insurance program for those not covered by the above four employment-based categories. Ministry of Health and Welfare in Taiwan is responsible for many types of social insurances like National Pension Insurance, National Health Insurance and Long-term Care Services Program. In addition, Ministry of Health and Welfare provides subsidized health insurance coverage for the underprivileged and ensures that senior citizens with no employment-based retirement benefits will still have the basic economic necessities in their elderly life. Unfortunately, most social insurances are impacted by various problems and have been facing the crisis of pension bankruptcy. Althougth the traditional actuarial methods use many hypotheses to analyze cash flow, they mostly focus on trend analysis with a macro view of the participants. Due to a large number of the insured, it is very hard to predict the payment behavior of each individual. To make better prediction, we propose to build payment behavior models based on machine learning technology to predict personal payment behavior accurately. Using the number of the participants for each personal payment behavior and corresponding insurance premiums, we can make better cash flow prediction in order to help the social insurance operations become sustainable. This research uses the seven year's data from Taiwan's National Pension Insurance as the source of experimental data. With the implementation of deep learning model, we could analyze and predict the future payment behaviors of the insured.
Chung, Hao-Ting, and 鐘皓廷. "Building Student Course Performance Prediction Model Based on Deep Learning." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/m2z8n3.
Full text國立臺北科技大學
資訊工程系
106
The deferral of graduation rate in Taiwan’s universities is estimated 16%, which will affect the scheduling of school resources. Therefore, if we can expect to take notice of students’ academic performance and provide guidance to students who cannot pass the threshold as expected, we can effectively reduce the waste of school resources. In this research, we use recent years’ student data attributes and course results as training data to construct student performance prediction model. The K-Means algorithm was used to classify all courses from the freshman to the senior. The related courses will be grouped in the same cluster, which will more likely to find similar features and improve the accuracy of the prediction. Then, this research constructs independent neural networks for each course according to the different academic year. Each model will be pre-trained by using De-noising Autoencoder. After pre-training, the corresponding structure and weights are taken as the initial value of the neural network model. Each neural network is treated as a base predictor. All predictors will be integrated into an Ensemble predictor according to different years’ weights to predict the current student’s course performance. As the students finish the course at the end of each semester, the prediction model will continue track and update to enhance model accuracy through online learning.
Huang, Chu-Chih, and 黃炬智. "Classification of Chinese Articulation Disorder based on Deep Learning Model." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/3v7km6.
Full text國立臺灣科技大學
電子工程系
107
Articulation disorder means having difficulties during pronunciations, leading to incorrect articulations and unclear sentences. Articulation disorder has been a common child language issue. Currently, there is no any unified sayings for articulation disorder's classification in the Taiwan's medical field. Thus, a speech therapist is required for analysis and treatment in hospitals. After a series of pronunciations, a speech therapist will make an analysis based on children's pronunciations. Children will return to the hospitals for months continuously to improve their conditions. Nevertheless, the treatment can only benefit children with articulation disorder by receiving treatments in hospitals, slowing down the treatment cycle. The purpose of this work is to automate the diagnosis for articulation disorder by combining the latest AI's convolutional neural network (CNN). Results show that LeNet-5 which achieved 94.56 Top-1 accuracy and 0.995 avg F1-score with the smallest model size is more suitable to apply articulations disorder application on mobile devices.
LIN, HAN-LONG, and 林翰隆. "Building Graduate Salary Grading Prediction Model Based on Deep Learning." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/z4hkqx.
Full text國立臺北科技大學
資訊工程系
107
This paper used deep learning to build a salary grading prediction model. Due to the order relationship between each grading of salary grading, this paper regards this kind of problem as an ordinal regression problem. This paper used multiple output deep neural network to solve the ordinal regression problem so that the network learns the correlation between these salary grading during training. This model is pre-trained using Stacked De-noising Autoencoder. After pre-training, the corresponding weights are taken as the initial weights of neural network. During training, this paper used the Dropout and Bootstrap Aggregating to improve model performance. This model used the graduates’ personal information, grades, and family data as input feature, and predict salary grading of graduating or graduated students. This result will be provided to the school researchers to grasp the salary trend.
CHEN, LI-TENG, and 陳立騰. "Image Caption Generation Based on Deep Learning and Visual Attention Model." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/v6g3tp.
Full text國立雲林科技大學
電機工程系
106
In this thesis, we develop an image caption generation based on deep learning and visual attention model. This system is composed of several parts: object detection, saliency computation, and image caption generation. In the object detection part, a deep learning technique, Faster R-CNN, is used to detect and classify objects in images. A pre-trained model can classify 80 categories for image classification. In the saliency computation, the pre-training model proposed in [8] is to compute the saliency value of each ROI image. According to category information and saliency value, the proposed system can generate the corresponding image caption. To evaluate the performance of the proposed system, the COCO 2014 image set is used. There are 30,000 images in the COCO 2014 image set. For image caption, the BLEU value of the proposed system is higher than that of [11]. Experimental results show that the proposed system is superior to the existing method [11].
CHUANG, YU-HAO, and 莊友豪. "Automatic Mobile Online Game Bot Detection Model Based on Deep Learning." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/bxryp2.
Full text國立臺北大學
資訊工程學系
106
The excessive flooding of game bot causes the imbalances in mobile online games and even shortens the life cycle of mobile online games. The random forest algorithm is a general solution to identify game bot through behavioral features. Although the random forest algorithm can detect most game bot exactly, however, there are some players belonging to gray zone that cannot be detected accurately. Therefore, in this paper, we propose a deep learning based game bot detection approach, collecting players’ data and extracting the features to build the multilayer perceptron model as the detection standard. We use different methods to design four sets training parameters, and then choose the best performance training parameters as our deep learning model approach baseline. This approach is implemented on the mobile online game named KANO and the model calculates each data's probability. Then we count every probability’s number and search the data in the middle, through the algorithm to define the detecting bot critical value. The experimental result displays the proposed model has better performance, reducing the error rate from 6.218% to 2.53% and increasing the accuracy from 95.2% to 99.894% as compared with the random forest model in the same players’ data. And the training data’s critical value has very little difference with the testing data’s critical value. Thus our model can detect bot players more accurately and has lower false negative and false positive.
LIU, ZHI-YONG, and 劉志勇. "Development and Performance Verification of Cognitive Diagnosis Model based on Deep Learning." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/s6t3jr.
Full text國立臺中教育大學
教育資訊與測驗統計研究所
107
Deep learning has brought breakthrough development in many fields such as a convolutional neural network for image recognition, long short-term memory networks for speech and natural language processing, word2vec model for produces word vectors, generative adversarial network, and deep reinforcement learning. In this study, Autoencoder algorithm is applied to develop a deep learning cognitive diagnosis model (DLCD). Traditional cognitive diagnosis models, such as DINA and G-DINA, require parameter estimation through the expectation-maximization algorithm or Markov chain Monte Carlo method. DLCD is used to improve the problem that traditional cognitive diagnosis models require large samples for estimation. The research methods are divided into three parts, Q matrix research, simulation research, and real data research. DLCD not only work well both on a complete Q matrix and a non-complete Q matrix but also demonstrates the most favorable generalization ability. The proposed method outperforms DINA and G-DINA in simulated research when the sample size is small. Moreover, DLCD has the highest classification agreement on real data research. Based on the results of simulated and real data sets, DLCD is suitable for small-class teaching and even for only one examinee.
CHUANG, YI-TING, and 莊宜庭. "A PM2.5 Prediction Model Based on Deep Learning with Recurrent Neural Network." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/sfu623.
Full text東海大學
資訊管理學系
107
In recent years, many studies have verified that air pollution will seriously affect human health. In addition, the media reported many issues concerning air pollution, so people have begun to pay attention to its existence. This study analyzes the data of the Environmental Protection Administration air quality immediate pollution indicators in 2018. Five methods are used to deal with the missing values. The main correlation variables affecting the PM25 concentration are identified by principal component analysis and correlation coefficients (single factor: PM10, SO2, NOX, NO2, CO, two-factor: NOX+NO2+CO, SO2+PM10), and the Long-Short Term Memory Model (LSTM) of the Recurrent Neural Network (RNN) was used to model the PM25 concentration model for the next 8 hours. According to the research results, most of the errors between the predicted and true values of Fengyuan Station fall within the reasonable range of MAPE (0.2~0.5). In addition, the best way to deal with the missing value is linear interpolation.
LI, CHEN-YU, and 李振宇. "A Study on Deep Learning based Blind Guidance Model Building for Smart Device." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/nuje9f.
Full text逢甲大學
資訊工程學系
107
In the field of machine learning and data science, smart navigation device is a trend. More and more smart devices are designed for blind people, and the core of the visual aid is usually realized by image recognition. There are many tools and machine learning platforms for the construction of image recognition model, but these tools couldn’t satisfy the requirements of the visual aid devices. In order to construct a visual aid device, an ability of reducing the cost of model training and portability of the image recognition visual aid device are the main problems. System needs to remind and warn user in immediate danger situation, such as the car, the traffic light, and the indoor space obstacle or helping blind people find indoor objects efficiently and quickly. Therefore, in order to solve these problems, we proposed deep learning-based Blind Guidance framework. YOLO (Real-Time Object Detection) is currently the fastest detection, high accuracy and low training detection method, which is used to reduce the cost of model training. For portability of the image recognition visual aid device, the system needs to calculate deep learning and low power capability embedded devices, NVIDIA Jetson TX2 solves the problem of portability image recognition equipment. For the experiments, we evaluated our proposed framework with 4,853 images. The experimental results show that our proposed system suitable for blind people currently.
CHEN, TAI-RONG, and 陳泰融. "A Preliminary Study on Deep Learning Neural Networks-based multi-model Sentiment Detection." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/x5399c.
Full text國立臺北科技大學
電子工程系
107
To celebrate the 50th anniversary of the moon landing program, University of Texas atDallas (UT Dallas) will be on the NASA Apollo program, Recording of communicationdialogues between all NASA Apollo program, provide Feeless Steps Corpus, the first heldFearless Steps Challenge Tournament, Further exploring the intricate communicationcharacteristics of problem solving on the scale as complex as going to the moon can lead to thedevelopment of novel algorithms beneficial for speech processing and conversationalunderstanding in challenging environments. This thesis focuses on the speech sentimentdetection tasks. Consider speech processing on the acoustics and Semantic meaning, propose aPreliminary Study on Deep Learning Neural Networks-based multi-model Sentiment Detection,Detect sentiment in speech signals, specific practice include (1) using the Convolutional NeuralNetwork (CNN) to automatically extract sentiment feature parameters from the acousticspectrum, and (2) Bidirectional Encoder Representation from Transformers (BERT).Combinethe characteristics of both to enhance the systems sentiment detection performance. The finalofficial competition found that, our system's sentiment detection accuracy rate 73.11%, rank 3in all teams submitting 20 results, exceed the baseline reference system (49.75%), Gap with thechampion (74.07%) 1%
Rizqi, Diwanda Ageng, and Diwanda Ageng Rizqi. "A Skill Transfer Support Model Based on Deep Learning in Human-machine Interaction." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/9h698z.
Full text國立臺灣科技大學
工業管理系
107
The shift paradigm toward Industry 4.0 is not solely completed by enabling smart machines in a factory, but enabling human capability. Refinement of work processes and introduction of new training approaches are needed to support efficient human skill development and transfer. This study proposes a new skill transfer support model in a manufacturing scenario. The proposed model uses two types of deep learning as the backbone: a convolutional neural network for action recognition and a faster region-based convolutional neural network for object detection. In this study, to evaluate the performance of the prosed model, a case study using toy assembly was conducted and they are recorded using two cameras with different angle. The accuracy for CNN and faster R-CNN is 94.5% and 99% respectively. A junior operator is guided by the proposed model as doing flexible assembly tasks based on the skill representation that has been constructed. In terms of theoretical contribution, this study integrated two deep learning models which can simultaneously recognize the action and detect the object. The contribution of the present study is to facilitate advanced training in manufacturing in terms of adapting new skills for their operators.
Lin, Tzu-Yang, and 林子揚. "Robust Vision-Based Daytime Vehicle Brake Light DetectionUsing Two-Stage Deep Learning Model." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/9m435s.
Full text元智大學
電機工程學系
106
In the modern age of advanced automotive technology and deep learning, most people have owned their own vehicle and each car is more and more equipped. The Advanced Driving Assistance System (ADAS) has gradually become a basic equipment for vehicles. In this environment, the development value of Internet of Vehicle is also increasing. If you can inform the driver of the driving conditions near the vehicle through the Internet of Vehicle, you can avoid most of the accidents. Today's ADAS functions can be divided into active control, early warning and other auxiliary three major categories, including Adaptive Cruise Control (ACC), Autonomous Emergency Braking (AEB), Forward Collision Warning (FCW), which uses radar and some sensors to measure the distance between itself and the front, and uses this as a parameter for analysis. However, in addition to the distance, if it is possible to know the information of the vehicle in front of the vehicle in a timely manner and transmit the real-time vehicle information of the vehicle in front through the Internet of Vehicle, it will be possible to more accurately determine the driving conditions of the surrounding vehicles. Therefore, we combined the latest object detection network and classification network and proposed an daytime vehicle brake light detection system that uses a single image as the input and does not require tracking. The screen of the general driving recorder is used as input, and the candidate area of the rear vehicle is found through the first stage of vehicle detection. Then the candidates are put into the second stage of the vehicle brake light recognition network to get the results. The experimental results show that our proposed system can achieve very high resolution under various weather conditions.
Huang, I.-Hang, and 黃一航. "Development of the rainfall-runoff model based on Multi-Agents Deep Reinforcement Learning." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/42p9m9.
Full text國立臺灣大學
土木工程學研究所
107
Rainfall-runoff models are commonly classified into three categories, namely: physical-based, conceptual and empirical models to implement in hydraulic structure designing and researches. Physical-based models are restricted by geographic information and over-complex operations. Empirical models adopt several empirical equations to construct the correlation of inputs and outputs at outflow control section, but empirical models sometimes are distrusted due to the black box characteristics. A reasonable way to retain the advantages and improve the drawbacks of both physical-based and empirical models is constructing a rainfall-runoff model with novel algorithms. Therefore, this study presents a novel Multi-Agents system Deep Reinforcement Learning (MAS-DRL) that is capable of understanding the hydrological process through water units and reducing physical operations. The behavior of a water unit and interaction between water units can be simulated by Deep Reinforcement Learning and the Multi-Agents system, respectively. Designed cases are conducted to clearly demonstrate the advantage of the MAS-DRL model. To approximate the actual basin, the topographies are settled based on the Shihmen Reservoir basin (Taiwan), and rainfall events are designed due to the precipitation standards that were settled by Central Weather Bureau, respectively. The Eagleson Dynamic Wave solution (Eagleson solution) and SOBEK are constructed as comparison models. The results reveal that with increasing rounds of training, the simulated discharge resulting from the MAS-DRL model gradually closes to the results simulated from Eagleson solution regardless of the rainfall event. In summary, this study proposes a novel MAS-DRL model, which simulates the behavior of a water unit and interaction between water units to understand the hydrological process and reproduces physical operation. The proposed modeling technique could be help to future use of DRL in hydrology.
HUANG, WEN-SHENG, and 黃玟勝. "Hash code generation based on deep learning and visual attention model for image retrieval." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/er59ds.
Full text國立雲林科技大學
電機工程系
106
In this thesis, we develop a hash code generation based on deep learning and visual attention model for image retrieval. This system is composed of several parts: object detection, saliency computation, and hash code generation. In the object detection part, a deep learning technique, Faster R-CNN, is used to detect and classify objects in images. A pre-trained model can classify 20 categories for image classification. In the saliency computation, the pre-training model proposed in [26] is to compute the saliency value of each object. According to category information and saliency value, the proposed system can generate the corresponding hash code. To evaluate the performance of the proposed system, the PASCAL VOC image set is used. There are 27088 images in the PASCAL VOC image set. For image retrieval, the nDCG value of the proposed system is higher than that of [29]. Experimental results show that the proposed system is superior to the existing method [29]. Keywords: object detection, visual attention, hash code
Cruz, Rui Francisco Pereira Moital Loureiro da. "Fine-tuning a transformers-based model to extract relevant fields from invoices." Master's thesis, 2021. http://hdl.handle.net/10362/130277.
Full textExtraction of relevant fields from documents has been a relevant matter for decades. Although there are well-established algorithms to perform this task since the late XX century, this field of study has again gathered more attention with the fast growth of deep learning models and transfer learning. One of these models is LayoutLM, which is a Transformer-based architecture pre-trained with additional features that represent the 2D position of the words. In this dissertation, LayoutLM is fine-tuned on a set of invoices to extract some of its relevant fields, such as company name, address, document date, among others. Given the objective of deploying the model in a company’s internal accountant software, an end-to-end machine learning pipeline is presented. The training layer receives batches with images of documents and their corresponding annotations and fine-tunes the model for a sequence labeling task. The production layer inputs images and predicts the relevant fields. The images are pre-processed extracting the whole document text and bounding boxes using OCR. To automatically label the samples using Transformers-based input format, the text is labeled using an algorithm that searches parts of the text equal or highly similar to the annotations. Also, a new dataset to support this work is created and made publicly available. The dataset consists of 813 pictures and the annotation text for every relevant field, which include company name, company address, document date, document number, buyer tax number, seller tax number, total amount and tax amount. The models are fine-tuned and compared with two baseline models, showing a performance very close to the presented by the model authors. A sensitivity analysis is made to understand the impact of two datasets with different characteristics. In addition, the learning curves for different datasets define empirically that 100 to 200 samples are enough to fine-tune the model and achieve top performance. Based on the results, a strategy for model deployment is defined. Empirical results show that the already fine-tuned model is enough to guarantee top performance in production without the need of using online learning algorithms.
(5929469), Hani A. Almansouri. "Model-Based Iterative Reconstruction and Direct Deep Learning for One-Sided Ultrasonic Non-Destructive Evaluation." Thesis, 2019.
Find full textOne-sided ultrasonic non-destructive evaluation (UNDE) is extensively used to characterize structures that need to be inspected and maintained from defects and flaws that could affect the performance of power plants, such as nuclear power plants. Most UNDE systems send acoustic pulses into the structure of interest, measure the received waveform and use an algorithm to reconstruct the quantity of interest. The most widely used algorithm in UNDE systems is the synthetic aperture focusing technique (SAFT) because it produces acceptable results in real time. A few regularized inversion techniques with linear models have been proposed which can improve on SAFT, but they tend to make simplifying assumptions that show artifacts and do not address how to obtain reconstructions from large real data sets. In this thesis, we present two studies. The first study covers the model-based iterative reconstruction (MBIR) technique which is used to resolve some of the issues in SAFT and the current linear regularized inversion techniques, and the second study covers the direct deep learning (DDL) technique which is used to further resolve issues related to non-linear interactions between the ultrasound signal and the specimen.
In the first study, we propose a model-based iterative reconstruction (MBIR) algorithm designed for scanning UNDE systems. MBIR reconstructs the image by optimizing a cost function that contains two terms: the forward model that models the measurements and the prior model that models the object. To further reduce some of the artifacts in the results, we enhance the forward model of MBIR to account for the direct arrival artifacts and the isotropic artifacts. The direct arrival signals are the signals received directly from the transmitter without being reflected. These signals contain no useful information about the specimen and produce high amplitude artifacts in regions close to the transducers. We resolve this issue by modeling these direct arrival signals in the forward model to reduce their artifacts while maintaining information from reflections of other objects. Next, the isotropic artifacts appear when the transmitted signal is assumed to propagate in all directions equally. Therefore, we modify our forward model to resolve this issue by modeling the anisotropic propagation. Next, because of the significant attenuation of the transmitted signal as it propagates through deeper regions, the reconstruction of deeper regions tends to be much dimmer than closer regions. Therefore, we combine the forward model with a spatially variant prior model to account for the attenuation by reducing the regularization as the pixel gets deeper. Next, for scanning large structures, multiple scans are required to cover the whole field of view. Typically, these scans are performed in raster order which makes adjacent scans share some useful correlations. Reconstructing each scan individually and performing a conventional stitching method is not an efficient way because this could produce stitching artifacts and ignore extra information from adjacent scans. We present an algorithm to jointly reconstruct measurements from large data sets that reduces the stitching artifacts and exploits useful information from adjacent scans. Next, using simulated and extensive experimental data, we show MBIR results and demonstrate how we can improve over SAFT as well as existing regularized inversion techniques. However, even with this improvement, MBIR still results in some artifacts caused by the inherent non-linearity of the interaction between the ultrasound signal and the specimen.
In the second study, we propose DDL, a non-iterative model-based reconstruction method for inverting measurements that are based on non-linear forward models for ultrasound imaging. Our approach involves obtaining an approximate estimate of the reconstruction using a simple linear back-projection and training a deep neural network to refine this to the actual reconstruction. While the technique we are proposing can show significant enhancement compared to the current techniques with simulated data, one issue appears with the performance of this technique when applied to experimental data. The issue is a modeling mismatch between the simulated training data and the real data. We propose an effective solution that can reduce the effect of this modeling mismatch by adding noise to the simulation input of the training set before simulation. This solution trains the neural network on the general features of the system rather than specific features of the simulator and can act as a regularization to the neural network. Another issue appears similar to the issue in MBIR caused by the attenuation of deeper reflections. Therefore, we propose a spatially variant amplification technique applied to the back-projection to amplify deeper regions. Next, to reconstruct from a large field of view that requires multiple scans, we propose a joint deep neural network technique to jointly reconstruct an image from these multiple scans. Finally, we apply DDL to simulated and experimental ultrasound data to demonstrate significant improvements in image quality compared to the delay-and-sum approach and the linear model-based reconstruction approach.
LIN, YUN, and 林昀. "Auto-pilot Model Car Based on Raspberry Pi Embedded System with Neural Compute Stick using Deep Learning Model." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/deje4w.
Full text國立臺北科技大學
車輛工程系
107
In this study explores Donkey Car as an open source experimental platform for automated radio-controlled cars, based on the Python language, using machine learning and computer vision to drive radio-controlled cars in the Raspberry Pi 3 Model B + for automated cars platform. Through this experimental platform, deep learning is applied to automated radio-controlled cars. Donkey Car is a comprehensive experimental platform that combines a deep learning framework with a Raspberry Pi control board, which is the user first uses the joystick to control the radio-controlled cars in the lane, besides recording the image information and the joystick information. And then inputting the data information into the deep learning framework, which applies the data to train an automated model, includes identifying useful features in the image and making appropriate steering in response to the features, and continuing to collect information, train the model, and test the motion of the radio-controlled cars until the desired result is met. Because of the limited CPU computing power of the Raspberry Pi, this experiment is equipped with Intel neural compute stick to improve the performance of its computing, and use the YOLOv2 target detection to identify obstacles in front of the vehicle to improve autonomous driving application and performance.
Ping-WeiSoh and 蘇評威. "Adaptive Deep Learning-based Air Quality Prediction Model Using the Most Relevant Spatial-Temporal Relations." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/r38wfv.
Full textChiu, Yu-Chang, and 邱裕樟. "A Direct Marketing Approach with Deep Learning in E-Commerce: Review-Based Text Generation Model." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/65y4d3.
Full textYANG, HAO-XIANG, and 楊皓翔. "Surface Defect Detection of Scarce Samples Based on Deep Learning Model and Generative Adversarial Network." Thesis, 2019. http://ndltd.ncl.edu.tw/handle/evzn27.
Full text國立臺北科技大學
自動化科技研究所
107
In traditional automated optical inspection (AOI), the surface defect detection of different targets usually requires the specified detection algorithms and procedures from the field expertise. In order to solve this problem, this thesis used the deep learning model to train the surface defect and further used the data augmentation and generated adversarial network (GAN) to add more abundant training dataset. The sparse defect samples are always happened in surface defect detection. And then, the data augmentation through simple techniques, such as cropping, rotating, and flipping input images, are traditionally applied to expand the training dataset in order to improve the performance and ability of the model to generalize. However, these traditional techniques often induce the overfitting of the defect model. This thesis firstly obtained the rich and qualified defect images by active learning. The filtered defect images successively feed into the GAN to add more abundant training dataset. The Fréchet Inception Distance (FID) is further used to judge the difference between input and generated images. The images owned lowest FID will be stored as the training dataset of surface defect model. The dataset will efficiently decrease the overkill rate and missed detection rate of the corresponding well trained surface defect model. Finally, the surface detection of deep learning model will be verified through the public dataset and the captured images by the AOI instrument in real world. The experiment results show that the surface detection of deep learning model can get the equal detection accuracy and performance for both training with huge raw dataset and the expanded dataset with traditional data augmentation and GAN.
Fiorani, Matteo. "Mixed-input second-hand car price estimation model based on scraped data." Master's thesis, 2022. http://hdl.handle.net/10362/134276.
Full textThe number of second-hand cars is growing year by year. More and more people prefer to buy a second-hand car rather than a new one due to the increasing cost of new cars and their fast devaluation in price. Consequently, there has also been an increase in online marketplaces for peerto- peer (P2P) second-hand cars trades. A robust price estimation is needed for both dealers, to have a good idea on how to price their cars, and buyers, to understand whether a listing is overpriced or not. Price estimation for second-hand cars has been, to my knowledge, so far only explored with numerical and categorical features such as mileage driven, brand or production year. An approach that also uses image data has yet to be developed. This work aims to investigate the use of a multi-input price estimation model for second-hand cars taking advantage of a convolutional neural network (CNN), to extract features from car images, combined with an artificial neural network (ANN), dealing with the categorical-numerical features, and assess whether this method improves accuracy in price estimation over more traditional single-input methods. To train and evaluate the model, a dataset of second-hand car images and textual features is scraped from a marketplace and curated such that more than 700 images can be used for the training.
(9226151), Camilo G. Aguilar Herrera. "NOVEL MODEL-BASED AND DEEP LEARNING APPROACHES TO SEGMENTATION AND OBJECT DETECTION IN 3D MICROSCOPY IMAGES." Thesis, 2020.
Find full textModeling microscopy images and extracting information from them are important problems in the fields of physics and material science.
Model-based methods, such as marked point processes (MPPs), and machine learning approaches, such as convolutional neural networks (CNNs), are powerful tools to perform these tasks. Nevertheless, MPPs present limitations when modeling objects with irregular boundaries. Similarly, machine learning techniques show drawbacks when differentiating clustered objects in volumetric datasets.
In this thesis we explore the extension of the MPP framework to detect irregularly shaped objects. In addition, we develop a CNN approach to perform efficient 3D object detection. Finally, we propose a CNN approach together with geometric regularization to provide robustness in object detection across different datasets.
The first part of this thesis explores the addition of boundary energy to the MPP by using active contours energy and level sets energy. Our results show this extension allows the MPP framework to detect material porosity in CT microscopy images and to detect red blood cells in DIC microscopy images.
The second part of this thesis proposes a convolutional neural network approach to perform 3D object detection by regressing objects voxels into clusters. Comparisons with leading methods demonstrate a significant speed-up in 3D fiber and porosity detection in composite polymers while preserving detection accuracy.
The third part of this thesis explores an improvement in the 3D object detection approach by regressing pixels into their instance centers and using geometric regularization. This improvement demonstrates robustness when comparing 3D fiber detection in several large volumetric datasets.
These methods can contribute to fast and correct structural characterization of large volumetric datasets, which could potentially lead to the development of novel materials.
Cianci, Davio. "A Deep-Learning-Based Muon Neutrino CCQE Selection for Searches Beyond the Standard Model with MicroBooNE." Thesis, 2021. https://doi.org/10.7916/d8-1zgg-jh16.
Full textXu, Kelvin. "Exploring Attention Based Model for Captioning Images." Thèse, 2017. http://hdl.handle.net/1866/20194.
Full textDesjardins, Guillaume. "Training deep convolutional architectures for vision." Thèse, 2009. http://hdl.handle.net/1866/3646.
Full textHigh-level vision tasks such as generic object recognition remain out of reach for modern Artificial Intelligence systems. A promising approach involves learning algorithms, such as the Arficial Neural Network (ANN), which automatically learn to extract useful features for the task at hand. For ANNs, this represents a difficult optimization problem however. Deep Belief Networks have thus been proposed as a way to guide the discovery of intermediate representations, through a greedy unsupervised training of stacked Restricted Boltzmann Machines (RBM). The articles presented here-in represent contributions to this field of research. The first article introduces the convolutional RBM. By mimicking local receptive fields and tying the parameters of hidden units within the same feature map, we considerably reduce the number of parameters to learn and enforce local, shift-equivariant feature detectors. This translates to better likelihood scores, compared to RBMs trained on small image patches. In the second article, recent discoveries in neuroscience motivate an investigation into the impact of higher-order units on visual classification, along with the evaluation of a novel activation function. We show that ANNs with quadratic units using the softsign activation function offer better generalization error across several tasks. Finally, the third article gives a critical look at recently proposed RBM training algorithms. We show that Contrastive Divergence (CD) and Persistent CD are brittle in that they require the energy landscape to be smooth in order for their negative chain to mix well. PCD with fast-weights addresses the issue by performing small model perturbations, but may result in spurious samples. We propose using simulated tempering to draw negative samples. This leads to better generative models and increased robustness to various hyperparameters.
Scellier, Benjamin. "A deep learning theory for neural networks grounded in physics." Thesis, 2020. http://hdl.handle.net/1866/25593.
Full textIn the last decade, deep learning has become a major component of artificial intelligence, leading to a series of breakthroughs across a wide variety of domains. The workhorse of deep learning is the optimization of loss functions by stochastic gradient descent (SGD). Traditionally in deep learning, neural networks are differentiable mathematical functions, and the loss gradients required for SGD are computed with the backpropagation algorithm. However, the computer architectures on which these neural networks are implemented and trained suffer from speed and energy inefficiency issues, due to the separation of memory and processing in these architectures. To solve these problems, the field of neuromorphic computing aims at implementing neural networks on hardware architectures that merge memory and processing, just like brains do. In this thesis, we argue that building large, fast and efficient neural networks on neuromorphic architectures also requires rethinking the algorithms to implement and train them. We present an alternative mathematical framework, also compatible with SGD, which offers the possibility to design neural networks in substrates that directly exploit the laws of physics. Our framework applies to a very broad class of models, namely those whose state or dynamics are described by variational equations. This includes physical systems whose equilibrium state minimizes an energy function, and physical systems whose trajectory minimizes an action functional (principle of least action). We present a simple procedure to compute the loss gradients in such systems, called equilibrium propagation (EqProp), which requires solely locally available information for each trainable parameter. Since many models in physics and engineering can be described by variational principles, our framework has the potential to be applied to a broad variety of physical systems, whose applications extend to various fields of engineering, beyond neuromorphic computing.
Carvalho, João Gabriel Marques. "Electricity consumption forecast model for the DEEC based on machine learning tools." Master's thesis, 2020. http://hdl.handle.net/10316/90148.
Full textNesta tese apresentaremos o trabalho sobre a criação de uma rede neuronal de aprendizagem automática, capaz de realizar previsões energéticas. Com o aumento do consumo energético, devem desenvolvidas ferramentas capazes de prever o consumo. Esta necessidade levou à pesquisa deste tema.Procura-se explicar a história da aprendizagem automática, o que é a aprendizagem automática e como é que esta funciona. Também se procura explicar os seus antecedentes matemáticos, a utilização de redes neuronais e que ferramentas foram atualmente desenvolvidas; de forma a criar soluções de aprendizagem automática. A aprendizagem automática consiste num programa informático, que após treino é capaz de desempenhar tarefas de forma similar à mente humana. A rede neuronal (ANN) é uma das mais importantes ferramentas de aprendizagem automática, através da qual se pode obter informação fundamental.Para prever o consumo de energia no Departamento de Engenharia Eletrotécnica e de Computadores (DEEC) da Universidade de Coimbra, uma rede neural foi treinada usando dados reais do consumo total das torres do DEEC.Phyton foi a linguagem utilizada e recorreu-se ao logaritmo de regressão de aprendizagem supervisionada. Com esta previsão, comparam-se os dados obtidos com os dados reais, o que permite a sua análise. Os dados usados no treino da rede neuronal vão de 2015/julho/10 a 2017/dezembro/31, num total de 906 dias. Por cada dia do ano existe um máximo de 3 valores, considerando-se assim uma amostra pequena.A comparação final entre os dados reais e os dados previstos foi somente realizada no mês de janeiro de 2018. A partir dos dados obtidos realizaram-se previsões, apesar de um certo nível de discrepância; justificada pela pequena quantidade de dados disponíveis. No futuro, deve-se aumentar os dados de treino de forma a obter um maior número de variáveis de entrada. O principal objetivo proposto nesta tese foi atingido com sucesso. Com toda a pesquisa apresentada, buscou-se criar informação que permitisse ser um marco na criação de melhores soluções. Este é um campo extraordinário que no futuro permitirá elevar os nossos conhecimentos a outros níveis.
In this thesis, the design of a machine learning neural network capable of making energy predictions is presented. With the increase in energy consumption, tools for the prediction of energy consumption are gaining great importance and their implementation is required. This concern is the main goal of the presented work.We strive to explain the history of machine learning, what machine learning is and how it works. It is also sought to explain the mathematical background and use of neural networks and what tools have been developed nowadays to create machine learning solutions. Machine learning is a computer program that can perform trained tasks in a similar way as the human mind. The neural network (ANN) is one of the most used and important machine learning solution through which pivotal data can be obtained. For predicting the energy consumption at the Department of Electrical and Computer Engineering (DEEC) of the University of Coimbra, a neural network was trained using real data from the overall consumption of the DEEC towers.Phyton was the language used and the supervised learning regression algorithm utilized. With this prediction, we finally compare our data with real data, so that we may analyze it. The data used in the training of the neural network goes from 2015/July/10 to 2017/December/31, a total of 906 days. For each day of the year, there is a maximum of 3 values, which is considered a small sample, but the only one available The final comparison between real and predicted data was only done for the month of January 2018. From the data achieved, predictions were made, but with a certain level of discrepancy, that is explained with the low amount of data available. In the future, one of the things that should be considered is to enlarge the training datasets, considering a larger amount of input variables. The main goal proposed for this thesis was successfully obtained. With all the presented research it was strived to create text that would allow being a steppingstone in the creation of better solutions. This is an extraordinary field that in the future will be able to elevate our knowledge to a completely different level.