Dissertations / Theses on the topic 'Multi-labels'

En classification multi-labels graduée (CMLG), chaque instance est associée à un ensemble de labels avec des degrés d’association gradués. Par exemple, une même molécule odorante peut être associée à une odeur forte ‘musquée’, une odeur modérée ‘animale’, et une odeur faible ‘herbacée’. L’objectif est d’apprendre un modèle permettant de prédire l’ensemble gradué de labels associé à une instance à partir de ses variables descriptives. Par exemple, prédire l’ensemble gradué d’odeurs à partir de la masse moléculaire, du nombre de liaisons doubles, et de la structure de la molécule. Un autre domaine intéressant de la CMLG est les systèmes de recommandation. En effet, les appréciations des utilisateurs par rapport à des items (produits, services, livres, films, etc) sont d’abord collectées sous forme de données MLG (l’échelle d’une à cinq étoiles est souvent utilisée). Ces données sont ensuite exploitées pour recommander à chaque utilisateur des items qui ont le plus de chance de l’intéresser. Dans cette thèse, une étude théorique approfondie de la CMLG permet de ressortir les limites des approches existantes, et d’assoir un ensemble de nouvelles approches apportant des améliorations évaluées expérimentalement sur des données réelles. Le cœur des nouvelles approches proposées est l’exploitation des relations entre les labels. Par exemple, une molécule ayant une forte odeur ‘musquée’ émet souvent une odeur faible ou modérée ‘animale’. Cette thèse propose également de nouvelles approches adaptées au cas des molécules odorantes et au cas des gros volumes de données collectées dans le cadre des systèmes de recommandation<br>In graded multi-label classification (GMLC), each instance is associated to a set of labels with graded membership degrees. For example, the same odorous molecule may be associated to a strong 'musky' odor, a moderate 'animal' odor, and a weak 'grassy' odor. The goal is to learn a model to predict the graded set of labels associated to an instance from its descriptive variables. For example, predict the graduated set of odors from the molecular weight, the number of double bonds, and the structure of the molecule. Another interesting area of the GMLC is recommendation systems. In fact, users' assessments of items (products, services, books, films, etc.) are first collected in the form of GML data (using the one-to-five star rating). These data are then used to recommend to each user items that are most likely to interest him. In this thesis, an in-depth theoretical study of the GMLC allows to highlight the limits of existing approaches, and to introduce a set of new approaches bringing improvements evaluated experimentally on real data. The main point of the new proposed approaches is the exploitation of relations between labels. For example, a molecule with a strong 'musky' odor often has a weak or moderate 'animal' odor. This thesis also proposes new approaches adapted to the case of odorous molecules and to the case of large volumes of data collected in the context of recommendation systems

En classification multi-labels graduée (CMLG), chaque instance est associée à un ensemble de labels avec des degrés d’association gradués. Par exemple, une même molécule odorante peut être associée à une odeur forte ‘musquée’, une odeur modérée ‘animale’, et une odeur faible ‘herbacée’. L’objectif est d’apprendre un modèle permettant de prédire l’ensemble gradué de labels associé à une instance à partir de ses variables descriptives. Par exemple, prédire l’ensemble gradué d’odeurs à partir de la masse moléculaire, du nombre de liaisons doubles, et de la structure de la molécule. Un autre domaine intéressant de la CMLG est les systèmes de recommandation. En effet, les appréciations des utilisateurs par rapport à des items (produits, services, livres, films, etc) sont d’abord collectées sous forme de données MLG (l’échelle d’une à cinq étoiles est souvent utilisée). Ces données sont ensuite exploitées pour recommander à chaque utilisateur des items qui ont le plus de chance de l’intéresser. Dans cette thèse, une étude théorique approfondie de la CMLG permet de ressortir les limites des approches existantes, et d’assoir un ensemble de nouvelles approches apportant des améliorations évaluées expérimentalement sur des données réelles. Le cœur des nouvelles approches proposées est l’exploitation des relations entre les labels. Par exemple, une molécule ayant une forte odeur ‘musquée’ émet souvent une odeur faible ou modérée ‘animale’. Cette thèse propose également de nouvelles approches adaptées au cas des molécules odorantes et au cas des gros volumes de données collectées dans le cadre des systèmes de recommandation<br>In graded multi-label classification (GMLC), each instance is associated to a set of labels with graded membership degrees. For example, the same odorous molecule may be associated to a strong 'musky' odor, a moderate 'animal' odor, and a weak 'grassy' odor. The goal is to learn a model to predict the graded set of labels associated to an instance from its descriptive variables. For example, predict the graduated set of odors from the molecular weight, the number of double bonds, and the structure of the molecule. Another interesting area of the GMLC is recommendation systems. In fact, users' assessments of items (products, services, books, films, etc.) are first collected in the form of GML data (using the one-to-five star rating). These data are then used to recommend to each user items that are most likely to interest him. In this thesis, an in-depth theoretical study of the GMLC allows to highlight the limits of existing approaches, and to introduce a set of new approaches bringing improvements evaluated experimentally on real data. The main point of the new proposed approaches is the exploitation of relations between labels. For example, a molecule with a strong 'musky' odor often has a weak or moderate 'animal' odor. This thesis also proposes new approaches adapted to the case of odorous molecules and to the case of large volumes of data collected in the context of recommendation systems

La représentation corporelle est l’ensemble des fonctions cognitives permettant le suivi de l’état du corps. Elle est impliquée dans des situations diverses, comme la perception des dimensions physiques du corps, l’action, ou encore la génération d’attitudes à propos du corps. Pour réaliser ces fonctions, elle se base de manière flexible sur un ensemble d’informations sensorimotrices, ainsi que sur les croyances, attentes et émotions de l’individu. Parmi les sources d’informations disponibles à propos du corps, l’influence sociale peut être un facteur de risque, de maintien, et de sévérité des distorsions de l’image du corps. Pourtant, si l’influence sociale sur les aspects attitudinaux de la représentation corporelle est bien établie, il existe peu d’évidence expérimentale de telles influences sur ses aspects perceptifs. Cette thèse a ainsi pour objectif d’étudier l’intégration d’informations sociales à la dimension perceptive de la représentation de la corpulence. Pour cela, nous avons réalisé une série d’expériences auprès de jeunes femmes, une catégorie de la population particulièrement sujette aux distorsions de la représentation corporelle. Un premier axe se focalise sur l'influence interpersonnelle en testant l'effet de labels de poids sur des jugements perceptifs. Pour étudier leur influence informationnelle, nous avons fait varier la fiabilité de plusieurs signaux pour étudier la manière dont elles étaient combinées. Nos résultats indiquent que les labels de poids ont une influence réduite sur les jugements de corpulence. Un second axe porte sur l'influence médiatique. La surexposition visuelle à certains types de corps est associée à l’insatisfaction corporelle, et pourrait contribuer à expliquer certaines distorsions perceptives et attitudinales de la représentation corporelle. Dans ce contexte, l’adaptation visuelle à des corps pourrait expliquer comment l’exposition prolongée à des corps minces peut mener à une surestimation de la corpulence propre. Nous avons testé certaines hypothèses de cette théorie adaptative des distorsions de l'image du corps. Ces expériences soulignent certaines limites de la théorie adaptative ; en particulier, il est incertain que les effets d’adaptation puissent influencer la représentation que les individus ont de leurs propres corps. En conclusion, nos résultats indiquent que la dimension perceptive de la représentation de la corpulence pourrait résister à certains types d’influences sociales interpersonnelles et médiatiques<br>Body representation is the set of cognitive functions that track the state of the body. It is involved in a variety of situations, such as the perception of the physical dimensions of the body, action, and the generation of attitudes towards the body. To perform these functions, it relies on the flexible use of a range of sensorimotor information, as well as on the individual's beliefs, expectations and emotions. Among the sources of information available about the body, social influence can be a risk, maintenance, and severity factor in body image distortions. However, while social influence on the attitudinal aspects of body representation is well established, there is little experimental evidence of such influence on its perceptual aspects. The aim of this thesis is to study the integration of social information into the perceptual dimension of the representation of body size. To this end, we conducted a series of experiments with young women, a demographic that is particularly prone to distortions of body representation. A first axis focuses on interpersonal influence by testing the effect of weight labels on perceptual judgments. To investigate their informational influence, we manipulated the reliability of multiple cues to study how they were combined. Our results indicate that weight labels have a limited influence on judgments of body size. A second axis focuses on another type of social influence, media influence. Visual overexposure to specific body types is associated with body dissatisfaction, and could help explain the perceptual and attitudinal distortions of body representation. In this context, visual adaptation to bodies could explain how prolonged exposure to thin bodies can lead to an overestimation of one's own body size. We tested some of the hypotheses of this adaptation theory of body image distortion. These experiments highlight some limitations of the adaptation account; in particular, it is uncertain whether adaptation effects can influence the representation that individuals have of their own bodies. In conclusion, our results suggest that the perceptual dimension of the representation of body size may be resistant to some types of interpersonal and media social influence

Nowadays, imaging of the human brain is vastly used in clinical settings and by the neuroscientific research community. There is an ever-increasing demand for novel biomedical image analysis approaches and tools to study the brain from its early intrauterine stage through adolescence to adulthood. The intrauterine period, in particular, is a crucial stage for the study of early neurodevelopmental processes. The idiosyncratic nature of the fetal brain poses numerous challenges and asks for the development of new techniques that take into consideration the peculiarities of in utero neurodevelopment. Although still in its infancy, medical image analysis techniques are progressively landing on the study of fetal brains. The purpose of this thesis is to develop automatic segmentation approaches that can be applied to brains at different life stages, including the gestational period, and investigate in utero brain development under ventriculomegaly.<br>En la actualidad, las imagenes del cerebro humano son ampliamente utilizadas en entornos clıınicos y por la comunidad neurocientııfica. Existe una demanda, cada vez mayor, de herramientas y enfoques de analisis de imagenes biomédicas novedosos para estudiar el cerebro desde su temprana etapa intrauterina hasta la adolescencia y la edad adulta. El periodo intrauterino, en particular, es una etapa crucial para el estudio de los procesos iniciales del neurodesarrollo. La naturaleza idiosincrasica del cerebro fetal plantea numerosos desafııos y requiere el desarrollo de nuevas técnicas que contemplen las peculiaridades del neurodesarrollo fetal. Aunque todavııa esta en su infancia, las técnicas de analisis de imagenes médicas estan llegando progresivamente al estudio de los cerebros fetales. El objetivo de esta tesis es desarrollar métodos automaticos de segmentación que puedan aplicarse a cerebros en distintas etapas de la vida, incluyendo el periodo gestacional, e investigar el desarrollo del cerebro fetal con ventriculomegalia.

Text Classification (TC) which is an important field in information technology has many valuable applications. When facing the sea of information resources, the objects of TC are more complicated and diversity. The researches in pursuit of effective and practical TC technology are fairly challenging. More and more researchers regard that multi-label TC is more suited for many applications. This thesis analyses the difficulties and problems in multi-label TC and Chinese text representation based on a mass of algorithms for single-label TC and multi-label TC. Aiming at high dimensionality in feature space, sparse distribution in text representation and poor performance of multi-label classifier, this thesis will bring forward corresponding algorithms from different angles.Focusing on the problem of dimensionality “disaster” when Chinese texts are represented by using n-grams, two-step feature selection algorithm is constructed. The method combines filtering rare features within class and selecting discriminative features across classes. Moreover, the proper value of “n”, the strategy of feature weight and the correlation among features are discussed based on variety of experiments. Some useful conclusions are contributed to the research of n-gram representation in Chinese texts.In a view of the disadvantage in Latent Dirichlet Allocation (LDA) model, that is, arbitrarily revising the variable in smooth process, a new strategy for smoothing based on Tolerance Rough Set (TRS) is put forward. It constructs tolerant class in global vocabulary database firstly and then assigns value for out-of-vocabulary (oov) word in each class according to tolerant class.In order to improve performance of multi-label classifier and degrade computing complexity, a new TC method based on LDA model is applied for Chinese text representation. It extracts topics statistically from texts and then texts are represented by using the topic vector. It shows competitive performance both in English and in Chinese corpus.To enhance the performance of classifiers in multi-label TC, a compound classification framework is raised. It partitions the text space by computing the upper approximation and lower approximation. This algorithm decomposes a multi-label TC problem into several single-label TCs and several multi-label TCs which have less labels than original problem. That is, an unknown text should be classified by single-label classifier when it is partitioned into lower approximation space of some class. Otherwise, it should be classified by corresponding multi-label classifier.An application system TJ-MLWC (Tongji Multi-label Web Classifier) was designed. It could call the result from Search Engines directly and classify these results real-time using improved Naïve Bayes classifier. This makes the browse process more conveniently for users. Users could locate the texts interested immediately according to the class information given by TJ-MLWC<br>La thèse est centrée sur la Classification de texte, domaine en pleine expansion, avec de nombreuses applications actuelles et potentielles. Les apports principaux de la thèse portent sur deux points : Les spécificités du codage et du traitement automatique de la langue chinoise : mots pouvant être composés de un, deux ou trois caractères ; absence de séparation typographique entre les mots ; grand nombre d’ordres possibles entre les mots d’une phrase ; tout ceci aboutissant à des problèmes difficiles d’ambiguïté. La solution du codage en «n-grams »(suite de n=1, ou 2 ou 3 caractères) est particulièrement adaptée à la langue chinoise, car elle est rapide et ne nécessite pas les étapes préalables de reconnaissance des mots à l’aide d’un dictionnaire, ni leur séparation. La classification multi-labels, c'est-à-dire quand chaque individus peut être affecté à une ou plusieurs classes. Dans le cas des textes, on cherche des classes qui correspondent à des thèmes (topics) ; un même texte pouvant être rattaché à un ou plusieurs thème. Cette approche multilabel est plus générale : un même patient peut être atteint de plusieurs pathologies ; une même entreprise peut être active dans plusieurs secteurs industriels ou de services. La thèse analyse ces problèmes et tente de leur apporter des solutions, d’abord pour les classifieurs unilabels, puis multi-labels. Parmi les difficultés, la définition des variables caractérisant les textes, leur grand nombre, le traitement des tableaux creux (beaucoup de zéros dans la matrice croisant les textes et les descripteurs), et les performances relativement mauvaises des classifieurs multi-classes habituels<br>文本分类是信息科学中一个重要而且富有实际应用价值的研究领域。随着文本分类处理内容日趋复杂化和多元化，分类目标也逐渐多样化，研究有效的、切合实际应用需求的文本分类技术成为一个很有挑战性的任务，对多标签分类的研究应运而生。本文在对大量的单标签和多标签文本分类算法进行分析和研究的基础上，针对文本表示中特征高维问题、数据稀疏问题和多标签分类中分类复杂度高而精度低的问题，从不同的角度尝试运用粗糙集理论加以解决，提出了相应的算法，主要包括：针对n-gram作为中文文本特征时带来的维数灾难问题，提出了两步特征选择的方法，即去除类内稀有特征和类间特征选择相结合的方法，并就n-gram作为特征时的n值选取、特征权重的选择和特征相关性等问题在大规模中文语料库上进行了大量的实验，得出一些有用的结论。针对文本分类中运用高维特征表示文本带来的分类效率低，开销大等问题，提出了基于LDA模型的多标签文本分类算法，利用LDA模型提取的主题作为文本特征，构建高效的分类器。在PT3多标签分类转换方法下，该分类算法在中英文数据集上都表现出很好的效果，与目前公认最好的多标签分类方法效果相当。针对LDA模型现有平滑策略的随意性和武断性的缺点，提出了基于容差粗糙集的LDA语言模型平滑策略。该平滑策略首先在全局词表上构造词的容差类，再根据容差类中词的频率为每类文档的未登录词赋予平滑值。在中英文、平衡和不平衡语料库上的大量实验都表明该平滑方法显著提高了LDA模型的分类性能，在不平衡语料库上的提高尤其明显。针对多标签分类中分类复杂度高而精度低的问题，提出了一种基于可变精度粗糙集的复合多标签文本分类框架，该框架通过可变精度粗糙集方法划分文本特征空间，进而将多标签分类问题分解为若干个两类单标签分类问题和若干个标签数减少了的多标签分类问题。即，当一篇未知文本被划分到某一类文本的下近似区域时，可以直接用简单的单标签文本分类器判断其类别；当未知文本被划分在边界域时，则采用相应区域的多标签分类器进行分类。实验表明，这种分类框架下，分类的精确度和算法效率都有较大的提高。本文还设计和实现了一个基于多标签分类的网页搜索结果可视化系统（MLWC），该系统能够直接调用搜索引擎返回的搜索结果，并采用改进的Naïve Bayes多标签分类算法实现实时的搜索结果分类，使用户可以快速地定位搜索结果中感兴趣的文本。

Les réseaux neuronaux ont fait preuve d'avancées remarquables dans des tâches réputées difficiles, comme la classification automatique d'images ou le traitement du langage naturel. Toutefois, leur nature de boîte noire limite leur explicabilité et entrave leur capacité à exploiter des connaissances extérieures aux données. Cette thèse a pour but d'explorer et de proposer des techniques d'intégration des connaissances de haut niveau dans les réseaux neuronaux afin d'améliorer les performances et l'interprétabilité. La première partie de la thèse est centrée sur l'intégration de connaissances aux données d'entrée d'un réseau. Son premier chapitre s'adresse à la préparation des données. On y propose une formalisation du prétraitement afin de garantir la transparence et la reproductibilité de cette étape. Cette formalisation nous permet d'étudier l'impact de la data-augmentation : pour caractériser ce qu'est une bonne préparation des données, et l'état informatif d'un dataset, un ensemble de mesures et de principes est proposé, ensuite des protocoles expérimentaux sont conçus afin d'évaluer ces principes sur le dataset BreakHis. Le deuxième chapitre de cette partie s'adresse à l'exploitation de connaissances haut-niveau pour l'établissement d'un ordre de présentation des données au réseau. Nous introduisons l'apprentissage par curriculum incrémental sur l'ordre de passage des données en entrée. Les résultats obtenus améliorent l'exactitude et la vitesse de convergence. Bien que cette étude soit menée sur le dataset BreakHis, nous pensons qu'elle est généralisable à n'importe quel autre dataset. La deuxième partie est centrée sur l'intégration de connaissances au sein de l'architecture du réseau et au niveau de sa sortie. Dans ce cadre, nous nous sommes intéressés à la classification multi-label hiérarchique, pour laquelle nous avons formalisé les connaissances représentant le lien hiérarchique. Pour cela nous avons introduit deux contraintes : l'une représentant le fait qu'un objet ne peut être affecté qu'à une seule classe à un niveau donné de la hiérarchie, et l'autre imposant que l'affectation globale d'un objet respecte la hiérarchie de classe (par exemple, on interdit de classer un élément comme abeille pour son sous-type et mammifère pour son sur-type). Nous avons conçu une architecture et une fonction de perte qui imposent ces deux contraintes durant l'apprentissage. L'architecture se distingue de l'état de l'art par le fait qu'un seul réseau est utilisé pour prédire simultanément les labels des différents niveaux : toutes les couches sont responsables de la prédiction du n-uplet des classes. Plusieurs variantes du réseau ont été expérimentées sur cinq jeux de données différents et les résultats confirment l'efficacité des contraintes hiérarchiques soutenant ainsi l'importance de la prise en compte de connaissances externes. Afin de raffiner les résultats de cette classification hiérarchique, nous avons introduit un mécanisme d'abstention, sous forme d'une troisième contrainte poussant le réseau à donner une prédiction au niveau de spécificité le plus précis possible sur lequel sa confiance est suffisante et s'abstenir sinon. Nous avons défini différents seuils de confiance et proposé différentes contraintes sur les seuils relativement à la hiérarchie des classes. Pour évaluer ce mécanisme, de nouvelles métriques de classification prenant en compte l'abstention ont été définies. Nous avons mené des expérimentations sur les mêmes jeux de données et les résultats ont montré l'intérêt de l'abstention, et la nécessité de définir un seuil empirique adapté à chaque dataset. Pour conclure, les travaux de cette thèse soulignent l'intérêt d'exploiter des connaissances externes dans le domaine des réseaux de neurones ceci au niveau des trois composantes de ce système d'apprentissage : en entrée pendant la préparation des données, dans la structure du réseau, et à la sortie lors de la prise de décision de classification<br>Neural networks have made remarkable improvements in challenging tasks such as automatic image classification and natural language processing. However, their black-box nature hinders explainability and limits their ability to leverage external knowledge. The purpose of this thesis is to explore and propose techniques for integrating knowledge into neural networks in order to improve their performance and interpretability. The first part of the thesis focuses on integrating knowledge at the input level. The first chapter deals with data preparation. A formalization of pre-processing is proposed to ensure the transparency and reproducibility of this step. This formalization enables us to study the impact of data augmentation: to characterize a good data preparation, and the informative state of a dataset, a set of measures and principles is proposed, then experimental protocols are designed to evaluate these principles on the BreakHis dataset. The second chapter of this part focuses on exploiting high-level knowledge to determine the order in which data should be inserted into the network. We introduce an incremental curriculum learning for ordering the input data. The results obtained show an improvement of accuracy and convergence speed. Although this study is carried out on the BreakHis dataset, we believe that it can be generalized to any other dataset. The second part is devoted to the integration of knowledge within the network architecture and at the output level. In this context, we focus on hierarchical multi-label classification, for which we formalize the knowledge representing the hierarchical link. For this aim, we introduce two constraints: one representing the fact that an object can only be assigned to one class at a given level of the hierarchy, and the other imposing that the global assignment of an object respects the class hierarchy (for example, we forbid classifying an element as a bee for its sub-type and a mammal for its super-type). We design an architecture and a loss function that impose these two constraints during learning. The architecture differs from the state of the art in that a single network is used to simultaneously predict the labels of the different levels: all layers are responsible for predicting the tuple of classes. Several variants of the network have been tested on five different datasets and the results confirm the efficiency of the hierarchical constraints, thus supporting the importance of taking external knowledge into account. In order to refine the results of this hierarchical classification, we introduce an abstention mechanism, in the form of a third constraint that enforces the network to give a prediction at the most precise level of specificity on which its confidence is sufficient and to abstain otherwise. We define different confidence thresholds and proposed different constraints on the thresholds accordingly to the class hierarchy. To evaluate this mechanism, new classification metrics that take abstention into account are defined. We carry out experiments on the same five datasets and the results show the interest of abstention, and the need to define empirical thresholds adapted to each dataset. In conclusion, the work in this thesis highlights the value of exploiting external knowledge, this is true for the three main components of a neural network: at the input level during data preparation, in the structure of the network, and at the output level when classification decisions are made

Pulsed electron-electron double resonance (PELDOR) is an emerging technique for nanometre distance measurements in nano-sized assemblies and between specific sites of molecules. Most commonly nitroxide radicals are used as probes for EPR distance measurements because they are easy to introduce in biological systems such as soluble and membrane proteins or nucleic acids. PELDOR distance measurements currently rely on data processing software which has been proven to accurately extract inter-spin distances from the dipolar coupling between two paramagnetic centres. However, when the dipolar coupling is affected by contributions from other close-by unpaired electrons inaccuracies as broadening effects and artefacts are introduced in the distance distributions derived. This challenge, commonly referred as multi-spin effects, has been affecting the extraction of accurate distance information from PELDOR measurements in chemical and biological systems with multiple spin labels. The aim of this project is to approach, identify and suppress inaccuracies introduced in PELDOR-based distance distributions by multi-spin effects. This is achieved through the synthesis of multiply labelled model systems which would allow for assessment of the impact of multi-spin effects on distance measurements of simple geometries whose behaviour can be easily predicted and modelled. In this work existing methods for suppression of multi-spin effects are tested, together with their efficiency and limitations. The results are used to devise better sets of parameters including alternative settings for extraction of accurate distances from multi-spin systems and to explore their efficiency and limitations. Additional effects influencing distance measurements by pulsed EPR are also examined; in particular the effects of orientation selection and their interplay with multi-spin effects is studied in depth. Studies on rigid symmetric and asymmetric chemical model systems together with heptameric channel membrane proteins allow for outlining of recommendations for PELDOR distance measurements settings on systems presenting similar structural features, including symmetries and inter-spin distances.

碩士<br>元智大學<br>資訊工程學系<br>105<br>With the development of society, more and more attention has been paid to psychiatric health and psychiatric illness. When people are depressed or suffer from psychiatric illness, it is an efficient and effective way to seek help from the Internet to help them to alleviate their suffering. Many psychiatric health websites have established forums and blogs to help people share their psychological problems with other users and psychologists. Other users and psychologists can give advice on how to respond to these psychological problems. Psychiatric health Web site has accumulated a large number of descriptions of psychological illness, which contains a wealth of emotion labels to express different psychological illness. Automatic identification of these mental illness labels can make online mental health services more efficient. In this paper, we propose a combined depth neural network framework BLSTM_CNN model to extract features from the text automatically. BLSTM is used to extract the sentence for each word, CNN is used to extract local features in a word, through the combination of BLSTM and CNN, according to the different emotion labels, implied more useful features can be extracted. The experimental results show that the BLSTM_CNN model is better than the CNN, LSTM and LSTM_CNN models.

博士<br>國立臺灣科技大學<br>資訊工程系<br>107<br>The problem of semi-supervised classification with non-uniformly distributed incomplete labels is frequently encountered in real world applications. The lack of positive information, the absence of negative examples and the non-uniform distribution of missing labels lead to the diminished accuracy of multi-label classification results. In this research, we propose the Semi-supervised Incomplete Training Label Recovery (SITLR) algorithm to solve the semi-supervised multi-label classification with incompletely labeled training data. With the proposed weight adjustment step and negative information initialization with LF-CARS algorithm, SITLR focuses on enhancing the information of labeled training instances according to the distribution of data, where it only recovers some important labels and the recovered training data can be applied to any existing multi-label classification algorithm for building a better classification model and generating better label predictions in the testing phase. The experiments verified the effectiveness of SITLR.

<div>This dissertation addresses the problem of how to design a convolutional neural network (CNN) for giving semantic labels to the points on the ground given the satellite image coverage over the area and, for the ground truth, given the noisy labels in OpenStreetMap (OSM). This problem is made challenging by the fact that -- (1) Most of the images are likely to have been recorded from off-nadir viewpoints for the area of interest on the ground; (2) The user-supplied labels in OSM are frequently inaccurate and, not uncommonly, entirely missing; and (3) The size of the area covered on the ground must be large enough to possess any engineering utility. As this dissertation demonstrates, solving this problem requires that we first construct a DSM (Digital Surface Model) from a stereo fusion of the available images, and subsequently use the DSM to map the individual pixels in the satellite images to points on the ground. That creates an association between the pixels in the images and the noisy labels in OSM. The CNN-based solution we present yields a 4-8% improvement in the per-class segmentation IoU (Intersection over Union) scores compared to the traditional approaches that use the views independently of one another. The system we present is end-to-end automated, which facilitates comparing the classifiers trained directly on true orthophotos vis-`a-vis first training them on the off-nadir images and subsequently translating the predicted labels to geographical coordinates. This work also presents, for arguably the first time, an in-depth discussion of large-area image alignment and DSM construction using tens of true multi-date and multi-view WorldView-3 satellite images on a distributed OpenStack cloud computing platform.</div>

博士<br>國立成功大學<br>電腦與通信工程研究所<br>105<br>Internet protocol (IP) is the most widely used protocol for high-bandwidth data transmission and it has been thought as a solution to provide different high-quality services in the future. As the internet traffic increases rapidly, the network size is extended. Multi-protocol label switching (MPLS) is proposed to reduce the IP processing time because only label is processed during the packet transmission between nodes. Although MPLS partially releases the burden of IP network, packet routing still faces a bottleneck when the number of users is large. Optical packet switching (OPS) overcomes this difficulty by simplifying several layers into IP over optical network. To implement MPLS over optical work, optical codes (OC) are used as labels for packet switching in Generalized MPLS (GMPLS) network. Among several label approaches, spectral amplitude coding (SAC) lowers system complexity and is compatible with label stacking. The label of an optical pocket is composed by different wavelength components, which are encoded according to a signature code pattern. However, due to the incoherent property of light source, the phase intensity induced noise (PIIN) appears at the forwarding node when the optical code label is de-coded. PIIN cannot simply removed by increasing the signal power because its value is proportional to the detected optical current. Therefore, we design three optical code labelling (OCL) scenarios, to increase the probability of correctly decoding the label in core nodes (CNs). Since the packet is sent to the appropriate path, the label error rate (LER) at edge node (EN) is decreased. In the first approach, stuffed quadratic congruence code (SQC code) is proposed for optical label implementing. Because of its low cross-correlation value, the effect of PIIN can be decreased significantly. If the label can be decoded correctly, the forward node would generate proper control signal to direct the packet to a suitable path. This reduces the probability of packet missing and lowers the value of LER when optical packet is de-modulated at the end node. For the case of label stacking, labels with SQC codes can provide greater system improvements. To meet practical applications, the relation between SAC-labels and optical MPLS network performance is also analyzed in this dissertation by numerical simulation. In the second approach, a hybrid label for optical packet switching in GMPLS network is proposed by combining SAC optical code-division multiple access (OCDMA) with wavelength division multiplexing (WDM). The author considers two label assignment scenarios. Hybrid labels are sequentially assigned to path segments in a label switching path (LSP) based on code index or wavelength index. LER performance of these two label assignment scenarios are also analyzed. Better LER results is achieved by sequential wavelength assignment, due to the similar label numbers among wavelengths. Furthermore, the optimal channel number is derived to minimize the LER under a specific number of stacked labels. In the final approach, bipolar OCL is employed in GMPLS network to improve the efficiency of label-recognition and network throughput. Label switching capabilities in LER is greatly reduced since the proposed bipolar OCL enlarges the Hamming distance of the star diagram of the decoded label signals. The proposed label mapping mechanism is also achieved through SAC in physical layer. In performance analysis, a numerical simulation of LER is presented to quantify the switching efficiency. Results show the proposed bipolar coding technique reduces LER in switching process, resulting in an extension of LSP in GMPLS core network.

The objective of cross-modal retrieval is to retrieve relevant items from one modality (say image), given a query from another modality (say textual document). Cross-modal retrieval has various applications like matching image-sketch, audio-visual, near infrared-RGB, etc. Different feature representations of the two modalities, absence of paired correspondences, etc. makes this a very challenging problem. In this thesis, we have extensively looked at the cross-modal retrieval problem from different aspects and proposed methodologies to address them. • In the first work, we propose a novel framework, which can work with unpaired data of the two modalities. The method has two-steps, consisting of a hash code learning stage followed by a hash function learning stage. The method can also generate unified hash representations in post-processing stage for even better performance. Finally, we investigate, formulate and address the cross-modal hashing problem in presence of missing similarity information between the data items. • In the second work, we investigate how to make the cross-modal hashing algorithms scalable so that it can handle large amounts of training data and propose two solutions. The first approach builds on mini-batch realization of the previously formulated objective and the second is based on matrix factorization. We also investigate whether it is possible to build a hashing based approach without the need to learn a hash function as is typically done in literature. Finally, we propose a strategy so that an already trained cross-modal approach can be adapted and updated to take into account the real life scenario of increasing label space, without retraining the entire model from scratch. • In the third work, we explore semi-supervised approaches for cross-modal retrieval. We first propose a novel framework, which can predict the labels of the unlabeled data using complementary information from the different modalities. The framework can be used as an add-on with any baseline cross-modal algorithm. The second approach estimates the labels of the unlabeled data using nearest neighbor strategy, and then train a network with skip connections to predict the true labels. • In the fourth work, we investigate the cross-modal problem in an incremental multiclass scenario, where new data may contain previously unseen categories. We propose a novel incremental cross-modal hashing algorithm, which can adapt itself to handle incoming data of new categories. At every stage, a small amount of old category data termed exemplars is used, so as not to forget the old data while trying to learn for the new incoming data. • Finally, we investigate the effect of label corruption on cross-modal algorithms. We first study the recently proposed training paradigms, which focuses on small loss samples to build noise-resistant image classification models and improve upon that model using techniques like self-supervision and relabeling of large loss samples. Next we extend this work for cross-modal retrieval under noisy data.