Dissertations / Theses on the topic 'Image structure representation'

Multimedia documents are composed of multiple file format combinations, such as image and text, image and sound, or image, text and sound. The type of multimedia document determines the form of analysis for knowledge architecture design and retrieval methods. Over the last few decades, theories of text analysis have been proposed and applied effectively. In recent years, theories of image and sound analysis have been proposed to work with text retrieval systems and progressed quickly due in part to rapid progress in computer processing speed. Retrieval of multimedia documents formerly was divided into the categories of image and text, and image and sound. While standard retrieval process begins from text only, methods are developing that allow the retrieval process to be accomplished simultaneously using text and image. Although image processing for feature extraction and text processing for term extractions are well understood, there are no prior methods that can combine these two features into a single data structure. This dissertation will introduce a common representation format for multimedia documents (CRFMD) composed of both images and text. For image and text analysis, two techniques are used: the Lorenz Information Measurement and the Word Code. A new process named Jeong's Transform is demonstrated for extraction of text and image features, combining the two previous measurements to form a single data structure. Finally, this single data measurements to form a single data structure. Finally, this single data structure is analyzed by using multi-dimensional scaling. This allows multimedia objects to be represented on a two-dimensional graph as vectors. The distance between vectors represents the magnitude of the difference between multimedia documents. This study shows that image classification on a given test set is dramatically improved when text features are encoded together with image features. This effect appears to hold true even when the available text is diffused and is not uniform with the image features. This retrieval system works by representing a multimedia document as a single data structure. CRFMD is applicable to other areas of multimedia document retrieval and processing, such as medical image retrieval, World Wide Web searching, and museum collection retrieval.

There has been great interest in recent times in the use of elastography for the characterization of human tissue. Digital Image Elasto-Tomography is a novel breast cancer pre-screening technique under development at the University of Canterbury, which aims to identify and locate stiff areas within the breast that require further investigation using images of the surface motion alone. A calibrated array of five digital cameras is used to capture surface motion of the breast under harmonic actuation. The forward problem, that is the resulting motion for a given mechanical property distribution, is calculated using the Finite Element Method. The inverse problem is to find the mechanical properties which reproduce the measured surface motion through numerical simulation. A reconstruction algorithm is developed using a shape based description to reduce the number of parameters in the inverse problem. A parallel Genetic Algorithm is developed for parameter optimization. A geometric method termed Fitness Function Analysis is shown to improve the inclusion location optimization problem. The ensemble of solutions generated using the Genetic Algorithm is used to produce an optimal and a credible region for inclusion location. Successful single frequency phantom reconstructions are presented. An effective way of combining information from multi-frequency phantom data by examining the characteristics of the measured surface motion using data quality metrics is developed and used to produce improved reconstructions. Results from numerical simulation datasets and a two inclusion phantom used to test the optimization of multiple and ellipsoidal inclusions indicate that although two inclusions can be successfully reconstructed, the single inclusions assumption may suffice even in irregular, heterogeneous cases. This assumption was used to successfully locate the stiffest inclusion in a phantom containing multiple inclusions of differing stiffness based on three multi-frequency datasets. The methods developed in phantoms are applied to three in vivo cases for both single and multi-frequency data with limited success. This thesis builds on previous work undertaken at the University of Canterbury. The original contributions in this work are as follows. A new reconstruction algorithm combining a genetic algorithm with fitness function analysis is developed. The most realistic tissue mimicking phantoms to date are used. An ellipsoidal shape-based description is presented, and applied to the first multi-inclusion reconstructions in DIET. This work presents the first reconstruction using meshes created directly from data using a meshing algorithm developed by Jonas Biehler. A multi-frequency cost function is developed to produce the first multi-frequency and in vivo reconstructions using DIET data.

A photograph typically depicts an aspect of the real world, such as an outdoor landscape, a portrait, or an event. The task of creating abstract digital representations of images has received a great deal of attention in the computer vision literature because it is rarely useful to work directly with the raw pixel data. The challenge of working with raw pixel data is that small changes in lighting can result in different digital images, which is not typically useful for downstream tasks such as object detection. One approach to representing an image is automatically extracting and quantising visual features to create a bag-of-terms vector. The bag-of-terms vector helps overcome the problems with raw pixel data but this unstructured representation discards potentially useful information about the spatial and semantic relationships between the parts of the image. The central argument of this thesis is that capturing and encoding the relationships between parts of an image will improve the performance of extrinsic tasks, such as image description or search. We explore this claim in the restricted domain of images representing events, such as riding a bicycle or using a computer. The first major contribution of this thesis is the Visual Dependency Representation: a novel structured representation that captures the prominent region–region relationships in an image. The key idea is that images depicting the same events are likely to have similar spatial relationships between the regions contributing to the event. This representation is inspired by dependency syntax for natural language, which directly captures the relationships between the words in a sentence. We also contribute a data set of images annotated with multiple human-written descriptions, labelled image regions, and gold-standard Visual Dependency Representations, and explain how the gold-standard representations can be constructed by trained human annotators. The second major contribution of this thesis is an approach to automatically predicting Visual Dependency Representations using a graph-based statistical dependency parser. A dependency parser is typically used in Natural Language Processing to automatically predict the dependency structure of a sentence. In this thesis we use a dependency parser to predict the Visual Dependency Representation of an image because we are working with a discrete image representation – that of image regions. Our approach can exploit features from the region annotations and the description to predict the relationships between objects in an image. In a series of experiments using gold-standard region annotations, we report significant improvements in labelled and unlabelled directed attachment accuracy over a baseline that assumes there are no relationships between objects in an image. Finally, we find significant improvements in two extrinsic tasks when we represent images as Visual Dependency Representations predicted from gold-standard region annotations. In an image description task, we show significant improvements in automatic evaluation measures and human judgements compared to state-of-the-art models that use either external text corpora or region proximity to guide the generation process. In the query-by-example image retrieval task, we show a significant improvement in Mean Average Precision and the precision of the top 10 images compared to a bag-of-terms approach. We also perform a correlation analysis of human judgements against automatic evaluation measures for the image description task. The automatic measures are standard measures adopted from the machine translation and summarization literature. The main finding of the analysis is that unigram BLEU is less correlated with human judgements than Smoothed BLEU, Meteor, or skip-bigram ROUGE.

In clinical applications it is often beneficial to use multiple imaging technologies to obtain information about different biomedical aspects of the subject under investigation, and to make best use of such sets of images they need to first be registered or aligned. Registration of multi-modal images is a challenging task and is currently the topic of much research, with new methods being published frequently. Structural representation models extract underlying features such as edges from images, distilling them into a common format that can be easily compared across different image modalities. This study compares the performance of two recent structural representation models on the task of aligning multi-modal biomedical images, specifically Second Harmonic Generation and Two Photon Excitation Fluorescence Microscopy images collected from skin samples. Performance is also evaluated on Brightfield Microscopy images. The two models evaluated here are PCANet-based Structural Representations (PSR, Zhu et al. (2018)) and Discriminative Local Derivative Patterns (dLDP, Jiang et al. (2017)). Mutual Information is used to provide a baseline for comparison. Although dLDP in particular gave promising results, worthy of further investigation, neither method outperformed the classic Mutual Information approach, as demonstrated in a series of experiments to register these particularly diverse modalities.

This research project examines an intriguing type of depictions which can be found within Sarum processional manuscripts, a genre of liturgical books which were produced between the thirteenth and fifteenth centuries. The central focus is a specific example from Norwich which was produced between the late fourteenth and early fifteenth centuries. I propose that their flat, ordered, and geometrically arranged mode of representation can be best understood when considered in relation to the semantic characteristics of notational systems. Their visual form signals that they are not representations of idiosyncratic events which have happened in the past, but are instead authoritative prescriptive layouts. They illustrate what important objects are required for the performance of a ritual and the number, status and position of the participants that will need to be in attendance. Thus, I argue that the viewer is not intended to be a passive witness to a scene taking place in the image, but is instead a presumed participant in a future performance of a specific character. Three arguments are introduced to lend support to the thesis. The first presents historical evidence which illustrates the authoritative role given to these books. The text discusses their widespread use and argues that this authoritative role may have been the result of a deliberate strategy on the part of the individuals seeking to increase the circulation of the books associated with the Sarum Use. The second argument is based on the examination of the relationships between the images and the texts found within the books. It states that the images do not present sufficient information to be considered pictorial instructions, but instead, can convey other meanings. The final argument is that the pictorial images have the semantic characteristics of a notational system. I argue that they are related to one specific system—the musical scores which interleave the images and intermingle with them in the pictorial frame.
Arts, Faculty of
Art History, Visual Art and Theory, Department of
Graduate

La représentation d’image sous une forme hiérarchique a été largement utilisée dans un contexte de classification. Une telle représentation est capable de modéliser le contenu d’une image à travers une structure arborescente. Dans cette thèse, nous étudions les méthodes à noyaux qui permettent de prendre en entrée des données sous une forme structurée et de tenir compte des informations topologiques présentes dans chaque structure en concevant des noyaux structurés. Nous présentons un noyau structuré dédié aux structures telles que des arbres non ordonnés et des chemins (séquences de noeuds) équipés de caractéristiques numériques. Le noyau proposé, appelé Bag of Subpaths Kernel (BoSK), est formé en sommant les noyaux calculés sur les sous-chemins (un sac de tous les chemins et des noeuds simples) entre deux sacs. Le calcul direct de BoSK amène à une complexité quadratique par rapport à la taille de la structure (nombre de noeuds) et la quantité de données (taille de l’ensemble d’apprentissage). Nous proposons également une version rapide de notre algorithme, appelé Scalable BoSK (SBoSK), qui s’appuie sur la technique des Random Fourier Features pour projeter les données structurées dans un espace euclidien, où le produit scalaire du vecteur transformé est une approximation de BoSK. Cet algorithme bénéficie d’une complexité non plus linéaire mais quadratique par rapport aux tailles de la structure et de l’ensemble d’apprentissage, rendant ainsi le noyau adapté aux situations d’apprentissage à grande échelle. Grâce à (S)BoSK, nous sommes en mesure d’effectuer un apprentissage à partir d’informations présentes à plusieurs échelles dans les représentations hiérarchiques d’image. (S)BoSK fonctionne sur des chemins, permettant ainsi de tenir compte du contexte d’un pixel (feuille de la représentation hiérarchique) par l’intermédiaire de ses régions ancêtres à plusieurs échelles. Un tel modèle est utilisé dans la classification des images au niveau pixel. (S)BoSK fonctionne également sur les arbres, ce qui le rend capable de modéliser la composition d’un objet (racine de la représentation hiérarchique) et les relations topologiques entre ses sous-parties. Cette stratégie permet la classification des tuiles ou parties d’image. En poussant plus loin l’utilisation de (S)BoSK, nous introduisons une nouvelle approche de classification multi-source qui effectue la classification directement à partir d’une représentation hiérarchique construite à partir de deux images de la même scène prises à différentes résolutions, éventuellement selon différentes modalités. Les évaluations sur plusieurs jeux de données de télédétection disponibles dans la communauté illustrent la supériorité de (S)BoSK par rapport à l’état de l’art en termes de précision de classification, et les expériences menées sur une tâche de classification urbaine montrent la pertinence de l’approche de classification multi-source proposée
Hierarchical image representations have been widely used in the image classification context. Such representations are capable of modeling the content of an image through a tree structure. In this thesis, we investigate kernel-based strategies that make possible taking input data in a structured form and capturing the topological patterns inside each structure through designing structured kernels. We develop a structured kernel dedicated to unordered tree and path (sequence of nodes) structures equipped with numerical features, called Bag of Subpaths Kernel (BoSK). It is formed by summing up kernels computed on subpaths (a bag of all paths and single nodes) between two bags. The direct computation of BoSK yields a quadratic complexity w.r.t. both structure size (number of nodes) and amount of data (training size). We also propose a scalable version of BoSK (SBoSK for short), using Random Fourier Features technique to map the structured data in a randomized finite-dimensional Euclidean space, where inner product of the transformed feature vector approximates BoSK. It brings down the complexity from quadratic to linear w.r.t. structure size and amount of data, making the kernel compliant with the large-scale machine-learning context. Thanks to (S)BoSK, we are able to learn from cross-scale patterns in hierarchical image representations. (S)BoSK operates on paths, thus allowing modeling the context of a pixel (leaf of the hierarchical representation) through its ancestor regions at multiple scales. Such a model is used within pixel-based image classification. (S)BoSK also works on trees, making the kernel able to capture the composition of an object (top of the hierarchical representation) and the topological relationships among its subparts. This strategy allows tile/sub-image classification. Further relying on (S)BoSK, we introduce a novel multi-source classification approach that performs classification directly from a hierarchical image representation built from two images of the same scene taken at different resolutions, possibly with different modalities. Evaluations on several publicly available remote sensing datasets illustrate the superiority of (S)BoSK compared to state-of-the-art methods in terms of classification accuracy, and experiments on an urban classification task show the effectiveness of proposed multi-source classification approach

The emergence of new media tools and social media platforms over the last ten years has created new means of intercultural engagement. On Instagram, there is a growing trend of travel pages and travel bloggers whose aim is to introduce and share with other users the highlights of the destinations they travel to. This also applies to locals in these destinations who wish to portray their country positively and promote it as a tourist destination, particularly in certain countries of the Middle East where there is the added challenge of an ‘unsafe’ image to combat. This research focuses on Lebanon to find out to what extent Instagram can be considered a tool to combat the ‘unsafe’ image of the country, and if users who come across depictions of Lebanon on Instagram perceive the country as a potential tourist destination. Using a mixed methods approach, this thesis combines surveys and semi-structured interviews with Canadian participants to reach its findings. Its theoretical framework makes use of Edward Said’s conception of the ‘other’ (1978), Stuart Hall’s system of representations (1980), Jan Neverdeen Pieterse’s hybridization paradigm (1996), and Eli Pariser’s (2011) echo chamber to analyze its findings. Broadly, findings show that while Instagram can effectively be considered a tool to counter the ‘unsafe’ image of Lebanon, and while the country may be branded as a potential tourist destination to users who come across such depictions of it, algorithm restrictions limit the potential for such depictions to fulfill their potential since they don’t always reach users who perceive Lebanon to be an ‘unsafe’ place.

Des del seu inici, la comunitat investigadora sobre reconeixement de patrons i visió per computador ha reconegut la importància d’aprofitar la informació estructural de les imatges. Els grafs s’han seleccionat com el marc adequat per representar aquest tipus d’informació a causa de la seva flexibilitat i poder de representació capaç de codificar, tant els components, objectes i entitats com les seves relacions. Tot i que els grafs s’han aplicat amb èxit a una gran varietat de tasques -com a resultat de la seva naturalesa simbòlica i relacional- sempre han patit d’algunes limitacions comparats amb mètodes estadístics. Això es deu al fet que algunes operacions matemàtiques trivials no tenen una equivalència en el domini dels grafs. Per exemple, en la base de moltes aplicacions de reconeixement de patrons hi ha la necessitat de comparar objectes. No obstant això, aquesta operació trivial no està degudament definida per grafs quan considerem vectors de característiques. Al llarg d’aquesta recerca, el principal domini d’aplicació està basat en el tema de l’Anàlisi i Reconeixement d’Imatges de Documents. Aquest és un subcamp de la Visió per Computador que té com a objectiu compendre imatges de documents. En aquest context, l’estructura -particularment la representació en forma de graf- proporciona una dimensió complementària al contingut de la imatge. En Visió per Computador la primera dificultat que ens trobem recau en construir una representació significativa de grafs capaç de codificar les característiques rellevants d’una imatge donada. Això es deu al fet que és un procés que ha de trobar un equilibri entre la simplicitat de la representació i la flexibilitat, per tal de representar les diferents deformacions que apareixen en cada domini d’aplicació. Hem estudiat aquest tema en l’aplicació de la recerca de paraules, dividint els diferents traços en grafemes –les unitats més petites d’un alfabet manuscrit&-. També, hem investigat diferents metodologies per accelerar el procés de comparació entre grafs perquè la recerca de paraules o, inclús, de forma més general, l’aplicació en la recerca de grafs, pugui incloure grans col·leccions de documents. Aquestes metodologies han estat principalment dues: (a) un sistema d’indexació de grafs combinat amb un sistema de votació en l’àmbit de nodes capaç d’eliminar resultats improbables i (b) usant representacions jeràrquiques de grafs que duen a terme la majoria de les comparacions en una versió reduïda del graf original, mitjançant comparatives entre els nivells més abstractes i els més detallats. A més a més, la representació jeràrquica també ha demostrat obtenir una representació més robusta que el graf original, lidiant amb el soroll i les deformacions de manera elegant. Per tant, proposem explotar aquesta informació en forma de codificació jeràrquica del graf que permeti utilitzar tècniques estadístiques clàssiques. Els nous avenços en aprenentatge profund geomètric han aparegut com una generalització de les metodologies d’aprenentatge profund aplicades a dominis no Euclidians –com grafs i varietats–, i han promogut un gran interès en la comunitat científica per aquests esquemes de representació. Així doncs, proposem una distància de grafs capaç d’obtenir resultats comparables a l’estat de l’art en diferents tasques aprofitant aquests nous desenvolupaments, però considerant les metodologies tradicionals com a base. També hem realitzat una col·laboració industrial amb la finalitat d’extreure informació automàtica de les factures de l’empresa (amb dades anònimes). El resultat ha estat el desenvolupament d’un sistema de detecció de taules en documents administratius. D’aquesta manera les xarxes neuronals basades en grafs han demostrat ser aptes per detectar patrons repetitius, els quals, després d’un procés d’agregació, constitueixen una taula.
La comunidad que investiga el reconocimiento de patrones y la visión por computador ha reconocido la importancia de aprovechar la información estructural de las imágenes. Los grafos se han seleccionado como el marco adecuado para representar este tipo de información a causa de su flexibilidad y poder de representación capaz de codificar los componentes, los objetos, las entidades y sus relaciones. Aunque los grafos se han aplicado con éxito a una gran variedad de tareas –como resultado de su naturaleza simbólica y relacional–, siempre han sufrido algunas limitaciones comparados con los métodos estadísticos. Esto se debe al hecho que algunas operaciones matemáticas triviales no tienen una equivalencia en el dominio de los grafos. Por ejemplo, en la base de la mayoría de aplicaciones de reconocimiento de patrones hay la necesidad de comparar objetos. No obstante, esta operación trivial no está debidamente definida por grafos cuando consideramos vectores de características. Durante la investigación, el principal dominio de aplicación se basa en el Análisis y Reconocimiento de Imágenes de Documentos. Este es un subcampo de la Visión por Computador que tiene como objetivo comprender imágenes de documentos. En este contexto la estructura -particularmente la representación en forma de grafo- proporciona una dimensión complementaria al contenido de la imágen. En Visión por Computador la primera dificultad que nos encontramos se basa en construir una representación significativa de grafos que sea capaz de codificar las características relevantes de una imagen. Esto se debe a que es un proceso que tiene que encontrar un equilibrio entre la simplicidad de la representación y la flexibilidad, para representar las diferentes deformaciones que aparecen en cada dominio de la aplicación. Hemos estudiado este tema en la aplicación de la búsqueda de palabras, dividiendo los diferentes trazos en grafemas –las unidades más pequeñas de un alfabeto manuscrito–. Tambien, hemos investigado diferentes metodologías para acelerar el proceso de comparación entre grafos para que la búsqueda de palabras o, incluso, de forma más general, la aplicación de búsqueda de grafos, pueda incluir grandes colecciones de documentos. Estas metodologías han estado principalmente dos: (a) un sistema de indexación de grafos combinado con un sistema de votación en el ámbito de los nodos capaces de eliminar resultados improbables y (b) usando representaciones jerárquicas de grafos que llevan a término la mayoría de las comparaciones en una versión reducida del grafo original mediante comparativas entre los niveles más abstractos y los más detallados. Asimismo, la representación jerárquica también ha demostrado obtener una representación más robusta que el grafo original, además de lidiar con el ruido y las deformaciones de manera elegante. Así pues, proponemos explotar esta información en forma de codificación jerárquica del grafo que permita utilizar técnicas estadísticas clásicas. Los nuevos avances en el aprendizaje profundo geométrico han aparecido como una generalización de las metodologías de aprendizaje profundo aplicadas a dominios no Euclidianos –como grafos y variedades– y han promovido un gran interés en la comunidad científica por estos esquemas de representación. Proponemos una distancia de grafos capaz de obtener resultados comparables al estado del arte en diferentes tareas aprovechando estos nuevos desarrollos, pero considerando las metodologías tradicionales como base. También hemos realizado una colaboración industrial con la finalidad de extraer información automática de las facturas de la empresa (con datos anónimos). El resultado ha sido el desarrollo de un sistema de detección de tablas en documentos administrativos. Así pues, las redes neuronales basadas en grafos han demostrado ser aptas para detectar patrones repetitivos, los cuales, después de un proceso de agregación, constituyen una tabla.
From its early stages, the community of Pattern Recognition and Computer Vision has considered the importance on leveraging the structural information when understanding images. Usually, graphs have been selected as the adequate framework to represent this kind of information due to their flexibility and representational power able to codify both, the components, objects or entities and their pairwise relationship. Even though graphs have been successfully applied to a huge variety of tasks, as a result of their symbolic and relational nature, graphs have always suffered from some limitations compared to statistical approaches. Indeed, some trivial mathematical operations do not have an equivalence in the graph domain. For instance, in the core of many pattern recognition application, there is the need to compare two objects. This operation, which is trivial when considering feature vectors, is not properly defined for graphs. Along this dissertation the main application domain has been on the topic of Document Image Analysis and Recognition. It is a subfield of Computer Vision aiming at understanding images of documents. In this context, the structure and in particular graph representations, provides a complementary dimension to the raw image contents. In computer vision, the first challenge we face is how to build a meaningful graph representation that is able to encode the relevant characteristics of a given image. This representation should find a trade off between the simplicity of the representation and its flexibility to represent the deformations appearing on each application domain. We applied our proposal to the word spotting application where strokes are divided into graphemes which are the smaller units of a handwritten alphabet. We have investigated different approaches to speed-up the graph comparison in order that word spotting, or more generally, a retrieval application is able to handle large collections of documents. On the one hand, a graph indexing framework combined with a votation scheme at node level is able to quickly prune unlikely results. On the other hand, making use of graph hierarchical representations, we are able to perform a coarse-to-fine matching scheme which performs most of the comparisons in a reduced graph representation. Besides, the hierarchical graph representation demonstrated to be drivers of a more robust scheme than the original graph. This new information is able to deal with noise and deformations in an elegant fashion. Therefore, we propose to exploit this information in a hierarchical graph embedding which allows the use of classical statistical techniques. Recently, the new advances on geometric deep learning, which has emerged as a generalization of deep learning methods to non-Euclidean domains such as graphs and manifolds, has raised again the attention to these representation schemes. Taking advantage of these new developments but considering traditional methodologies as a guideline, we proposed a graph metric learning framework able to obtain state-of-the-art results on different tasks. Finally, the contributions of this thesis have been validated in real industrial use case scenarios. For instance, an industrial collaboration has resulted in the development of a table detection framework in annonymized administrative documents containing sensitive data. In particular, the interest of the company is the automatic information extraction from invoices. In this scenario, graph neural networks have proved to be able to detect repetitive patterns which, after an aggregation process, constitute a table.

Ce travail vise à mieux évaluer la qualité perceptuelle des images contenant des distorsions structurelles et géométriques notamment dans le contexte de médias immersifs. Nous proposons et explorons un cadre algorithmique hiérarchique de la perception visuelle. Inspiré par le système visuel humain, nous investiguons plusieurs niveaux de représentations des images : bas niveau (caractéristiques élémentaires comme les segments), niveau intermédiaire (motif complexe, encodage de contours), haut niveau (abstraction et reconnaissance des données visuelles). La première partie du manuscrit traite des représentations bas niveau pour la structure et texture. U n modèle basé filtre bilatéral est d’abord introduit pour qualifier les rôles respectifs de l’information texturale et structurelle dans diverses tâches d’évaluation (utilité, qualité. . . ). Une mesure de qualité d’image/vidéo est proposée pour quantifier les déformations de structure spatiales et temporelles perçues en utilisant une métrique dite élastique. La seconde partie du mémoire explore les représentations de niveaux intermédiaires. Un modèle basé « schetch token » et un autre basé sur codage d’un arbre de contexte sont présentés pour évaluer la qualité perçue. La troisième partie traite des représentations haut niveau. Deux approches d’apprentissage machine sont proposées pour apprendre ces représentations : une basée sur un technique de convolutional sparse coding, l’autre sur des réseaux profonds de type generative adversarial network. Au long du manuscrit, plusieurs expériences sont menées sur différentes bases de données pour plusieurs applications (FTV, visualisation multi-vues, images panoramiques 360. . . ) ainsi que des études utilisateurs
This work aims to better evaluate the perceptual quality of image/video that contains structural and geometric related distortions in the context of immersive multimedia. We propose and explore a hierarchical framework of visual perception for image/video. Inspired by representation mechanism of the visual system, low-level (elementary visual features, e.g. edges), mid-level (intermediate visual patterns, e.g. codebook of edges), and higher-level (abstraction of visual input, e.g. category of distorted edges) image/video representations are investigated for quality assessment. The first part of this thesis addresses the low-level structure and texture related representations. A bilateral filter-based model is first introduced to qualify the respective role of structure and texture information in various assessment tasks (utility, quality . . . ). An image quality/video quality measure is proposed to quantify structure deformation spatially and temporally using new elastic metric. The second part explores mid-level structure related representations. A sketch-token based model and a context tree based model are presented in this part for the image and video quality evaluation. The third part explores higher-level structure related representations. Two machine learning approaches are proposed to learn higher-level representation: a convolutional sparse coding based and a generative adversarial network. Along the thesis, experiments an user studies have been conducted on different databases for different applications where special structure related distortions are observed (FTV, multi-view rendering, omni directional imaging . . . )

Made available in DSpace on 2017-07-21T19:26:08Z (GMT). No. of bitstreams: 1 Talita Rosas Ferreira.pdf: 6282017 bytes, checksum: f3b7825f0878fb8865db212f2fd79a70 (MD5) Previous issue date: 2014-03-14
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
The computed tomography (CT) represents a technique that provides images of samples, allowing the study of different soil physical phenomena by qualitative and quantitative analysis in 2D and 3D. In the area of applied physics to porous media is a matter of investigation the definition of representative elementary areas (REA) regarding measurements of physical properties of this media. REA is related to the minimum area of a sample needed to represent its characteristics of interest. The aim of this study was to define REAs to be adopted for density (ρs) measurements from sample soil collected in volumetric rings. Having this purpose in mind, three soils with different textures were analyzed: Geric Ferralsol (GF), Rhodic Ferralsol (RF) and Eutric Nitosol (EN). Six samples from each soil were submitted to the method of volumetric ring (VR) and CT for ρs evaluation. A first generation tomograph equipped with 241Am gamma-ray source was used in the image acquisition. Consecutive areas were selected according to three different schemes (consecutive areas increasing from a first area selected at the center of the image and consecutive areas increasing from a first area selected at the inferior and superior borders of the sample) with size areas ranging from 1.2 to 678.8 mm². For ρs measurements, the following criteria were adopted: 1) relative deviation (RD) between ρs – RV and each of the areas not superior to 10, 8, 6, 4 and 2%; 2) RD between ρs - CT obtained for the last area selected inside the tomographic image and each of the remaining areas equally not superior than the criteria from item 1; 3) that at least three consecutive areas must not differ in RD values among themselves, using the variation criterion presented in items 1 and 2. It was considered that the REA for ρs was reached at the variation criteria of 4%. The REA found for ρs, according to the area selection starting from the center, superior and inferior borders of the tomographic images, were: 432.0; 393.3 and 334.0 mm² (GF), 473.1; 457.4 and 393.3 mm² (RF) and 349.7; 457.4 and 334,0 mm² (EN), respectively. The results obtained by the area selection starting from the center were assumed to be the real values of REA for the studied soils. In this study, it was also proposed an alternative criterion of analysis based on the results obtained, which use as reference, simultaneously, the methods of VR and CT. Therefore, it was possible to define that áreas measuring 432.0 mm² e 349.7 mm² provide, respectively , reliable density values for the LVA and NV soils.
A Tomografia Computadorizada (TC) é uma técnica que fornece imagens do interior de amostras, permitindo a investigação de diferentes fenômenos físicos que ocorrem no solo por meio de análises qualitativas e quantitativas em 2D e 3D. Na área de física aplicada a meios porosos, uma questão que vem sendo estudada nos últimos anos diz respeito à definição de áreas elementares representativas (AER) para medidas de propriedades físicas desses meios. A AER está relacionada com a área mínima de uma amostra, necessária para representar suas características de interesse. O objetivo deste estudo foi definir AERs para medidas de densidade (ρs) de amostras de solo coletadas em anéis volumétricos. Para isso, três solos de diferentes texturas foram analisados: Latossolo Vermelho-amarelo (LVA), Latossolo Vermelho (LVE) e Nitossolo Vermelho (NV). Seis amostras de cada solo foram submetidas a dois métodos para determinação da sua ρs: método do anel volumétrico (AV) e da TC. Para a obtenção das imagens foi utilizado um tomógrafo de raios gama de primeira geração equipado com fonte de 241Am. Foram selecionadas, nas imagens tomográficas, áreas consecutivas, de acordo com três diferentes esquemas (áreas concêntricas crescentes a partir de uma área no centro da amostra e áreas crescentes a partir de uma área selecionada nas bordas inferior e superior da amostra), com áreas variando de 1,2 até 678,8 mm². Para medidas de ρs, os seguintes critérios foram adotados para a definição da AER: 1) desvio relativo (DR) entre o valor médio de ρs - AV e cada uma das demais áreas não superior a 10, 8, 6, 4 e 2%; 2) DR entre o valor médio de ρs - TC obtido para a última área (UA) selecionada na imagem tomográfica e para cada uma das demais áreas igualmente não superior aos critérios do item 1; 3) que pelo menos três áreas consecutivas não devessem diferir entre si nos valores de ρs, de acordo com os itens 1 e 2. Considerou-se que a AER para a ρs foi atingida no critério de variação de 4%. As AERs obtidas para ρs, de acordo com uma seleção de áreas partindo do centro, face inferior e face superior das imagens tomográficas foram, respectivamente, 432,0; 393,3 e 334,0 mm² (solo LVA), 473,1; 457,4 e 393,3 mm² (solo LVE) e 349,7; 457,4 e 334,0 mm² (solo NV). Os resultados obtidos por meio da seleção de áreas partindo do centro das imagens tomográficas foram adotados como valores oficiais de AER dos solos estudados. Também foi proposto neste trabalho um novo critério de análise baseado nos resultados que utilizam como referência os métodos do AV e da TC, simultaneamente, a partir do qual foi possível determinar que as áreas de tamanho 432,0 mm² e 349,7 mm², respectivamente, fornecem valores de densidade confiáveis para os solos LVA e NV.

This thesis, within the subfield of computer science known as computer vision, deals with the use of scale-space analysis in early low-level processing of visual information. The main contributions comprise the following five subjects: The formulation of a scale-space theory for discrete signals. Previously, the scale-space concept has been expressed for continuous signals only. We propose that the canonical way to construct a scale-space for discrete signals is by convolution with a kernel called the discrete analogue of the Gaussian kernel, or equivalently by solving a semi-discretized version of the diffusion equation. Both the one-dimensional and two-dimensional cases are covered. An extensive analysis of discrete smoothing kernels is carried out for one-dimensional signals and the discrete scale-space properties of the most common discretizations to the continuous theory are analysed. A representation, called the scale-space primal sketch, which gives a formal description of the hierarchical relations between structures at different levels of scale. It is aimed at making information in the scale-space representation explicit. We give a theory for its construction and an algorithm for computing it. A theory for extracting significant image structures and determining the scales of these structures from this representation in a solely bottom-up data-driven way. Examples demonstrating how such qualitative information extracted from the scale-space primal sketch can be used for guiding and simplifying other early visual processes. Applications are given to edge detection, histogram analysis and classification based on local features. Among other possible applications one can mention perceptual grouping, texture analysis, stereo matching, model matching and motion. A detailed theoretical analysis of the evolution properties of critical points and blobs in scale-space, comprising drift velocity estimates under scale-space smoothing, a classification of the possible types of generic events at bifurcation situations and estimates of how the number of local extrema in a signal can be expected to decrease as function of the scale parameter. For two-dimensional signals the generic bifurcation events are annihilations and creations of extremum-saddle point pairs. Interpreted in terms of blobs, these transitions correspond to annihilations, merges, splits and creations. Experiments on different types of real imagery demonstrate that the proposed theory gives perceptually intuitive results.

QC 20120119

La premiere application concerne la lecture automatique des images autoradiographiques de gel d'electrophorese bidimensionnelle de proteines. La seconde application porte sur la realisation d'un logiciel interactif d'aide au dessin assiste par ordinateur, specifiquement dedie a laconstruction et a la representation graphique de cartes de molecules d'adn recombinants

Les relations d'inclusion et d'adjacence des regions dans l'images comportent des informations contextuelles. Le relation d'adjacence est largement utilisé car il indique comment les régions sont organisées dans l'images. La relation d'inclusion n'est généralement pas prise en compte, bien qu'il assimile la relation d'objet-fond. Il existe plusieurs représentations morphologiques hiérarchiques: l'arbre des formes (AdF) qui représentent l'inclusion de lignes de niveaux d'image, ainsi que les hiérarchies de segmentation (i.e. la hiérarchie des quasi-zones plates) qui est utile dans l'analyse de la relation d'adjacence. Le but de ce travail est de tirer partie à la fois des relations d’inclusion et d’adjacence dans ces representations pour mener à bien des tâches de vision par ordinateur. Nous introduisons le graphe d'alignement spatial (GAS) qui est construit à partir de l'inclusion et de l'arrangement spatial des régions dans l'AdF. Dans un cas simple tel que notre l'AdF de Laplacien, le GAS est réduit à un graphe déconnecté où chaque composant connecté est un groupe sémantique d'objets. Dans d’autres cases, e.g., l'AdF classique, le GAS est plus complexe. Pour résoudre ce problème, nous proposons d'élargir notre raisonnement à la morphologie basée sur la forme. Notre extension permet de manipuler n'importe quel graphe des formes et permet n'importe stratégie de filtrage dans la cadre de opérateurs connexes. Par conséquent, le GAS pourrait être analysé par une hiérarchie des quasi-zones plates. Les résultats de notre méthode dans la reconnaissance de texte montrent l'efficacité et la performance, qui sont attrayantes notablement pour les applications mobiles
The inclusion and adjacency relationship between image regions usually carry contextual information. The later is widely used since it tells how regions are arranged in images. The former is usually not taken into account although it parallels the object-background relationship. The mathematical morphology framework provides several hierarchical image representations. They include the Tree of Shapes (ToS), which encodes the inclusion of level-line, and the hierarchies of segmentation (e.g., alpha-tree, BPT), which is useful in the analysis of the adjacency relationship. In this work, we take advantage of both inclusion and adjacency information in these representations for computer vision applications. We introduce the spatial alignment graph w.r.t inclusion that is constructed by adding a new adjacency relationship to nodes of the ToS. In a simple ToS such as our Tree of Shapes of Laplacian sign, which encodes the inclusion of Morphological Laplacian 0-crossings, the graph is reduced to a disconnected graph where each connected component is a semantic group. In other cases, e.g., classic ToS, the spatial alignment graph is more complex. To address this issue, we expand the shape-spaces morphology. Our expansion has two primary results: 1)It allows the manipulation of any graph of shapes. 2)It allows any tree filtering strategy proposed by the connected operators frameworks. With this expansion, the spatial graph could be analyzed with the help of an alpha-tree. We demonstrated the application aspect of our method in the application of text detection. The experiment results show the efficiency and effectiveness of our methods, which is appealing to mobile applications

Orientadores: Lincoln de Assis Moura Junior, Sergio Shiguemi Furuie, Eduardo Tavares Costa
Tese (doutorado) - Universidade Estadual de Campinas, Faculdade de Engenharia Eletrica e de Computação
Made available in DSpace on 2018-08-05T07:59:16Z (GMT). No. of bitstreams: 1 Rebelo_MarinadeFatimadeSa_D.pdf: 3509163 bytes, checksum: 9cd8b854b66521bcf122c15fe2fd1ffd (MD5) Previous issue date: 2005
Resumo: A identificação de estruturas constitui uma etapa importante em processamento de imagens médicas. Este trabalho pretende contribuir na área de identificação de imagens médicas, e tem por objetivo propor uma metodologia genérica para identificação de estruturas, utilizando uma abordagem em múltiplas resoluções, o espaço de escalas. Avalia-se a utilização de uma representação de dados em múltiplas escalas que permite a inclusão de conhecimento a priori sobre as estruturas em diversas escalas e ainda explora-se a idéia de realizar o processamento em uma escala apropriada. A metodologia é composta das seguintes etapas: (i) criação de uma representação dos dados em diversas escalas utilizando a teoria de espaço de escalas linear. (ii) A seguir, analisa-se as imagens presentes em todas as escalas e detecta-se as características relevantes das imagens. O produto dessa etapa é uma representação em forma de árvore que mapeia as relações entre as estruturas no espaço de escalas. Essa representação serve como base para o passo seguinte, o processamento de alto nível, no qual o conhecimento a priori sobre a estrutura procurada é modelado e incluído na representação. (iii) A última etapa é o casamento entre os elementos presentes na estrutura construída e um padrão conhecido que descreve a estrutura de interesse. A metodologia é genérica e o tipo de informação armazenada no padrão depende da aplicação específica. Neste trabalho, foi implementado um protótipo, no qual são utilizadas informações geométricas para identificação de órgãos em imagens 2D de phantom que reproduz a anatomia humana. Os resultados da aplicação da metodologia em imagens com diferentes níveis de ruído e contraste foram bastante satisfatórios. As duas primeiras etapas já estão implementadas para imagens 3D e novos parâmetros podem ser facilmente incluídos na etapa de casamento para aplicações em imagens tri-dimensionais
Abstract: The identification of structures is an important step for several applications in the field of medical imaging. The purpose of this thesis is to contribute to the field of identification in medical images. Its main goal is to propose a generic methodology for identification of structures by using a multiresolution approach, the scale-space. We evaluate the use of a data representation that allows the inclusion of a priori knowledge about the structures in several scales and we also develop the idea of an appropriate scale to perform the processing. The proposed methodology comprises the following steps: (i) creation of an image representation in several scales using the scale space theory. (ii) Then the images in all scales are inspected and relevant features are extracted; the output of this step is a tree structure that maps the relations of the detected features throughout the scale space; the representation serves as a guide to subsequent high level processing step, where a priori knowledge about the desired feature is modeled and included in the representation. (iii) The last step is the matching between the elements present in the built structure and a known pattern that describes the structure of interest. The proposed methodology is generic and the type of information to be used depends strongly on the application. In this Thesis, we built a prototype application in which we used geometric information for identification of organs in 2D phantom images that reproduces human anatomy. The results of applying this method to a set of images with different noise and contrast levels were quite satisfactory. The two initial steps of the method were also implemented for 3D images. New parameters can be easily included in the matching step for extension to 3D
Doutorado
Engenharia Biomedica
Doutor em Engenharia Elétrica

My disertation theses explores the intricate relationship between art, science and photography in the framework of the contemporary culture. Clearly outlined research areas open up the subject to a broader theoretical examination to underpin the artistic strategies that can be employed in the practial research. The resulting artwork interprets the domain of particle physics in a series of artworks. First area of the research delves into the domain of images and seeks to understand the relationship between the images of art and science in a broader sense. Second area investigates ambiguous medium of photography as both tool of science and art. Third area is an overview of the history of representation of the subatomic world and issues related to representing what is in fact unrepresentable. Fourth seeks to find epistemic and conceptual connection between art and science and their interdisciplinary dialogue as Sci-Art. The fifth part introduces artworks that reflect the critical egangement with the theoretical research and the scientific method by building the instrument for the observation of the cosmic rays. Sources for the theoretical framework are largely drawn from the academic literature written in the UK and USA where the topics explored in the theses have been studied in depth. The time scope considered in the theses encompasses 1990's of the 20. century up utill the present day.

We describe a new direct method for estimating structure and motion from image intensities of multiple views. We extend the direct methods of Horn- and-Weldon to three views. Adding the third view enables us to solve for motion, and compute a dense depth map of the scene, directly from image spatio -temporal derivatives in a linear manner without first having to find point correspondences or compute optical flow. We describe the advantages and limitations of this method which are then verified through simulation and experiments with real images.

碩士
國立臺灣師範大學
科學教育研究所在職進修碩士班
95
Drawn upon the perspective of Systemic Functional Linguistics (SFL), this study aimed at exploring the effect of science image on pupils’ image reading comprehension. Two “nervous system” images were compared – the traditional images excerpted from current science text book, and the SFL images counterparts which were modified version of the traditional ones by the guideline of SFL.These two sets of image contain the same science concepts with differenct “Representational Structure”, “Modality” and “Compositional Meaning”. “Traditional nervous system images test” and “SFL nervous system images test” of understanding of nervous system was developed to probe pupils’ understanding on reading the images, a quasi-experimental design and semi-structured interview was deployed in this study. One hundred and forty junior high school students were randomly assigned to read one of the two sets of image, where sixteen pupils with high and low performance of both grops were selected as the subjects of interview. Major findings were as followings: (a) Students who read the SFL images performed significantly better than who read the Traditional images. (b) Students who read the traditional images generated lots of alternative conceptions of nervous system and had difficulties in making sense of images. (c) Pupils who read the SFL images produced relatively few alternative conceptions. Eventually, implications of the findings were discussed and the topics for further studies were suggested.

NOUS AVONS MIS EN OEUVRE UN DOUBLE PROJET – OBJET DE RECHERCHE DANS CE TRAVAIL.
D'UNE PART, NOUS AVONS ĖTUDIĖ COMMENT CONCEVOIR UNE HOMOGENĖITĖ DES CULTURES AFRICAINES ET EXPLIQUER A LA FOIS LA DIVERSITĖ DE LEURS PRODUCTIONS, AU DOUBLE SENS DU MYTHE ET DU RITE.
D'AUTRE PART, NOUS AVONS CHERCHĖ A PRODUIRE UN REPERTOIRE DE L'IMAGINAIRE NEGRO-AFRICAIN A PARTIR D'UNE ĖXEGÈSE ANTHROPO-SOCIOLOGIQUE DES CONCEPTS DE PRATIQUES RITUELLES ET DE REPRĖSENTATIONS SOCIALES.

碩士
國立臺灣藝術大學
造形藝術研究所
94
With the changes of the systems in our society in the modern international communities, many countries have joined the line of competition in manufacturing, creating a stronger contest in trade and as a result caused many businesses in Taiwan to leave the country, opt for closing down or even in facing bankruptcy. In this contest, all industries are trying to create a distinguishing feature that defines their product. Since Taiwan is currently facing great pressure from market competitors such as Mainland China, South Korea, Japan and Hong Kong, finding a suitable market for the product during the design processes, becomes an urgent topic that all industries in Taiwan are eager to study at this stage. Handbag business is without exception in need for such study. The establishment of a product image is an urgent matter for all kinds of businesses; and how to create a product image taking into account the existing consumer preferences, thereby finding a new design model, direction and strategy in order to compete with other brands in the international market, is an important measure in this research writing, while establishing a product image is also creating a new aesthetic style which would express the purposes of visual communications design. In this writing, 3 types of subject matters and creative methods will be used to convey images on handbag materials. 1. Design of floral imageries 2. Design of symbolic imageries 3. Design of lines and geometric shapes Apart from plain fabrics, PVC and leather, these 3 types of themes are the most commonly used imageries on handbag materials. The reason for choosing these themes as directions for the creative design is their ability to create strong product image. In order to demonstrate the frequency on the appearances of these themes on handbag materials, a study on the images of a few popular brands in the market is included in this writing. Furthermore, taking into account the fact that the final presentation of the images will be made on leather or fabrics, it will be considered in the design techniques to make use of the following means of presentations: 1. Imagery output 2. Textile 3. Printing And these 3 themes will extend to 3 main topics: 1. Fun in the blooms – forming new floral images suitable for handbags by distorting, overlapping and rotating the original pictures or graphics of flowers or even changing their existing colours. 2. Amongst the words – creating a new form of logo patterns on jacquard fabrics by editing words, or using postmodern techniques to break apart or rearrange the order of the letters or words. 3. Interweaving and overlapping – creating new images by altering the lines and geometric shapes. Put rhythm into them and bring out a variation of unevenness, patches or layers. The 3 main topics could provide a concept for the creative design of handbag materials and could also be used as a reference to the design of handbag imageries. Keywords: Handbag material, Handbag material imageries, Jacquard fabrics, Brand, Logo, Post-Modernism.