Suchergebnisse

The practical implementation of audio-video coupled speech recognition systems is mainly limited by the hardware complexity to integrate two radically different information capturing devices with good temporal synchronisation. In this paper, we propose a solution based on a smart CMOS image sensor in order to simplify the hardware integration difficulties. By using on-chip image processing, this smart sensor can calculate in real time the X/Y projections of the captured image. This on-chip projection reduces considerably the volume of the output data. This data-volume reduction permits a transmission of the condensed visual information via the same audio channel by using a stereophonic input available on most of the standard computation devices such as PC, PDA and mobile phones. A prototype called VMIKE (Visio-Microphone) has been designed and realised by using standard 0.35um CMOS technology. A preliminary experiment gives encouraged results. Its efficiency will be further investigated in a large variety of applications such as biometrics, speech recognition in noisy environments, and vocal control for military or disabled persons, etc.

Haptic interpersonal communication is commonly used to salute, to congratulate, or indirectly to manipulate heavy objects. However, the haptic feedback is missing from the common communication systems. Recent developments in telecommunications and computer capabilities have made possible the use of haptic feedback in collaborative virtual environments. Collaborative virtual environments are a promising solution to facilitate remote work collaboration. They have many applications like: military training, engineering design, e-learning or video games.Nevertheless, users of collaborative virtual environments have to face several issues. First, interacting with a virtual environment is not a straightforward task. Navigate and manipulate objects in a virtual environment requires a good mental representation of space. Secondly, remote collaboration limits the communication quality because even the best video conference system can't support all the richness of a face to face communication. Information available on the partners are reduced thus coordinate actions between users become a complex task.The aim of this thesis is to propose visual haptic interactions to simplify coordination and increase mutual awareness between the users. Through the improvement of coordination and mutual awareness an increase of team performance and work efficiency is expected.Three kind of fundamental 3D interactions are addressed in collaborative context: the coordination of selections, the setting of selections and the manipulation of objects. For each of these three of fundamental interactions, several methods of interaction and tools of coordination are proposed and assessed.The findings of this thesis highlight the strengths and the weaknesses of the closely coupled method of interactions. The results of the experiments also confirm the importance of haptic communication in remote collaboration. ; La communication haptique interpersonnelle est communément utilisée pour se saluer, se féliciter, ou de manière indirecte pour manipuler des objets lourds. Pourtant, la modalité haptique est absente des systèmes de communication à distance usuels. Les progrès récents de l'informatique et des réseaux de communication ont permis l'émergence d'environnements virtuels collaboratifs offrant un retour haptique aux utilisateurs. Les environnements virtuels collaboratifs constituent une solution prometteuse pour faciliter le travail collaboratif à distance. Les contextes applicatifs sont nombreux : entrainement militaire, assemblage mécanique, manipulation moléculaire, conception assistée par ordinateur.Toutefois, les utilisateurs d'environnements virtuels collaboratifs sont confrontés à deux types de problématiques : celles liées aux environnements virtuels 3D et celles liées à la collaboration à distance. En effet, il est difficile pour un utilisateur peu expérimenté d'interagir avec un environnement virtuel 3D. Se déplacer et manipuler des objets dans ce type d'environnement nécessite une bonne représentation mentale de l'espace.De plus, la collaboration à distance limite les possibilités et la qualité de la communication. Les informations dont disposent les utilisateurs sur leurs partenaires sont donc réduites. Dans ce contexte, la coordination des actions entre les utilisateurs devient plus complexe.L'objectif de ces travaux de thèse est donc de proposer des méthodes d'interaction visio-haptique pour faciliter la coordination et augmenter l'attention mutuelle entre les utilisateurs. Via l'amélioration de la coordination et de l'attention inter-utilisateurs, une augmentation des performances et de l'efficacité du travail collaboratif est escomptée.Trois types d'interactions fondamentales sont abordées dans un contexte collaboratif : la coordination des sélections, le paramétrage des sélections et la manipulation collaborative d'objet. Pour chacune des tâches d'interactions précédemment citées, des méthodes d'interaction ainsi que des outils de coordination et de communication ont été proposé et évalué.Ces travaux de thèse présentent les points forts mais aussi les défauts des méthodes d'interaction collaboratives fortement couplées. Les résultats obtenus montrent également l'importance de la communication haptique dans la collaboration à distance.

Haptic interpersonal communication is commonly used to salute, to congratulate, or indirectly to manipulate heavy objects. However, the haptic feedback is missing from the common communication systems. Recent developments in telecommunications and computer capabilities have made possible the use of haptic feedback in collaborative virtual environments. Collaborative virtual environments are a promising solution to facilitate remote work collaboration. They have many applications like: military training, engineering design, e-learning or video games.Nevertheless, users of collaborative virtual environments have to face several issues. First, interacting with a virtual environment is not a straightforward task. Navigate and manipulate objects in a virtual environment requires a good mental representation of space. Secondly, remote collaboration limits the communication quality because even the best video conference system can't support all the richness of a face to face communication. Information available on the partners are reduced thus coordinate actions between users become a complex task.The aim of this thesis is to propose visual haptic interactions to simplify coordination and increase mutual awareness between the users. Through the improvement of coordination and mutual awareness an increase of team performance and work efficiency is expected.Three kind of fundamental 3D interactions are addressed in collaborative context: the coordination of selections, the setting of selections and the manipulation of objects. For each of these three of fundamental interactions, several methods of interaction and tools of coordination are proposed and assessed.The findings of this thesis highlight the strengths and the weaknesses of the closely coupled method of interactions. The results of the experiments also confirm the importance of haptic communication in remote collaboration. ; La communication haptique interpersonnelle est communément utilisée pour se saluer, se féliciter, ou de manière indirecte pour manipuler ...

Haptic interpersonal communication is commonly used to salute, to congratulate, or indirectly to manipulate heavy objects. However, the haptic feedback is missing from the common communication systems. Recent developments in telecommunications and computer capabilities have made possible the use of haptic feedback in collaborative virtual environments. Collaborative virtual environments are a promising solution to facilitate remote work collaboration. They have many applications like: military training, engineering design, e-learning or video games.Nevertheless, users of collaborative virtual environments have to face several issues. First, interacting with a virtual environment is not a straightforward task. Navigate and manipulate objects in a virtual environment requires a good mental representation of space. Secondly, remote collaboration limits the communication quality because even the best video conference system can't support all the richness of a face to face communication. Information available on the partners are reduced thus coordinate actions between users become a complex task.The aim of this thesis is to propose visual haptic interactions to simplify coordination and increase mutual awareness between the users. Through the improvement of coordination and mutual awareness an increase of team performance and work efficiency is expected.Three kind of fundamental 3D interactions are addressed in collaborative context: the coordination of selections, the setting of selections and the manipulation of objects. For each of these three of fundamental interactions, several methods of interaction and tools of coordination are proposed and assessed.The findings of this thesis highlight the strengths and the weaknesses of the closely coupled method of interactions. The results of the experiments also confirm the importance of haptic communication in remote collaboration. ; La communication haptique interpersonnelle est communément utilisée pour se saluer, se féliciter, ou de manière indirecte pour manipuler ...

Catalunya Visió es una colección publicada en Barcelona entre los años 1968 y 1974 que alcanzó una gran difusión y notoriedad. A pesar de que cada volumen incluye varias comarcas, no se trata de la clásica monografía comarcal, sino de una peculiar combinación de descripción geográfica, literatura de viaje y fotografía en blanco y negro. Las logradas descripciones del paisaje de la época, realizadas por escritores muy sensibles hacia el mismo, se complementan con unas fotografías de altísima calidad artística y de gran valor iconográfico a cargo de varios fotógrafos de renombre. Texto y fotografía transmiten al unísono, aunque sirviéndose de dos lenguajes muy distintos, un doble mensaje. Por una parte, se constata que el paisaje tradicional está dando paso a un nuevo paisaje, el propio del desarrollismo de la época, el éxodo rural y la irrupción del turismo de masas. El otro mensaje es de carácter más bien político y cultural y tiene que ver con las iniciativas de reivindicación de la identidad nacional catalana que, en la década de 1960, en la fase final del franquismo, emergen de nuevo con fuerza. ; Catalunya Visió is a collection published in Barcelona between 1968 and 1974 that was widely distributed and achieved much renown. Although each volume includes several counties of Catalonia, it is by no means a standard county monograph but rather an original combination of geographical description, travel literature and black-and-white photography. The accomplished descriptions of the landscape of the time, written by authors who were deeply sensitive to this subject, are complemented with images by well-known photographers, of superb artistic quality and great iconographic value. The texts and the photographs send out the same double message, despite using very different languages. On the one hand, the traditional landscape is shown to be giving way to a new landscape, that of the developmentist policies of the era, rural flight and the arrival of mass tourism. The other message, of a more political and cultural ...

Els processos d'acollida del sistema de pro­tecció a la infància esdevenen el punt inicial de l'acompanyament de la infància i joven­tut que migra sola i del desenvolupament posterior dels seus itineraris socioeduca­tius. Mitjançant entrevistes semiestructura­des, s'ha recollit la visió de 15 educadors i educadores de diferents centres, recursos i organitzacions del sistema de protecció de Catalunya desplegats, principalment, amb l'Estratègia catalana per a l'acollida i la inclusió. Els resultats dibuixen un sistema d'acollida protocol·litzat que es mou en una "doble bipolaritat normativa" com a "menors susceptibles de protecció" i, a la vegada, com a subjectes de control migratori. L'anàlisi de l'experiència viscuda per aquesta infància des de la visió de les i els professionals que els acompanyen posa de relleu situacions de mobilitat i immobilitat múltiples i permet entreveure els significats ocults i atribuïts de la seva materialització. Mentre transiten pel sistema d'acollida es troben amb nombroses "portes" que re­forcen l'efecte embut condicionant els seus itineraris i traduint-se, en masses ocasions, en situacions d'exclusió. Des de l'atenció socioeducativa es conclou que l'acollida ha de possibilitar la construcció de vincles per ressituar-la, dignificar-la i entendre les rela­cions de poder que la condicionen.

One of the factors that have hindered progress in the areas of sign language recognition, translation, and production is the absence of large annotated datasets. Towards this end, we introduce How2Sign, a multimodal and multiview continuous American Sign Language (ASL) dataset, consisting of a parallel corpus of more than 80 hours of sign language videos and a set of corresponding modalities including speech, English transcripts, and depth. A three-hour subset was further recorded in the Panoptic studio enabling detailed 3D pose estimation. To evaluate the potential of How2Sign for real-world impact, we conduct a study with ASL signers and show that synthesized videos using our dataset can indeed be understood. The study further gives insights on challenges that computer vision should address in order to make progress in this field. Dataset website: http://how2sign.github.io/ ; This work received funding from Facebook through gifts to CMU and UPC; through projects TEC2016-75976-R, TIN2015- 65316-P, SEV-2015-0493 and PID2019-107255GB-C22 of the Spanish Government and 2017-SGR-1414 of Generalitat de Catalunya. This work used XSEDE's "Bridges" system at the Pittsburgh Supercomputing Center (NSF award ACI- 1445606). Amanda Duarte has received support from la Caixa Foundation (ID 100010434) under the fellowship code LCF/BQ/IN18/11660029. Shruti Palaskar was supported by the Facebook Fellowship program. ; Peer Reviewed ; Objectius de Desenvolupament Sostenible::10 - Reducció de les Desigualtats ; Objectius de Desenvolupament Sostenible::4 - Educació de Qualitat::4.5 - Per a 2030, eliminar les disparitats de gènere en l'educació i garantir l'accés en condicions d'igualtat a les persones vulnerables, incloses les persones amb discapacitat, els pobles indígenes i els nens i nenes en situacions de vulnerabilitat, a tots els nivells de l'ensenyament i la formació professional ; Objectius de Desenvolupament Sostenible::10 - Reducció de les Desigualtats::10.2 - Per a 2030, potenciar i promoure la inclusió social, econòmica i ...

International audience ; The Visio Bernoldi is part of a group of so-called, "political visions" from the Carolingian period. It reports the journey to the other world, during a near fatal illness, of a certain Bernold. Various people – among them Charles the Bald – all suffering for their sins, begged Bernold that on his return to the mortal world he ask their dependents and friends for prayers, alms and masses. Circulated and commented by Hincmar of Reims, the text conspiculously serves the archbishop's interests. This article considers the complex textual tradition of this short but fascinating text, and offers its first critical edition. The Visio Bernoldi circulated in three versions, called here A, B and C. C is an abridged, partial paraphrase integrated into Flodoard's History of the Church of Reims (953). Flodoard used the Visio Bernoldi as a historical document to provide a divine justification for the political fate of Ebo and Hincmar of Reims, and of Charles the Bald. Version A, as argued here, is closest to the original letter, while B (only partially extant) can be understood as a conscious revision to improve the rustic and cumbersome Latin of the original text. The article also proposes an in-debth study of the extant and lost manuscripts (Paris, BNF, lat. 5327, Brussels, Bibliothèque Royale 4087-4100, Paris, BNF, nouv. acq. lat. 469, Paris, BNF, fr. 17698I, Bibliothèque d'Hérivaux (lost), Bibliothèque de Saint-Bénigne de Dijon (lost)). ; La Visio Bernoldi fait partie d'un groupe de « visions politiques » carolingiennes. Le texte relate le voyage dans l'au-delà, durant une maladie presque fatale, d'un certain Bernold. Plusieurs personnes, parmi lesquelles Charles le Chauve, toutes souffrant à cause de leurs péchés, supplient Bernold de demander à leurs dépendants et amis d'offrir des prières, des aumônes et des messes. Diffusé et commenté par Hincmar de Reims, le texte sert de manière flagrante les intérêts de l'archevêque. Cet article étudie la complexe tradition textuelle de ce texte court mais ...