290277 DIVA Data Intensive Visualization and Analysis Exp. Fall 2011 48 months Execution Euro 793,577.39 EU Seventh Framework Program th_diva.jpg This project is aimed at training the next generation of visualization and analysis experts who will be equipped with the necessary skills to cope with the major challenges for visual presentation and understanding in data intensive application environments. The people in this program are generally early-stage European scientific researchers who in the future will lead the development of novel Data Intensive Visualization and Analysis (DIVA) methodologies in data-driven science and technology application domains. The program of DIVA is based on integrating training and research projects across different aspects of visualization and interactive analysis, with an application oriented collaboration. Visualization and interactive analysis, in a larger context includes a variety of research aspects from data acquisition to knowledge discovery. In this training program we want to focus on the core pipeline of visualization from data to visual interaction and understanding. Covered by the activities of the consortium partners, this includes the principal topics such as: data processing, feature extraction, compression, multiscale modeling, interactive rendering, display systems, interaction, visual perception and cognition. Through collaboration and interaction between the partners as well as dedicated teaching and coaching, the trained visualization experts will gain a comprehensive view of visualization in science and technology. CRS4 co-leads the project with University of Zurich and performs research in the areas of data processing, output-sensitive techniques for interactive rendering, parallel rendering, light-field displays, tele-immersion, and digital mock-ups. University of ZurichSwitzerland CRS4Italy University of RostockGermany Chalmers University of TechnologySweden DiginextFrance HolografikaHungary Eyescale (associated)Switzerland Gexcel (associated)Italy Blom CGR (associated)Italy CEREN (associated)France Fraunhofer IGD (associated)Germany Airbus (associated)France NVIDIA (associated)Germany AMD (associated)France Enrico Gobbetti, Marcos Balsa Rodriguez, Fabio Bettio, Fabio Marton, Marco Agus, and Jose Antonio Iglesias Guitian 242341 INDIGO Innovative Training and Decision Support for Emergency Operations 2010-05-03 36 months Execution Euro 281,541 EU Seventh Framework Program th_indigo.jpg The INDIGO project aims to research, develop and validate an innovative system integrating the latest advances in Virtual Reality and Simulation in order to homogenise and enhance both the operational preparedness and the management of an actual complex crisis. INDIGO will enable: (a) the 3D interactive and realistic visualisation of the complete crisis environment, including data coming from the field, simulation results, and building interiors; (b) the creation and simulation of different evolving scenarios for planning, training, and anticipating future states and impending developments during operations, and analyse events after the crisis; (c) the simultaneous training of decision makers, crisis managers as well as first responders that will be influenced by the simulated scenario and that will reciprocally influence its evolution; (d) the involvement of multiple participants, thanks to its distributed architecture, while offering a unique pictorial way of sharing and communicating complex knowledge across organisation boundaries. In addition, INDIGO will propose a European emergency symbology reference for 2D/3D maps. This will fill an important gap by offering a common visual reference that can be used across Europe to facilitate the immediate understanding of the situation, thus improving decision making across organisational boundaries. The definition of the functional specifications of the system will be driven by the analysis of the needs of real end-users participating in the project as partners or involved in the User Group. These organisations will test and validate the outcomes of the project with real-world scenarios. By the end of the project a packaged system integrating all the proposed technologies will have been developed and provided to them under two versions for purpose of validation and refinement of needs and specifications. CRS4, together with ISTI-CNR, will concentrate on extending such a framework with the possibility of handling two particularly important data types: extremely massive point clouds, and geo-referenced (three-dimensionalized) photographs. These two particular datatypes are of particular importance to the security domain, since they can be acquired very rapidly and provide both measurable and visually recognizable description of a site. On the server side, the focus will be on the efficient handling of extremely massive data, on the incorporation of raw data (e.g., from LIDAR acquisitions), and on the efficient compressed streaming. Moreover, a combined (hybrid) solution using both 3D points and images will be researched. DIGINEXTFrance CNRItaly CRS4Italy Immersion SASFrance European Committee for StandardizationBelgium CrisisPlanThe Netherlands Swedish National Defense CollegeSweden Entente pour la foret mediterraneenneFrance Enrico Gobbetti, Fabio Marton, Marco Agus, Ruggero Pintus, Jose Antonio Iglesias Guitian, and Giovanni Pintore 967735 SBLGSM-IRAD Small-body Low-Gravity Surface Mobility 2010-04-01 6 months Completed $53,000 Johns Hopkins University th_sblgsm.jpg The project aims at improving CRS4 Batched Multi-Triangulation technology to integrate it into a space robotics simulation software environment. The goal is to support fast, realistic real-time rendering of asteroid datasets, as well as collision detection between the asteroid and custom vehicles/robots. Johns Hopkins University Applied Physics LabUSA Enrico Gobbetti, Fabio Marton, and Giovanni Pintore 950916 SPSRD-IRAD Accurate and realistic portrayal of planetary terrain data at interactive update rates to support simulation for planetary surface robotics development 2009-01-01 6 months Completed $53,000 Johns Hopkins University th_spsrd_irad.jpg The project aims at modifying CRS4 implementation of the Batched Dynamic Adaptive Meshes (BDAM) rendering algorithms to integrate it into a space robotics simulation software environment used for planetary surface robotics development. Johns Hopkins University Applied Physics LabUSA Enrico Gobbetti, Fabio Marton, and Giovanni Pintore Research contract GEXCEL-MPCMV Massive Point Cloud Management and Visualization 2011-03-21 12 months Execution Euro 85,000 Gexcel th_gexcel_mpcmv.jpg The project aims at developing specialized techniques for streaming, rendering, and color-mapping massive point clouds. CRS4Italy Enrico Gobbetti, Fabio Marton, Fabio Bettio D. Lgs. 82/05 RATMAN-RER3D Rapidly Adaptive Terrain Models Available on the Net: Reuse 2010-10-05 12 months Execution Euro 125,000 SardegnaIT th_csr-vic-terrain3d.jpg The project aims at extending CRS4 framework for real-time terrain streaming and rendering. The system is at the core of the regional geoviewing framework and, in the context of this project, will be transfered to the region of Emilia-Romagna. http://www.sardegna3d.it/ CRS4Italy Enrico Gobbetti, Fabio Marton, Fabio Bettio, Giovanni Pintore ICT-231199-V-CITY V-CITY The Virtual City 2008-12-01 36 months Execution Euro 300,982 EU Seventh Framework Program th_v_city.jpg 3D geoinformatics has entered the digital age, hesitantly in some areas, and rampantly in others. Google Earth and Microsoft Virtual Earth are household names. Although limited to landscapes and few buildings envelopes, their massive digital geographic libraries are today the playground of millions of people and the generator of new forms of content and applications with tremendous impact perspectives. However, these pale in comparison to those that will be made possible as soon as urban digital libraries will be fully available and exploitable. The focus of the project on urban environments is not only made possible by the latest technological advances of the consortium, but also highly justified. Urban environments represent one of the most important and valuable cultural heritage as acknowledged by the UNESCO. Therefore, the V-City project aims to research, develop and validate an innovative system integrating the latest advances in Computer Vision, 3D Modelling and Virtual Reality for the rapid and cost-effective reconstruction, visualisation and exploitation of complete, large-scale and interactive urban environments. This system will enable historians, architects or archaeologists to reconstruct from existing data, study, understand, preserve or document urban environments using an innovative interactive 3D user interface. CRS4 is the organization responsible for the visualization of massive urban models. CSFrance CGRItaly CNRItaly CRS4Italy ProceduralSwitzerland KU LeuwenBelgium Enrico Gobbetti, Fabio Marton, Marco Agus, and Giovanni Pintore POR Sardegna 2000-2006 Misura 3.13 DISTRICT-LAB3D Acquisition, Distribution, and Visualization of Complex 3D Models Laboratory 2008-01-01 24+36 months Execution 1,340,000 Regione Sardegna th_district_lab3d.jpg The projects aims at setting up a laboratory for supporting innovation and technology transfer through demonstration and tutorial activities, as well as through the development of research prototypes. The main focus is 3D acquisitions with laser scanners, storage and distribution of massive 3D models, editing, visualization and 3D printing of such models. Sardegna RicercheItaly Enrico Gobbetti, Fabio Bettio, Antonio Zorcolo, and Ruggero Pintus MRTN-CT-2006-035763 3DANATOMICALHUMAN 3D Anatomical Functional Models for the Human Musculoskeletal System 2006-10-01 48 months Completed Euro 287,984.29 EU Marie Curie Program th_3danatomicalhuman.jpg The objective of this research and training network is to increase the development of technologies and knowledge around virtual representations of human body for interactive medical applications. The network has a specific goal: developing realistic functional 3D models for the human musculoskeletal system, the methodology being demonstrated on the lower limb. CRS4 contributes to the network in the areas of biological soft tissue modeling, visualization, and user interaction. University of GenevaSwitzerland Istituti Ortopedici RizzoliItaly University COllege LondonUK INRIAFrance Vrije Universiteit BrusselBelgium Aalborg UniversityDenmark EPFLSwitzerland Primal PicturesUK CRS4Italy Enrico Gobbetti, Marco Agus, and Jose Antonio Iglesias Guitian Contenuti Digitali - D.Lgs. 163/06 2b - L.R. 5/07 1a RATMAN-SIT1 Rapidly Adaptive Terrain Models Available on the Net: Framework Extensions 2008-12-01 2 months Completed Euro 65,000 SardegnaIT th_csr-vic-terrain3d.jpg The project aims at extending CRS4 framework for real-time terrain streaming and rendering. The system is at the core of the regional geoviewing framework. http://www.sardegna3d.it/ CRS4Italy Enrico Gobbetti, Fabio Marton, Fabio Bettio, Giovanni Pintore CYBERSAR CYBERSAR Cyberinfrastructure for technological and scientific research in Sardinia 2006-01-01 36 months Completed Euro 2,100,000 Italian Ministry of Instruction, University, and Research th_cybersar.jpg The project aims at setting up an advanced cyberinfrastructure based on dedicated optical networks to support collaborative research application. The aim of Cybersar computational infrastructure is to support innovative computational applications by using leading edge hardware and technological solutions and to provide an experimental platform for research on the enabling technologies that will power next generation cyberinfrastructures. In particular, in the Visual Computing Group, we study techniques for processing and rendering very large scale 3D datasets on innovative large scale displays. COSMOLAB ConsortiumItaly Enrico Gobbetti, Fabio Marton, Marco Agus, Fabio Bettio, Giovanni Pintore 11357 BOEING777 Real-time Display of very large 3D Commercial Airplanes Models 2004-05-01 36 months Completed CRS4/Boeing Agreement th_boeing.jpg CRS4 and Boeing established a Memorandum of Agreement (MOA) and Proprietary Information Agreement (PIA) pertaining to the real-time display of very large 3D commercial airplane models, for 3 years from May 1, 2004 - April 30, 2007. Under this agreement, CRS4 has access to full 777 CAD data for research purposes. The research goal is the development of multiresolution techniques for displaying such data in real-time on commodity graphics platforms. CRS4Italy Enrico Gobbetti, Fabio Marton IST-FP6-510166 COHERENT Collaborative Holographic Environments for Networked Tasks 2004-01-01 39 months Completed Euro 471,880 EU Sixth Framework Program th_coherent.jpg Advances in networked audiovisual communication facilitate the emergence of computer-supported collaborative work (CSCW). In the COHERENT project, six leading European organisations provide complementary competencies to create a new networked holographic audio-visual platform to support real-time collaborative 3D interaction between geographically distributed teams. The display component will be based on innovative holographic techniques that can present, at natural human interaction scale, realistic animated 3D images to an unlimited number of freely moving simultaneous viewers. The design of the basic networked audiovisual components will be driven by two innovative demanding applications - a collaborative medical visualisation system and a collaborative design review system for the automotive industry - that will constitute by themselves an advancement of the state of the art in their specific domains. Both applications will provide intuitive access and interaction with shared 3D models through a sensory rich 3D user interface based on non-intrusive wireless interaction devices and offering 3D audio cues. Research will strongly concentrate on enabling technology for intuitive multi user access and interaction with complex 3D signals and objects. This project proposes to build a working high-resolution display in the one metre size range that, thanks to its human scale work area, will be ideally suited for multi-user collaborative working in true 3D. The challenge of providing the large visualisation data flow needed to drive such a device will be met using a cost-effective parallel solution based on commercial-off-the-shelf graphics and computing technology. Using GEANT, the pan-European Gigabit Research Network, the project will conduct distributed testing and validation of the system concepts for the two representative application scenarios. The research will be conducted in a 30-month schedule, to guarantee evaluation and demonstration of tangible results. Rapidly evolving advances in networked audiovisual communication technology are facilitating the emergence of computer-supported collaborative work (CSCW) systems. These systems are striving to seamlessly support collaboration between geographically distant teams for the purpose of achieving higher levels of participation, productivity, and creativity. They therefore address a major societal and economic challenge. Since visualisation is one of the most natural and intuitive ways to exchange information between humans, it has become the principal medium used in co-operative and multi-user situations. At the present time, however, state of the art collaborative real-time audiovisual systems typically rely on essentially 2D environments (traditional flat screens) to share information. For many professional applications, however, the main goal is to share the physical 3D object of common interest. These applications typically include clinical discussions among teams of medical specialists, multi-disciplinary scientific debate, design reviews between OEM's and suppliers using computer aided design (CAD), where the objects may be anatomical, molecular and product models respectively. Since these are almost exclusively very complex 3D objects, providing collaborative environments able to process, transmit and display 3D data in ways that match human perceptual abilities is therefore of primary importance and would represent a significant technology breakthrough. However, at present the only computer displays able to provide all the depth cues processed by the human brain to reconstruct a three-dimensional scene are unfortunately limited to single user configurations. Quite ironically, these limitations have led to networked solutions that facilitate remote collaboration only at the expense of the isolation of each participant from their local physical environment. In the COHERENT project, six leading European organisations in their respective fields provide complementary competencies to create a new networked holographic audio-visual platform striving to seamlessly support real-time collaborative 3D interaction between geographically distributed teams. The display component will be based on innovative holographic techniques that can present, at natural human interaction scale, realistic animated 3D images to an unlimited number of freely moving simultaneous viewers. The design of the basic networked audiovisual components will be driven by two innovative demanding applications - a collaborative medical visualisation system and a collaborative design review system for the automotive industry - that will constitute by themselves an advancement of the state of the art in their specific domains. Both applications will provide intuitive access and interaction with shared 3D models through a sensory rich 3D user interface based on non-intrusive wireless interaction and offering 3D audio cues. Research will strongly concentrate on enabling technology for intuitive multi user access and interaction with complex 3D signals and objects. The technical feasibility of the proposed holographic display solution has been recently demonstrated with the development of a "small scale" proof-of-concept, using white light based, 24 bit true colour, holographic 3D display. This project proposes to build on this earlier success to produce a working high-resolution display in the one metre size range that, thanks to its human scale work area, will be ideally suited for multi-user collaborative working in true 3D. The challenge of providing the large visualisation data flow needed to drive such a device will be met using a cost-effective parallel solution based on commercial-off-the-shelf graphics and computing technology. The driving applications have been chosen in two important sectors where collaborative 3D technology and networked audiovisual communication have a clear potential impact and provide a sizeable market for the future exploitation of the project results. Moreover, the need for distant teams to work together for a collaborative goal is becoming increasingly common in many industrial and social situations. Therefore, the best practice and methods opened-up by this project will have implications in other application domains. In particular, they will concern high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual and tele-presence and future mixed-reality-based communication services. The consortium has centred the project workplan around continuous and detailed end-user involvement in the research, development, evaluation, and validation activities. The end-users will also play an instrumental role in reaching their larger community as part of the dissemination and exploitation strategy. The research will be conducted against an ambitious, but achievable, 30-month schedule, to guarantee early delivery, evaluation, and demonstration of tangible results. HolografikaHungary CRS4Italy C-SFrance University of BonnGermany Istituto Superiore di SanitaItaly PSA Peugeot CitroenFrance Enrico Gobbetti, Fabio Marton, Marco Agus, Fabio Bettio, Giovanni Pintore SEC4-PR-011500 CRIMSON The Crisis Simulation System 2004-12-01 24 months Completed Euro 197,142 EU Sixth Framework Program th_crimson.jpg The CRIMSON project aims to research, develop and validate an innovative system using the Virtual Reality technologies for the inter-organisational preparation, rehearsal and management of security missions in response to urban crisis. The proposed system will enable the involvement of multiple participants from various operational agencies such as fire brigades, policemen, medical teams, military troops, and even the general public. It will allow the 3D simulation and evaluation of complex crisis and contingency scenarios that would be difficult to simulate and validate in real conditions. This system will offer a unique tool for creating, communicating and sharing complex knowledge between users with very different educational or cultural background. It will dramatically enhance the planning and management of crisis, the preparation of crisis management tasks, and, at the same time, it will provide a captivating tool for the collaborative training of the security actors and the information of citizens. CRS4 contribution to this project focuses on time-critical rendering of large urban scenery. C-SFrance CRS4Italy ISTI-CNRItaly ImmersionFrance Mathematiques Appliquees SAFrance Leiden UniversityThe Netherlands Enrico Gobbetti, Fabio Marton CSR CSR-VIC-TERRAIN3D Rapidly Adaptive Terrain Models Available on the Net 2006-03-27 7 months Completed Euro 158,000 Sardinian Regional Authorities th_csr-vic-terrain3d.jpg The project aims at creating a version of CRS4 real-time terrain renderer able to asynchronously access terrain information from remote servers. The library will be used as a rendering engine in a networked viewer integrated with the regional GIS. CRS4Italy Enrico Gobbetti, Fabio Marton, Fabio Bettio, Giovanni Pintore DIES2 EYESIM Cataract Surgery Simulator 2005-01-01 9+6 months Completed Euro 200,000 DIES Group th_eyesim.jpg The word cataract is used to describe a natural eye lens that has turned cloudy. Cataracts are not a disease, but rather a condition affecting the eye, which causes gradual impairment of vision. The development of cataracts is a normal part of the aging process, but they can result from a number of other reasons. If left untreated, cataracts can cause needless blindness. The more efficient solution for restoring vision consists of extracting the cataract and substituting it with an intraocular lens, or IOL. Modern advances in micro-surgical techniques permit cataracts to be removed safely and are very successful in restoring vision. Nowadays, they are probably the most frequently performed surgery in the world. Considering the diffusion and the complexity of the specialty, training is considered very important. In this context, the usage of Virtual Reality based training systems would greatly help in improving the learning curves and the quality of apprenticeship. In this project, we study and develop specialized physically-based simulations of the capsulorhexis and phacoemulsication tasks, as well as simple geometric simulations of corneal incision. Our combined simulator runs on a multiprocessing PC platform and provides realistic visual feedback with real-time interaction. The simulator is used in the industry as a component of ophtalmology training applications. CRS4Italy Enrico Gobbetti, Marco Agus, Antonio Zorcolo, Giovanni Pintore DIES1 VS Vascular Simulator 2005-01-01 3 months Completed Euro 30,000 DIES Group th_dies1.jpg Development of a real-time simulator of contrast agent transport in human vessels for virtual interventional cardiology. CRS4Italy Enrico Gobbetti, Marco Agus IST-1999-12175 IERAPSI An Integrated Environment for Rehearsal And Planning of Surgical Interventions 2000-01-01 36 months Completed Euro 503,606 EU Fifth Framework Program th_ierapsi.jpg IERAPSI provides a novel approach to computerised image-guided surgical planning. The project aims at providing an environment for visualising and interacting with the anatomy and pathology demonstrated by advanced imaging methods and VR techniques. At the same time IERAPSI will allow rehearsal of procedures on an individual patient and the development of training systems based on individual patient's variations in anatomy and pathology. Today, planning of surgical procedures makes poor use of imaging data. In most cases surgeons simply study medical images from MRI, CT, etc. prior to surgery and construct an internal 3D model of anatomy in each individual case. Previous knowledge of normal anatomy is essential. Further the ability to rehearse the surgical procedure using patient specific data is extremely rare. IERAPSI will provide an interactive computerised environment for the planning and rehearsal of surgical procedures in individual patients. The most important goal is to contribute to the European Community's social objectives by improving the provision of health and life through the introduction of modern science technology into healthcare. Specifically, IERAPSI will provide: Image review and analysis tools to allow the surgical review of CT, MRI and angiographic examinations in an interactive 2D and 3D manner; an integrated suite of image segmentation and visualisation tools intended to allow rapid and accurate identification of individual structure based on their imaging characteristics; a physics based surgical simulation system with visual and haptic feedback for training surgeons to perform operations on individual patient data. To meet the project objectives IERAPSI will address surgery of the petrous bone - a common surgical site with complex anatomy. It requires a range of surgical procedures with escalating levels of complexity. CRS4 is the partner responsible for the study and development of the surgical simulation platform. The project has produced the following tangible results: a physically motivated burr-bone interaction model, loosely based on Hertz contact theory, that includes haptic forces evaluation, the bone erosion process and the resulting debris; adaptive techniques for real-time haptic and visual simulation of bone dissection, that exploit a multiresolution representation of the bone characteristic function to adaptively trade simulation quality with speed; a dynamic direct volume rendering technique based on OpenGL register combiners that is able to render shaded representations of dynamically changing rectilinear scalar volume in parallel to simulation threads; a running prototype of the bone dissection simulator. The system is based on patient-specific volumetric object models derived from 3D CT and MR imaging data. Real-time feedback is provided to the trainees via direct volume rendering and haptic feedback. The performance constraints dictated by the human perceptual system are met by exploiting parallelism via a decoupled simulation approach on a multi-processor PC platform. The end-user evaluation of the simulator was based on three groups of users characterized as: experts (Senior ENT Surgeons); with theoretical knowledge (residents); no previous experience. Complete session traces were acquired during the training sessions and have been later analyzed and compared. The system demonstrated realistic haptic and visual rendering, and the ability of simulating complete mastoidectomy procedures. The Victoria University of ManchesterUnited Kingdom CRS4Italy Dresden University of TechnologyGermany Institute of Laryngology and Otology, University College LondonUnited Kingdom Virtual Presence Ltd.United Kingdom Genias BeneluxThe Netherlands CS SIFrance Enrico Gobbetti, Marco Agus, Antonio Zorcolo, Fabio Bettio IST-1999-13365 DIVERCITY Distributed Virtual Workspace for Enhancing Communication within the Construction Industry 2000-01-01 30 months Completed Euro 126,886 EU Fifth Framework Program th_divercity.jpg The project primarily addresses Workplace Design by developing, integrating and evaluating innovative workplace technologies for creating innovative and new workplace environments in the building industry sector. It aims to improve the process of building design and construction by enabling the user groups to operate both more efficiently and with better interaction. The project addresses the three key building construction phases: Client-Briefing, which requires detailed interaction with the client; Design Review, which requires detailed input from multidisciplinary teams of architects, engineers, and designers; and Construction, whose function is to fabricate and/or refurbish the building/s. The objective is to produce a prototype virtual workspace that will enable the three key phases to be visualised and manipulated, thus enabling better design and planning through greater interaction between all stakeholders. This will result in improved productivity and design; lower building costs with reduced waste, and improved safety both in the final building and also the construction process. The key milestones are the development of three modules for construction workspaces and their integration into the prototype system. CRS4 is the partner in charge of the development of multiresolution components for handling large tessellated models. Finite element methods have established themselves in the industry as one of the methods of choice for simulating global illumination, mainly because their results are well suited for inspection in virtual reality simulators. Unfortunately, the method is not well suited to scenes containing highly tessellated objects, because both of memory and time complexity constraints. The objective of this work has been to remove this limitation, by employing multiresolution modeling techniques. Our work led to the following results: definition of algorithms and data structures for multiresolution handling of large tessellated models: the data structure is based on a face cluster hierarchy, and the algorithms deal with creation of multiresolution models from triangle meshes, multiresolution answers to geometric queries, and integration within the framework of a finite element vector radiosity solver (irradiance gathering, irradiance and radiosity push-pull); creation of a multi-platform software library, that supports face-clustering and vector radiosity. The library has been implemented in C++ and runs on Linux, SGI IRIX, and Win32 platforms; definition of a higher order extension of the face cluster radiosity technique. The proposed technique combines face clustering, multiresolution visibility, vector radiosity, and higher order bases with a modified progressive shooting iteration to rapidly produce visually continuous solutions with limited memory requirements; definition of a technique for quickly rendering view-dependent vector radiosity solutions using OpenGL vertex programs. Using our method, visually compelling global illumination solutions for non-diffuser scenes of over one million input polygons can be computed in minutes and examined interactively on common graphics personal computers. Technical Research Centre of FinlandFinland Centre Scientifique et Technique du BatimentFrance University of SalfordUnited Kingdom Equator Helsinki OyFinland CRS4Italy Spie TondellaFrance CS SIFrance Aalborg UniversityDenmark Enrico Gobbetti, Leonardo Spano IST-2000-28095 VPLANET The Virtual Planet 2001-09-01 36 months Completed Euro 469,714 EU Fifth Framework Program th_vplanet.jpg The Virtual Planet project aims at developing tools that will enable real-time 3D exploration of large scale phototextured terrain datasets acquired with new generation remote sensing technology. The project will tackle the following technological challenges: rapid preparation of terrain databases from multiple sources; dynamic loading of massive high-resolution terrain databases; 3D real-time rendering of geographical databases; interoperation with existing GIS software; software extensibility based on an open architecture. CRS4 is the partner in charge of the study and development of multi-resolution terrain rendering components. CRS4 and ISTI/CNR have proposed a new technique, called Batched Dynamic Adaptive Meshes (BDAM), based on a paired tree structure: a tiled quadtree for texture data and a pair of bintrees of small triangular patches for the geometry. Both preprocessing and rendering exploit out-of-core techniques and fully harnesses the power of current graphics hardware. Recent benchmarks indicate that the BDAM technique outperforms state-of-the-art techniques based on hierarchies of right triangles, currently regarded as the most efficient for continuous level-of-detail rendering. CRS4Italy CNESFrance CNRItaly CS SIFrance DLRGermany IGNFrance Enrico Gobbetti, Fabio Marton, Fabio Bettio ESPRIT-26285 CAVALCADE Collaborative Virtual Construction and Design 1998-01-01 24 months Completed Euro 180,000 EU Fourth Framework Program th_cavalcade.jpg CAVALCADE's project goal is to develop a computer system for collaborative virtual prototyping of digital mock-ups. The system will support and enhance concurrent engineering practices, thanks to a distributed architecture enabling teams based in geographically dispersed locations to collaboratively design, test, validate, and document a shared model. CRS4's contribution to the project is mainly in the study and development of appropriate multiresolution modeling and rendering techniques. AISItaly CRS4Italy CSTBFrance CS SIFrance IRITFrance FFNSFrance ESAThe Netherlands Enrico Gobbetti, Eric Bouvier, Francesco Benevento MIGAVIS MIGAVIS Discontinuous Finite Element Visualization 1997-01-01 18 months Completed Euro 113,620 ENEL Polo Termico th_migavis.jpg The aim of this research line is the study and the implementation of appropriate visualization techniques for finite element data in two and three-dimensions. In particular, we are dealing with "unusual" situations such as field discontinuity and deformed cells. Such data are produced for example by chemical simulations, by fluid dynamics simulations, or, in general, anywhere high accuracy on boundary domain description is required. Finite element methods are well suited to represent physical processes in simulation programs. Several applications in the field of fluid dynamics need to represent discontinuous fields defined on finite elements cells. Such data are produced for example as an output from chemical simulation processes. The combination of discontinuous finite element simulation methods, topologically unstructured grids, and high-order approximations of fields and geometries allows programs to handle a variety of situations in which standard approaches usually fail. In particular, structured grids suffer from heavy limitations when dealing with complicated geometry or when trying to adapt to local features of the solution. Furthermore, discontinuous finite element methods assure time accuracy of the solution to be obtained by using high order polynomial approximations within each element (cell), thus being particularly well suited to unstructured grids. Finally, when high accuracy in the computational domain boundary description is required by a finite element simulation program, it is often necessary to deal with geometrically deformed cells, as the non-linear shape of these cells may give a better approximation of the boundaries than a linear one. Common visualization approaches do not offer the possibility to handle discontinuities and this research area seems to be completely uninvestigated when discontinuities are combined with unstructured topology. The aim of our research is to supply general purpose visualization tools for representing meshes made up of topologically different cells (a combination of triangles, quadrilaterals, and other generic convex polygons in the bidimensional case; a combination of tetrahedra together with hexahedra, and generic convex polyhedra in the three-dimensional case) on which discontinuous scalar fields are defined. Also, non-linear parametric description of the geometry must be represented graphically along with the field values defined over it.

High order polynomial approximation

All standard visualization tools and techniques are based on the assumption that each variable is defined over a cell has a linear behavior. One of the main problem that as to be faced is to linearly approximate polynomial function for rendering purposes. In our approach, such linearization has been performed using the Longest Side Midpoint Insertion algorithm, an iterative method where at each step every cell not directly linearizable, with respect to a defined error estimation and a given threshold, is split along its longest side in two cell. This method has been proven to converge in a finite number of iteration to a linear approximation of the function defined on the original mesh, given a tolerance value, both in 2d and 3d space.

Discontinuity representation

An efficient representation of discontinuities is a major problem to be solved for discontinuous finite element visualization. Discontinuity is a fundamental information in the simulation process: discrepancy in function values at cell interfaces provides informations on solution convergence. To this aim we decided to handle each cell as a separate entity by representing function value at each vertex independently from the value on the other cells sharing that vertex. This way to describe the actual solution has then been combined with the representation of the average solution obtained by computing for each vertex the value of the function in the cell incident on it. The possibility to describe both actual and average solution is shown to be a good way for emphasizing discontinuities. Both solutions are represented by classical visualization techniques (i.e., by isocontours and color mapping), as described in the following section. Another approach for discontinuity representation consists in mapping the variance of the discontinuous solution on the edges of the underlying grid. In this way discontinuities are made evident within the mesh and their visualization can be combined with isocontours or color mapping of either the actual or the average solution.

Non-linear geometry

Again, during visualization of this kind of data, the problem resides in representing deformed cells with computer graphics primitive that are linear. The goal is to give a good approximation of such cells with a set of linear cells. We are considering to apply the Longest Side Midpoint Insertion also for this case. The underlying research work on visualization algorithms has been partially funded by Sardinian Regional Authorities. A first practical result of our research is the implementation of a visualization system for the representation of discontinuous fields defined on unstructured grids. The system, called MIGAVIS, combines different techniques for representing discontinuities on unstructured topologies within a simple parametric user interface. The system is currently being used at ENEL of Pisa (Polo Termico) as an efficient visualization tool for discontinuous data based on finite element analysis obtained from compressible and viscous flows simulation processes. MIGAVIS has been developed by augmenting the object-oriented Visualization Toolkit (VTK) by Schroeder, Martin and Lorensen with new classes for handling linearization and discontinuity information. The application has been completely developed in C++ and the development platform is IRIX 5.3 Silicon Graphics workstation. A parametric user interface implemented in OSF/Motif allows an easy interaction with data. The system offers the possibility of visualizing:
  • the grid in wire-frame on which the solution is defined;
  • the actual discontinuous solution;
  • the average solution.
Both the actual and the average solution can be described by either a scalar representation (through isocontours or color mapping) or a vectorial representation (through glyphs or hedgehogs). The user can interactively select the scalar field (i.e., a specific solution corresponding to a variable in the simulation process) for scalar visualization and/or the scalar fields for vectorial visualization. The vectorial visualization is simply obtained by combining different scalar solutions. The variance of the solution can be mapped on edges grid whenever desired, thus emphasizing discrepant values at cell interfaces just in correspondence of their location within the grid. All such visualizations can be combined to produce a single image. The visualization system is integrated into an interface that gives the possibility to interactively modify the parameters of visualization process, i.e.:
  • parameters for linearization process;
  • colormaps for variance and for all solution and grid representations;
  • value ranges for variance and for all solution representations;
  • number of contours;
  • glyphs and hedgehogs parameters (height, scale, etc. );
  • parameters for linear and non-linear colormaps;
  • scale factor for Cartesian axes;
  • offset factor for visualized objects with respect to cartesian axes.
 CRS4Italy Enrico Gobbetti, Andrea Leone, Paola Marzano TELEMATICS VREPAR2 Psycho-Neuro-Physiological Assessment and Rehabilitation 2 1998-01-01 24 months Completed Euro 7,500 EU Fourth Framework Program th_vrepar2.jpg The projects aims at developing virtual reality tools for treating eating disorders, testing their efficacy at a scale of operation representing reality, and disseminitaing the results to an extended audience. The project is also oriented at analyzing and quantifying the markets for virtual reality products and services. CRS4 contributes to this project with a study of the state of the art of virtual environment technology. IBM SEMEAItaly Istituto Auxologico ItalianoItaly CRS4Italy ISMRA, CaenFrance Enrico Gobbetti, Riccardo Scateni EU-1063, HPPC-SEA Chapter F VIVA The Virtual Vascular Project 1997-09-01 24 months Completed EU Eureka Program th_viva.jpg

The aim of the VIVA project is to develop tools for the modern hemodynamicist and cardiovascular surgeon to study and interpret the constantly increasing amount of information being produced by non-invasive imaging equipment. In particular, we are developing a system that will be able to process and visualize 3D medical data, reconstruct the geometry of arteries of specific patients and to simulate blood flow in them. The initial applications of the system will be for clinical research and training purposes. In a later stage we will explore the application of the system to surgical planning.

VIVA is based on an integrated set of tools, each dedicated to a specific aspect of the data processing and simulation pipelines:

  • image processing and segmentation
  • 3D geometry modeling, handling and reconstruction
  • 3D mesh generation
  • blood flow simulation
  • visualization and real-time 3D imaging
  • structural computations
 CRS4Italy Enrico Gobbetti, Fabio Bettio MIRRORS MIRRORS Mirror Neurons and the Observation/Execution Matching System 1998-06-01 36 months Completed $50,000 Human Frontiers Science Program th_mirrors.jpg

Study of the functional properties of mirror neurons and investigation of the execution/matching system in humans. CRS4 will develop a computer system for acquisition, generation, and display of stereoscopic sequences that will be used in human physiology experiments.

CRS4Italy University of ParmaItaly University of CreteGreece University of California at LAUSA Kyoto UniversityJapan Enrico Gobbetti, Marco Agus D. D. 784 Ric. 24/07/2001 URBAN Uniformed Reconstructions of the Brain Available on the Net 2001-07-24 36 months Completed Euro 258,228 Italian Ministry of Instruction, University, and Research th_urban.jpg

Study and development of 3D reconstruction and visualization techniques for primate brains.

 CRS4Italy University of ParmaItaly Enrico Gobbetti, Fabio Bettio, Gianni Pintore D. M. 645 4/101997, Cluster 22, Project 41D LAPS Advanced Laboratory for Computer-Aided Design and Simulation 2000-01-01 42 months Completed Euro 824,058 Italian Ministry of Instruction, University, and Research th_laps.jpg The project aims at setting up and maintaining a laboratory for carrying out computer aided design and numerical simulation research activities in the biomedical and engineering domains. Research and technological development activities are focused on: virtual environments for the analysis of volumetric data; geometric and physical prototyping of vascular datasets; compressible and incompressible fluid--dynamics; structural integrity analysis; fluid-structure interaction. CRS4Italy Enrico Gobbetti, Fabio Bettio BRAIN BRAIN Software Tools for Primate Brain Reconstruction from Histological Sections 2001-01-01 6 months Completed Euro 15,000 University of Parma th_brain.jpg We have developed software for 3-D reconstruction and visualization of architectonic, neurophysiological and tract tracing data of primate cerebral cortex. Our emphasis is on providing interactive solutions to reconstruction and analysis problems by harnessing the power of new generation commodity graphics accelerators. We take as input data acquired in serially collected individual sections, in which the locations of outer and inner cortical boundaries, architectonic borders, electrode tracks, and labeled neurons are coded in X-Y coordinates. Linear and non-linear local transformations are interactively applied to sections for aligning them and minimizing distortions introduced by sectioning and histological procedures. Cortical surfaces are incrementally reconstructed during section manipulation using both direct triangulation and functional techniques. Using multipass rendering techniques, the system interactively generates realistic 3-D views that present in the same image the location of architectonic areas and the spatial location, density and cortical depth of the introduced data. The reconstructed brain can be resliced according to arbitrary planes and virtually dissected for showing sulcal banks without distortion. Application of this software to the analysis of data from our previous studies showed that this integrated system is a powerful tool for anatomo-functional correlation in highly convoluted brains and for comparing data from brains cut along different sectioning plans. The availability of low-cost, high performance graphics PC platforms makes this approach practical for everyday laboratory work. CRS4Italy Enrico Gobbetti, Fabio Bettio