Real-time Dense 3D Reconstruction with RGB-D Camera

Real-time Dense 3D Reconstruction with RGB-D Camera PDF Author: Hanyu Deng
Publisher:
ISBN:
Category :
Languages : en
Pages : 33

Get Book Here

Book Description

Real-time Dense 3D Reconstruction with RGB-D Camera

Real-time Dense 3D Reconstruction with RGB-D Camera PDF Author: Hanyu Deng
Publisher:
ISBN:
Category :
Languages : en
Pages : 33

Get Book Here

Book Description


RGB-D Image Analysis and Processing

RGB-D Image Analysis and Processing PDF Author: Paul L. Rosin
Publisher: Springer Nature
ISBN: 3030286037
Category : Computers
Languages : en
Pages : 524

Get Book Here

Book Description
This book focuses on the fundamentals and recent advances in RGB-D imaging as well as covering a range of RGB-D applications. The topics covered include: data acquisition, data quality assessment, filling holes, 3D reconstruction, SLAM, multiple depth camera systems, segmentation, object detection, salience detection, pose estimation, geometric modelling, fall detection, autonomous driving, motor rehabilitation therapy, people counting and cognitive service robots. The availability of cheap RGB-D sensors has led to an explosion over the last five years in the capture and application of colour plus depth data. The addition of depth data to regular RGB images vastly increases the range of applications, and has resulted in a demand for robust and real-time processing of RGB-D data. There remain many technical challenges, and RGB-D image processing is an ongoing research area. This book covers the full state of the art, and consists of a series of chapters by internationally renowned experts in the field. Each chapter is written so as to provide a detailed overview of that topic. RGB-D Image Analysis and Processing will enable both students and professional developers alike to quickly get up to speed with contemporary techniques, and apply RGB-D imaging in their own projects.

Real-Time Interactive 3D Reconstruction of Indoor Environments With High Accuracy

Real-Time Interactive 3D Reconstruction of Indoor Environments With High Accuracy PDF Author: Shakil Ahmed
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
3D registration of depth images has been studied extensively in the past. With emergence of low cost RGB-D cameras, many applications have emerged. Yet, the quality of alignment has much to improve. It remains a challenge to create a 3D model of the environment with high accuracy which could be used for engineering applications. Moreover, challenging scenarios where features are scarce, handling large areas as scene, enabling the user to freely roam around the scene for image acquisition in a practical manner, guiding the user in taking better images and accomplishing all of this with low cost RGB-D camera in real time is a subject which is yet to be improved. In this thesis, we address all this challenges by designing and implementing a mobile system that rely on markers. Our system detects and matches markers in real-time with very low CPU load. Moreover, this mobile 3D reconstruction system is interactive which enables a user not only to move freely while doing 3D reconstruction, but also makes the user aware of current status of 3D reconstruction in real-time.

Towards Optimal Point Cloud Processing for 3D Reconstruction

Towards Optimal Point Cloud Processing for 3D Reconstruction PDF Author: Guoxiang Zhang
Publisher: Springer Nature
ISBN: 3030961109
Category : Technology & Engineering
Languages : en
Pages : 99

Get Book Here

Book Description
This SpringerBrief presents novel methods of approaching challenging problems in the reconstruction of accurate 3D models and serves as an introduction for further 3D reconstruction methods. It develops a 3D reconstruction system that produces accurate results by cascading multiple novel loop detection, sifting, and optimization methods. The authors offer a fast point cloud registration method that utilizes optimized randomness in random sample consensus for surface loop detection. The text also proposes two methods for surface-loop sifting. One is supported by a sparse-feature-based optimization graph. This graph is more robust to different scan patterns than earlier methods and can cope with tracking failure and recovery. The other is an offline algorithm that can sift loop detections based on their impact on loop optimization results and which is enabled by a dense map posterior metric for 3D reconstruction and mapping performance evaluation works without any costly ground-truth data. The methods presented in Towards Optimal Point Cloud Processing for 3D Reconstruction will be of assistance to researchers developing 3D modelling methods and to workers in the wide variety of fields that exploit such technology including metrology, geological animation and mass customization in smart manufacturing.

Optimization of Pose, Texture and Geometry in 3d Reconstruction with Consumer Depth Cameras

Optimization of Pose, Texture and Geometry in 3d Reconstruction with Consumer Depth Cameras PDF Author: Chao Wang (Computer graphics engineer)
Publisher:
ISBN:
Category : Computer vision
Languages : en
Pages :

Get Book Here

Book Description
3D Reconstruction is one of the most popular topics in the area of computer graphics and vision. A typical 3D reconstruction process is to reconstruct the 3D model or other similar geometry representations from different sources of data, including color images and depth data captured by depth cameras. Online and offline RGB-D (RGB and depth) reconstruction techniques have been developing rapidly in this decade with the prevalence of consumer depth cameras. However, current 3D construction methods still lack robustness in the tracking process, and also pay little attention on the quality of final reconstructed 3D models. This dissertation is focused on improving the robustness of camera tracking in the online RGB-D reconstruction process, as well as optimizing camera pose, face texture and geometry quality of 3D models in the offline RGB-D reconstruction with consumer depth cameras. One problem in online 3D reconstruction is that, existing camera pose estimation approaches in online RGB-D reconstruction systems always suffer from fast-scanned data and generate inaccurate relative transformations between consecutive frames. In order to improve the tracking robustness of online 3D reconstruction, we propose a novel feature-based camera pose optimization algorithm for real-time 3D reconstruction systems. We have demonstrated that our method improves current methods by utilizing matched features across all frames, and is robust on reconstructing RGB-D data with large adjacent shifts across frames. Another problem in RGB-D reconstruction is that the geometry of reconstructed 3D models is usually too dense and coarse, and texture quality of mesh faces is always too low. To deal with this problem, we introduce a new plane-based RGB-D reconstruction approach with plane, geometry and texture optimization to improve the geometry and texture quality of reconstructed models. Compared to existing planar reconstruction methods which cover only large planar regions in the scene, our method reconstructs the entire original scene without losing geometry details in the low-polygonal lightweight result meshes with clear face textures and sharp features. We have demonstrated the effectiveness of our approach by applying it onto different RGB-D benchmarks and comparing it with other state-of-the-art reconstruction methods.

Variation Based Dense 3D Reconstruction

Variation Based Dense 3D Reconstruction PDF Author: Sven Painer
Publisher: Springer
ISBN: 3658126981
Category : Computers
Languages : en
Pages : 87

Get Book Here

Book Description
In his master thesis, Sven Painer develops, implements, and evaluates a method to reconstruct the liver surface from monocular mini-laparoscopic sequences. The principal focus of his research is to create a basis for helping clinicians to write reports with quantitative descriptions of the liver surface. A Structure from Motion approach is performed to do a sparse reconstruction of the liver surface and subsequently this information is used in a variation based dense 3D reconstruction. The algorithms are formulated in a causal way, enabling the implementation to be run in real-time on an adequate hardware platform. The results show a significant performance increase and pave the way to give clinicians a feedback during video capturing to improve the quality of the reconstruction in the near future.

A Framework for Realtime 3-D Reconstruction by Space Carving Using Graphics Hardware

A Framework for Realtime 3-D Reconstruction by Space Carving Using Graphics Hardware PDF Author: Christian Nitschke
Publisher: diplom.de
ISBN: 3956362012
Category : Technology & Engineering
Languages : en
Pages : 153

Get Book Here

Book Description
Inhaltsangabe:Introduction: Reconstruction of real-world scenes from a set of multiple images is a topic in Computer Vision and 3D Computer Graphics with many interesting applications. There is a relation to Augmented and Mixed Reality (AR/MR), Computer-Supported Collaborative Work (CSCW), Computer-Aided industrial/architectural Design (CAD), modeling of the real-world (e.g. computer games, scenes/effects in movies), entertainment (e.g. 3D TV/Video) and recognition/analyzing of real-world characteristics by computer systems and robots. There exists a powerful algorithm theory for shape reconstruction from arbitrary viewpoints, called shape from photo-consistency. However, it is computationally expensive and hence can not be used with applications in the field of 3D video or CSCW as well as interactive 3D model creation. Attempts have been made to achieve real-time framerates using PC cluster systems. While these provide enough performance they are also expensive and less flexible. Approaches that use GPU hardware-acceleration on single workstations achieve interactive framerates for novel-view synthesis, but do not provide an explicit volumetric representation of the whole scene. The proposed approach shows the efforts in developing a GPU hardware-accelerated framework for obtaining the volumetric photo hull of a dynamic 3D scene as seen from multiple calibrated cameras. High performance is achieved by employing a shape from silhouette technique in advance to obtain a tight initial volume for shape from photo-consistency. Also several speed-up techniques are presented to increase efficiency. Since the entire processing is done on a single PC, the framework can be applied to mobile setups, enabling a wide range of further applications. The approach is explained using programmable vertex and fragment processors and compared to highly optimized CPU implementations. It is shown that the new approach can outperform the latter by more than one magnitude. The thesis is organized as follows: Chapter 1 contains an introduction, giving an overview with classification of related techniques, statement of the main problem, novelty of the proposed approach and its fields of application. Chapter 2 surveys related work in the area of dynamic scene reconstruction by shape from silhouette and shape from photo-consistency. The focus lies on high performance reconstruction and hardware-acceleration. Chapter 3 introduces the theoretical basis for the proposed [...]

Full 3D Reconstruction From Multiple RGB-D Cameras

Full 3D Reconstruction From Multiple RGB-D Cameras PDF Author: Owen Watson
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
Each pair is aligned by a two-phase procedure that transforms the data from the coordinate system of the camera at a lower level in the alignment tree to that of the higher. The transformation between each pair is catalogued and used to reconstruction of incoming frames from the cameras. Once calibrated, cameras are assumed to be independent and their successive frames are compared to detect motion. The catalogued transformations are updated on instances that motion is detected essentially correcting misalignment. \par At the end of the calibration process the reconstructed scene generated from the combined data would contain relative alignment accuracy throughout all regions. Using this proposed algorithm reconstruction accuracy of over 90% was achieved for systems calibrated with the angle between the cameras 45 degrees or more. Once calibrated the cameras can observe and reconstruct a scene on every frame. This is reliant on the assumption that the cameras will be fixed; however, in a practical sense this cannot be guaranteed. Systems maintained over 90% reconstruction accuracy during operation with induced misalignment. This procedure also maintained the reconstruction accuracy from calibration during execution for up to an hour. The fundamental contribution of this work is the novel concept of using overlap as a means of expressing how a group of cameras are connected. Building a spanning tree representation of the given system of cameras provides a useful structure for uniquely expressing the relationship between the cameras. A calibration procedure that is effective with low overlapping views is also contributed. The final contribution is a procedure to maintain reconstruction accuracy overtime in a mostly static environment.

Telepresence: Actual and Virtual

Telepresence: Actual and Virtual PDF Author: Thomas B. Sheridan
Publisher: CRC Press
ISBN: 1000774120
Category : Computers
Languages : en
Pages : 128

Get Book Here

Book Description
Telepresence: Actual and Virtual explores the history of telepresence from the 1948 developments of master–slave manipulation, through to current telepresence technology used in space, undersea, surgery and telemedicine, operations in nuclear and other hazardous environments, policing and surveillance, agriculture, construction, mining, warehousing, education, amusement, social media, and other contexts. It also describes the various operator hand and body controls and the corresponding telerobotic actuation of robotic hands, arms, and locomotion. This book reviews the sensing and control technology, its history and likely future, and discusses the many research and policy issues that are raised. The book also takes up key questions relating to social and ethical issues, given that a person’s mechanical reach is becoming unlimited, enabling one to perform mischievous or harmful acts without identification, and what that portends for future developments in telepresence, including regulation and recommended directions of development. The primary audience for this book is professionals interested in human–robot interaction, human factors engineering, virtual reality, applications to space and undersea exploration, telemedicine and telesurgery, firefighting, mechanized agriculture, policing, drone surveillance, warehouse parts' fetching, mining, and military operations.

MultiMedia Modeling

MultiMedia Modeling PDF Author: Cathal Gurrin
Publisher: Springer
ISBN: 3319041142
Category : Computers
Languages : en
Pages : 631

Get Book Here

Book Description
The two-volume set LNCS 8325 and 8326 constitutes the thoroughly refereed proceedings of the 20th Anniversary International Conference on Multimedia Modeling, MMM 2014, held in Dublin, Ireland, in January 2014. The 46 revised regular papers, 11 short papers and 9 demonstration papers were carefully reviewed and selected from 176 submissions. 28 special session papers and 6 papers from Video Browser Showdown workshop are also included in the proceedings. The papers included in these two volumes cover a diverse range of topics including: applications of multimedia modelling, interactive retrieval, image and video collections, 3D and augmented reality, temporal analysis of multimedia content, compression and streaming. Special session papers cover the following topics: Mediadrom: artful post-TV scenarios, MM analysis for surveillance video and security applications, 3D multimedia computing and modeling, social geo-media analytics and retrieval, multimedia hyperlinking and retrieval.