Item


Joint estimation of segmentation and structure from motion

We present a novel optimisation framework for the estimation of the multi-body motion segmentation and 3D reconstruction of a set of point trajectories in the presence of missing data. The proposed solution not only assigns the trajectories to the correct motion but it also solves for the 3D location of multi-body shape and it fills the missing entries in the measurement matrix. Such a solution is based on two fundamental principles: each of the multi-body motions is controlled by a set of metric constraints that are given by the specific camera model, and the shape matrix that describes the multi-body 3D shape is generally sparse. We jointly include such constraints in a unique optimisation framework which, starting from an initial segmentation, iteratively enforces these set of constraints in three stages. First, metric constraints are used to estimate the 3D metric shape and to fill the missing entries according to an orthographic camera model. Then, wrongly segmented trajectories are detected by using sparse optimisation of the shape matrix. A final reclassification strategy assigns the detected points to the right motion or discards them as outliers. We provide experiments that show consistent improvements to previous approaches both on synthetic and real data

This work has been supported by the Spanish Ministry of Science and Innovation projects CTM2011-29691-C02-02. L. Zappella was supported by the Catalan government scholarship 2009FI B1 00068

Elsevier

Manager: Ministerio de Ciencia e Innovaci贸n (Espanya)
Author: Zappella, Luca
Del Bue, Alessio
Llad贸 Bardera, Xavier
Salvi, Joaquim
Date: 2013
Abstract: We present a novel optimisation framework for the estimation of the multi-body motion segmentation and 3D reconstruction of a set of point trajectories in the presence of missing data. The proposed solution not only assigns the trajectories to the correct motion but it also solves for the 3D location of multi-body shape and it fills the missing entries in the measurement matrix. Such a solution is based on two fundamental principles: each of the multi-body motions is controlled by a set of metric constraints that are given by the specific camera model, and the shape matrix that describes the multi-body 3D shape is generally sparse. We jointly include such constraints in a unique optimisation framework which, starting from an initial segmentation, iteratively enforces these set of constraints in three stages. First, metric constraints are used to estimate the 3D metric shape and to fill the missing entries according to an orthographic camera model. Then, wrongly segmented trajectories are detected by using sparse optimisation of the shape matrix. A final reclassification strategy assigns the detected points to the right motion or discards them as outliers. We provide experiments that show consistent improvements to previous approaches both on synthetic and real data
This work has been supported by the Spanish Ministry of Science and Innovation projects CTM2011-29691-C02-02. L. Zappella was supported by the Catalan government scholarship 2009FI B1 00068
Format: application/pdf
Document access: http://hdl.handle.net/10256/11544
Language: eng
Publisher: Elsevier
Collection: info:eu-repo/semantics/altIdentifier/doi/10.1016/j.cviu.2012.09.004
info:eu-repo/semantics/altIdentifier/issn/1077-3142
info:eu-repo/grantAgreement/MICINN//CTM2011-29691-C02-02/ES/ROBOT AUTONOMO SUBMARINO PARA LA INSPECCION Y MONITORIZACION DE EXPLOTACIONES DE ACUICULTURA MARINA/
Rights: Tots els drets reservats
Subject: Imatges -- Processament
Image processing
Visi贸 per ordinador
Computer vision
Title: Joint estimation of segmentation and structure from motion
Type: info:eu-repo/semantics/article
Repository: DUGiDocs

Subjects

Authors