CVI²

The 1st SHApe Recovery from Partial textured 3D scans (SHARP) Workshop and Challenge will be held in conjunction with ECCV on the afternoon of August 23, 2020, in Glasgow, Scotland.

An online participation is now possible, where physical presence in Glasgow is not required. 

Capturing complete 3D scans is challenging because of multiple factors including varying levels of details (e.g. finer anatomical parts and clothing wrinkles in human scans), occlusion, non-rigidity, movement, and optical properties (e.g., fabric, material, hair, reflection, texture patterns, etc.).

Photogrammetric capture systems can acquire 3D scan sequences at high frame rates but miss details, suffer from occlusion because of the fixed setup and are bulky. Hand-held scanners can adapt to the target, resolving finer details, handle more complex geometries and occlusion, but require longer acquisition time. In practice, these trade-offs result in partial data in the form of scans filled with inaccuracies, uncertainties and/or missing parts.

The goal of the proposed workshop and challenges is to promote the development of methods to recover a complete 3D scan from its partial acquisition. The acquisition time of hand-held scanners could be decreased if we could acquire partial information of an object and complete the missing areas as a post-processing step.

The quality of photogrammetric scans could be enhanced by completing the missing parts and correcting the areas of lower reliability. Advances in such methods would also impact applications more generally at both the industrial and the consumer levels. It would allow, for example, capturing more complex objects (e.g., complex clothing) and achieving higher-quality acquisitions on lower-end devices. Practical applications impacted by the proposed challenges include virtual reality, medical treatment, fitness monitoring and fashion. These challenges provide test-beds for developing novel methods of 3D scan completion.

1st place : Julian CHIBANE, and Gerard PONS-MOLL from Max Planck Institute for Informatics (MPII, Germany) were ranked first in the 3 challenges.

2nd place : The SnT team (Alexandre SAINT, Anis KACEM, Kseniya CHERENKOVA, and Djamila AOUADA) was ranked second in the two tracks of Challenge 1.

Artec 3D awarded a cash prize of 4kEuros to the 1^st place winners, and donated 2kEuros to UNICEF on behalf of the runner-up team, a mixed team from SnT, University of Luxembourg, and Artec 3D, composed of Alexandre Saint, Anis Kacem, Kseniya Cherenkova and Djamila Aouada.

Details of results are reported in [3] and can be accessed here.

[1] Chibane, J., Pons-Moll, G.: Implicit feature networks for texture completion of 3d data. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2020)

[2] Saint, A., Kacem, A., Cherenkova, K., Aouada, D.: 3dBooster: 3d body shape and texture recovery. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2020)

[3] Saint A., Kacem A., Cherenkova K.; Papadopoulos K., Chibane J., Pons-Moll G., Gusev G., Fofi D., Aouada D., and Ottersten B., SHARP 2020: The 1st shape recovery from partial textured 3D scans challenge results. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2020)

We propose two challenges. The task of the challenges is to reconstruct a full 3D textured mesh from a partial 3D scan. The first challenge is for human bodies, and the second challenge is for a variety of generic objects. These challenges launch two new unique datasets:

1) Challenge 1: Recovery of Human Body Scans.

This challenge is focused on textured 3D human body scans. It introduces a new unique dataset, 3DBodyTex.v2 – an extension of the 3DBodyTex data. It contains 3300 textured 3D body scans with tight-fitting or wide clothing, with a large variation in poses and in subjects.

By entering Challenge 1, participants agree to be bound by these Terms and Conditions.

2) Challenge 2: Recovery of Generic Object Scans.

This challenge is focused on textured 3D scans of generic objects. It introduces a new unique dataset, 3DObjectTex.v1 – a subset from the ViewShape repository – containing 2000 textured 3D scans of very diverse objects.

By entering Challenge 2, participants agree to be bound by these Terms and Conditions.

In an effort to give more researchers the opportunity to participate in the SHARP 2020 challenges, an online participation is now open. All tracks will be available with the same deadline for registration. Instead of submitting an accompanying paper, participants will be required to submit a code. Submitting an accompanying paper, to be included in the proceedings of ECCV, is still highly encouraged.

Participants in one or multiple tracks of the SHARP Challenge are expected to document their results by submitting:

– long papers (max 8 pages excluding references): when submitting completely original work, not previously published, accepted for publication, or under review in any peer-reviewed venue including journals, conferences or workshops.

– short papers (max 4 pages including references): when submitting a shared content with a paper accepted at ECCV (or any other conference, workshop or journal).

All accepted papers will be included in the ECCV 2020 conference proceedings. The papers will be peer-reviewed and they must comply with the ECCV 2020 proceedings style and format.