ESA title

Virtual Post-It

  • ACTIVITYKick-start Activity
  • STATUSOngoing
  • THEMATIC AREAInfrastructure & Smart Cities

Objectives of the service

The proposed solution addresses all of the pain points of construction review and provides a faster and more convenient solution. 

  • Instead of the description of the rework location, the reviewer simply pins the message in real 3D space which also registers on the BIM thereby accelerating the creation of the rework message

  • Instead of the description of the required rework, semantic signs and arrows are used thereby accelerating the creation of the rework message

  • Rework message and location automatically fed to a central database with a time stamp

  • Rework crew is guided to the rework location by visual navigation

  • Rework crew is shown semantic signs and arrows regarding the rework thereby overcoming linguistic barriers

  • Visual documentation of the rework is carried out and fed to the central database with a time stamp

  • Should it be required, the rework crew can initiate a call for remote assistance by the reviewer where both parties have the ability to draw upon their screen as a virtual canvas which is shared in real time and where the content is anchored to location in real 3D space

Users and their needs

The review of construction work is a crucial step in the construction process as it is the basis of the evaluation of the status of the project, quality deviations, and design conformance. Such reviews are currently mostly paper based, documented after the fact, and involve a significant back and forth between the reviewer and the rework crew. The “pain” in terms of the review include the following:

  • Description of the rework by the reviewer

  • Description of the location of the rework by the reviewer

  • Feeding of the rework message and status to a central database by the reviewer

  • Finding the location of the error by the rework crew

  • Interpreting the rework message by the rework crew, especially crews not speaking the local language

  • Documentation of the rework done by the rework crew

  • Extensive phone conversation between reviewer and rework crew without any visual guidance

Users thus need a tool that is capable of:

  • Fast rework message localization

  • Fast rework message creation

  • Automatic synchronization of status information

  • Visual navigation

  • Easy interpretation

  • Automatic documentation

  • Visual remote assistance

Service/ system concept

The main building blocks are:

Localization Engine (localizes wearer and recorded media vis-à-vis real 3D space and the BIM)

  • Shared Aperture Antenna

    • GNSS+cellular primary localization anchor characterized by seamless transition between the two (signal processing integrated into a hardhat)

    • Shared aperture MIMO antenna (mounted on hardhat)

SLAM

  • 2D/3D SLAM secondary localization anchor with camera(s) (mounted on hardhat)

Virtual Post-It Mobile interface (handset, tablet, smartglass)

  • Ability to create virtual post-its using easy to use interface w/ semantic signs

  • Ability to receive virtual post-its

  • Visual and textual rework status documentation capability

  • Navigation to location of virtual post-it

  • Remote Assistance capability with virtual canvas

Desktop interface 

  • Visualization of virtual post-its overlaid on the BIM 

  • Two-way communication to mobile interface

  • Fused image of BIM and project status based on media recorded during SLAM

Space Added Value

The main contribution of space assets is the permanent localization feature which is the main proprietary IP of the solution. Specifically, our localization engine consists of:

  • shared aperture MIMO antenna design capable of handling GNSS and cellular signals and use that to create primary anchors

  • SLAM including 2D/3D anchors as fixed points and inertial inputs in between as secondary anchors potential existing competitors

Current Status

The project is currently at the completion of technical and commercial feasibility with the technical architecture designed, the service concept ascertained based on customer outreach, technical and commercial partner search completed. The next steps are the creation of demos and presentation in real life situation funded by smaller grants. Afterwards a prototype will be developed using seed financing from venture sources and non-diluting equity grants.

Prime Contractor(s)

Status Date

Updated: 13 July 2022