Bentley systems linking AR, BIM and drones

13 September 2016

Bentley Systems is looking to combine BIM and augmented reality with drone technology to more accurately capture the progress of a construction project and spot mistakes in the process.

The company recently conducted an experiment around the Bentley office capturing video of the building during the construction of an extension to the second floor.

It then extracted all the frames from that video, and used them to create a mesh of the building scene using its own software known as ContextCapture technology. It then aligned the resulting mesh with a BIM model of the building. Finally, it used the calculated positions and orientations of each frame to augment them with the BIM model.

Although the resulting augmentation was not live, and took several minutes to calculate, the company believes such steady augmentation will become a mainstay of the industry and by using drones, camera positions are very accurate and will help with identifying delays or mistakes in the construction process. As technology moves on, the time could also be reduced so that the accompanying video is near or eventually live.

Using standard hand-held augmented reality, you could walk around the site with a tablet and you could view live augmentation of the site which would facilitate the identification of mistakes and delays.

Stephane Cote, research director at Bentley Systems, said that in the future a drone could frequently be flying around a construction site, taking photos, and uploading those to a server on the cloud, which would generate a mesh, align it with the BIM model, and augment the photos with the model.

Cote, said: “The experiment we did on the construction site was basically a research investigation.

“We wanted to see how drone photos and videos are used to monitor construction sites. And it happened that our Bentley building was being renovated, they were adding a new floor on top of the existing one, so it was an excellent site to use.

“The work of building site monitoring involves visiting the site on a regular basis, checking what has been built and whether the building corresponds to the plan. The sooner errors are detected the better, which is where the drone comes in.

He added: “The idea of drones is very interesting as it gives access to the vantage points that others cannot reach.

“The process could potentially be used on a regular basis, you just have to programme the drone to follow the same tasks over and over again everyday, so that every day you get a scan of the building.

“You could have a drone flying around all the time, covering every minute.”

As well as regular building site monitoring, Cote believes such technology would also be perfect for use in large infrastructure projects, at least as far as the outer shell of the asset is concerned.

A report last week highlighed that construction industry had the fastest uptake of use of drones.


Imagine, technology allowing us to remotely, safely and efficiently control earth moving machines on a construction site thru the use of a drone that is monitoring in real-time changes that are taking place as the machines do their work!

Richard, 12 September 2016

Leave a comment