Augmented reality with Luxrender. The process

Post your tests, experiments and unfinished renderings here.

Moderator: coordinators

Augmented reality with Luxrender. The process

Postby aldozang » Wed Aug 18, 2010 11:20 pm

Scene Rendered with a modified Luxrender version. We added artificial objects in a real scene (buddha, dinossaur and sphere). The interactions between this artifical objects and the real scene (caustics, reflections, shadows, ...) were mapped in a final scene directly by our Luxrender version during rendering.
lab126-mesa-final.jpg
Image 1. Path tracing. The first example.


background-ar.jpg
Image 4. Background of the real scene.


augmented-reality.jpg
Image 5. Rendering obtained with latest version. Correction of the geometry and reflection between "virtual support" surfaces.

THE PROCESS

1- Capture the environment light using a mirrored ball.
environment.JPG
Image 2. Mirrored ball used for capture the light of the environment.


2- Use a checkerboard pattern to calibrate the camera position (Tsai method). In these example I have calculated 2 cameras position (the position of the camera for capturing the environment light and the camera for capture the backgound of the scene).
camera-calib.png
Image 3. Photograph of the background with the checkerboard pattern to calibrate the camera position. Drew the position of the mirrored ball used for capture the illumination.


3- Using the data of 1 and 2 we obtain the result Image 1.
Last edited by aldozang on Thu Aug 26, 2010 3:46 pm, edited 5 times in total.
User avatar
aldozang
Developer
 
Posts: 79
Joined: Wed Dec 16, 2009 4:02 pm
Location: Rio de Janeiro, Brasil

Re: Augmented reality

Postby Poncho » Thu Aug 19, 2010 2:54 am

looks nice, the glass dino looks a bit fake somehow... :)
Cheers!
User avatar
Poncho
Developer
 
Posts: 1127
Joined: Sun Nov 30, 2008 11:47 am
Location: Northwood

Re: Augmented reality

Postby ameuret » Thu Aug 19, 2010 3:31 am

Wow !

For someone who has struggled many hours on compositing luxrender results in physical scenes this is a dream to imagine an integrated solution !

What sampler/integrator is allowed by your version ? What is based on 0.6, 0.7 ?

Do you plan to hand over your code to the official team ?

Congratulations !

-- Arnaud.
ameuret
 
Posts: 34
Joined: Sat Jan 09, 2010 6:43 am
Location: Villemoisson sur Orge, France

Re: Augmented reality

Postby SATtva » Thu Aug 19, 2010 9:41 am

Very nice indeed. I second the question. Are you planning to share?
Linux builds packager
聞くのは一時の恥、聞かぬのは一生の恥
User avatar
SATtva
Developer
 
Posts: 6090
Joined: Tue Apr 07, 2009 12:19 pm
Location: from Siberia with love

Re: Augmented reality

Postby aldozang » Fri Aug 20, 2010 5:30 pm

This work is part of a project that we developed in the Visgraf-IMPA laboratory (Brazil). This is a first version of the framework for augmented reality rendering. We are now doing some tests and later be making available the code for that can be incorporated into future versions of luxrender (if the authors believe it should). The Luxrender version used is 0.7 (changeset 2357 8d6bc72f3a89 (July 19), from Mercurial repository). All sample type are available, but only dirctlighting and path integrators are are only functional for augmented reality.

Thank you all for your interest!
User avatar
aldozang
Developer
 
Posts: 79
Joined: Wed Dec 16, 2009 4:02 pm
Location: Rio de Janeiro, Brasil

Re: Augmented reality

Postby Synthercat » Sat Aug 21, 2010 2:11 am

Can't wait for this sharing!
Perception is the most important virtue .-
User avatar
Synthercat
 
Posts: 138
Joined: Tue Nov 10, 2009 4:06 am
Location: Thessaloniki Greece

Re: Augmented reality

Postby AJM » Sat Aug 21, 2010 9:44 am

The only thing I have to comment on is that the reflections of both the Maya box and book on the table don't show up in the sphere, and the book isn't transferred through the glass dino. Other than that, it's a good render.
AJM
 
Posts: 14
Joined: Mon May 24, 2010 10:11 pm

Re: Augmented reality

Postby aldozang » Sat Aug 21, 2010 12:01 pm

The reflections of the book are not correct because the book was rendered directly on the table without having an own geometric model (I'm not an expert in modeling, so the examples are simple). The reflections on the ball also does not seem right, but got the same results with the original version of LuxRender, then there may be something wrong with one method. The idea of these tests is to see the errors, identify the functions and correct them.

thanks for the sincerity! :)

PS: I posted in the wrong forum, should be work in progress!
User avatar
aldozang
Developer
 
Posts: 79
Joined: Wed Dec 16, 2009 4:02 pm
Location: Rio de Janeiro, Brasil

Re: Augmented reality

Postby Lord Crc » Sat Aug 21, 2010 8:35 pm

I took the liberty of moving the topic :)

Looks very good, I'm certain a lot of users would be happy if we could merge this back into the official version.
May contain traces of nuts.
User avatar
Lord Crc
Developer
 
Posts: 4932
Joined: Sat Nov 17, 2007 2:10 pm

Re: Augmented reality

Postby aldozang » Tue Aug 24, 2010 9:33 pm

I fixed some bugs in the routines of reflections (now the reflections on the sphere are calculated correctly. Then I'll post a new example to show these corrections)
Now I'm working to fix other errors. :)
User avatar
aldozang
Developer
 
Posts: 79
Joined: Wed Dec 16, 2009 4:02 pm
Location: Rio de Janeiro, Brasil

Next

Return to Works in Progress

Who is online

Users browsing this forum: No registered users and 2 guests