10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 1/9

User Name Password

Remember Me?

Register Help

Log in

What's New? BA Facebook Search...Get Started in Blender Site Help

Advanced SearchToday's Posts FAQ Calendar Mark Forums Read Community Forum Actions Quick Links

Forum Support Tutorials, Tips and Tricks How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To startviewing messages, select the forum that you want to visit from the selection below.

[ ] Hide Feature Row

Thread: How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

Advertise Here

Results 1 to 20 of 40

Page 1 of 2 1 2 Last

6 people like this. Be the first of yourfriends.

Like

Thread Tools Search Thread

30Dec12, 07:02

How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

More than ever before 3D models have become a "physical" part of our life, how we can see in the internet with 3D services ofprinting.

Some people have many difficult to get a model to print... well, not only to print, but to write an scientific article, make a job, or justhave fun.

With this tutorial you'll learn how to scan 3D objects to use it the way you want.

To read the entire tutorial, please see this link: http://arcteamopenresearch.blogsp...turesand.html

Thank you all for participate of the post. Because this I'll put more information.

Thanks to Rgaidao to share this links with us >

Using Meshlab you now have three options to achieve it:

1) Transfer point cloud color information to the mesh (already covered in the tutorial). A good option when you have very detailedpoint clouds, but not very good when using sparse or incomplete point clouds.

2) Use osmbundler camera parameters to transfer color information from raster images to the mesh.

#1

Join Date:Location:Posts:

Jul 2005SinopMT, Brazil93

cogitas3d Member

Forum

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 2/9

see:http://www.youtube.com/watch?v=iLs5I..._ZAJ0Osrm6TyTg

3) Use osmbundler camera parameters to create a raster texture, combining different raster images and mapping it(parametrization) to the mesh.

see:http://www.youtube.com/watch?v=OJZRuIzHcVw

To do all this you just need to open as a project, inside meshlab, the PPT output file "bundle.out" and after that the respective"list.txt". The first file concerns to camera parameters and the second to associated raster images. After that just follow thealready mentioned (and fantastic) Mr. P tutorials.

And you have the posibility to project the texture on Blender, using an add on that imports .OUT files:

http://projects.blender.org/tracker/...d=153&atid=467

The final result is like this:

Sphynx statue SfM reconstruction

A big hug!

Last edited by cogitas3d; 31Dec12 at 08:18. Reason: increase information

www.ciceromoraes.com.br

Reply With Quote

30Dec12, 10:31

This vs "123d catch", how does it compare?

#2

Join Date:Posts:

Oct 200990

swepower Member

Reply With Quote

30Dec12, 18:28

swepower,123d catch and Bundler+ PMVS2 are based upon the same principles, photogrammetric reconstruction. Here a short list of prosand cons for the two:

123D CatchPro: Output is a fully textured mesh (.obj format)Mininmal user input, just upload the pictures and download the finished model(Probably) high quality settings for undistorting, matching and reconstruction since they use large clusters*

Con:Max. input resolution of the images is 3 megapixels (they resize automatically)Output is limited to max. amount of triangles and texture size**You don't know what happens to your input data

#3

Join Date:Location:Posts:

May 2011Berlin113

Scrible Member

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 3/9

Bundler+PMVSPro:No "artificial" limitation on input and output size (as much as your pc memory can handle)Settings can be adjusted for different scenariosOpen sourceYou know what has been done with your data

Con:It's just a pointcloud. Meshing and texturierung are additional, time consuming tasks.Depending on the imagery, point cloud can be quite noisy.PMVS (for dense reconstruction) can be very heavy on memory***

* More of a guess than a proveable fact.** Haven't used it in awhile, not quite sure what the current limit is. Used to be around 1,3 million triangles.*** With a couple hundred images at full resolution, 32GB RAM are used easily.

It's kinda late here, so probably I forgot something. But that's what I have in mind right now. Maybe I'll edit in the morning with aclear head.

cogitas3d,thanks for the tutorial. I'm sure some ppl will find it quite useful. Have you heard/ used VisualSFM yet? You might want to take a look at it; it's a nice GUI for the entire matching andreconstruction process.

Cheers.

Reply With Quote

30Dec12, 20:18

Also 123d catch is owned by Autodesk and closesourced while this is open source, right?

#4

Join Date:Posts:

Jul 201261

Jecimi Member

Originally Posted by swepower

This vs "123d catch", how does it compare?

Reply With Quote

31Dec12, 05:17

Hi all,

PPT (Python Photogrametry Toolbox) is open source and based on Bundler, CMVS and PMVS2.

123d catch, as you wrote, is closed source and owned by Autodesk

VisualSFM is, unfortunatley, also closedsource (just freeware), at least the last time I checked it. Here(http://homes.cs.washington.edu/~ccwu/vsfm/README) is the the README fiel, with the license.

Ciao.

#5

Join Date:Posts:

Dec 20126

luca_bezzi Member

Originally Posted by Jecimi

Also 123d catch is owned by Autodesk and closesourced while this is open source, right?

Reply With Quote

31Dec12, 06:21

Here is the result of using the "Kermit" example images supplied with PPT using AutoDesk 123D Catch :

#6

Join Date:Posts:

Jul 20021,397

Rhysy 2 Member

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 4/9 Attached Thumbnails

And here is Kermit using PPT, following cogitas3d's tutorial :

From my own fumbling experiments (thanks cogitas3D for the tutorial !) I've found that 123DCatch is much more stable (PPT tendsto crash a lot for no reason) and deals better with shadows. PPT does not seem to have any options for manual stitching. Also,there seems to be a bug if you use the "rescale images" option I found that it basically just didn't work using this, whereas I gotsomething useable if I resized the images myself. And of course, both of them suffer from terrible, terrible names (why PPT ? why123D catch ? why not Photogram... or Bundler, or something...)

That said, the results posted my cogitas3D speak for themselves. Clearly it can generate very high quality results if you actuallyknow what you're doing. I'm definitely going to persist with, I've got dozens of dinosaur and other figurines just sitting idle except forwhen my 3year old nephew isn't using them, and obviously he can't appreciate them as much as I do...

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 5/9

Attached Thumbnails

Rhysy.Net a nice facetious website dedicated to the art of Rhysy now works in all browsers ! Hurrah !Physicists of the Caribbean follow my pointless adventures in a blog

Reply With Quote

31Dec12, 07:57

Ppt

HI Rhysy 2,The quality of work with PPT depends very much from the quality of the photoset. The kermit is 640x480 pixel, so very low. Thedifference you noticed in your test is caused by the texture. If you see in the two pictures the meshes are almost the same (but inthe one of PPT it is possible to see the right hand of Kermit, which is missing in the one of 123D catch), but the first image has areal texture (done with real picture on the 3D mesh), while in the second image (the one of PPT) the color informations are takenfrom the 3D pointcloud and "coated" on the 3D surface. If you will use the real pictures to do a texture for your PPT model, you willsee that the final result will look better.

Anyway it is possible to obtain good 3D model with PPT also with bad pictures, as in this example (bad light condition, high ISOvalues, etc...): http://arcteamopenresearch.blogsp...meshwith.html

This is a normal project done with PPT: http://arcteamopenresearch.blogsp...xpptand.html

Ciao.

#7

Join Date:Posts:

Dec 20126

luca_bezzi Member

Reply With Quote

31Dec12, 08:22

Hi Rhysy 2!

123D Catch in this case appear better because the light is active on Meshlab and smooth not. If you project the texture it will bebetter too, in PPT. On the 123D Cach viewer you see the object with texture, smooth and without light active.

See ya

#8

Join Date:Location:Posts:

Jul 2005SinopMT, Brazil93

cogitas3d Member

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 6/9

www.ciceromoraes.com.br

Reply With Quote

31Dec12, 10:15

I agree, the mesh in this case is better from PPT compared to 123D. What I'm wondering is...

... what makes a good photoset ?

#9

Join Date:Posts:

Jul 20021,397

Rhysy 2 Member

The quality of work with PPT depends very much from the quality of the photoset.

Rhysy.Net a nice facetious website dedicated to the art of Rhysy now works in all browsers ! Hurrah !Physicists of the Caribbean follow my pointless adventures in a blog

Reply With Quote

31Dec12, 11:04

Nice question.

There are several aspects which contribute to the final quality of the reconstruction.

1. CameraThe quality of the lens is fairly important. A good lens has less spheric and chromatic abberation, which influences the accuracy ofthe detected features of overlapping images. Furthermore it is important that the lens really can "use" the resolution of the sensor;a 15 megapixel sensor doesn't help you if the lens isn't good enough to properly transmit the light information onto the sensor.The resolution itself can be important too. As luca said, 640 x 480 is fairly low to achieve a high quality of reconstruction. The moreinformation recorded, the more can be reconstructed.

2. Image SetOf course it is important how one takes the images. The sets have to have a certain amount of overlap viewed from differentdirections. There are a couple of rules how big the angle between two overlapping images should be, but I have to confess, I don'thave them in mind right now.The images should be completely in focus, blur adds to inaccurate results. Just keep in mind, that for example a aperture of 22doesn't give you the most crisp images due to the diffraction effect here is a nice example.

3. Lighting conditionsIdeal lighting for the object of interest is a diffuse light source. Outdoors you get the best results on a cloudy day.Due to the low dynamic range of cameras sunlight can have quite a negative influence; strong shadows can lead to errors or to noreconstruction at all.In my personal experience, a change in lighting is not beneficial. So taking images for some hours does result in quite a change oflight direction (regarding direct sun light). Clouds can be quite unpredictable, sudden changes in density results in differentbrightness.The direction of the lighting has also an impact on the final results fine details, which are only visible when lighting the object fromthe side, can't be captured if the light doesn't show it.

4. The object of interestFor photogrammetry to work you need texture. This is essential, a white wall with little texture can't be reconstructed since there isno information for matching and calculating a point cloud. The more texture, the better.Also, this won't work on very glossy surfaces or transparent ones since every viewing angle results in a fairly different lighting.

I bet there is a lot more to it, most likely I forgot half.

There a lots of tutorials and further information out there on the web.Cheers.

btw. lucas, does PPT have a tool for georeferencing (and scaling) the reconstruction?

#10

Join Date:Location:Posts:

May 2011Berlin113

Scrible Member

Originally Posted by Rhysy 2

... what makes a good photoset ?

Reply With Quote

01Jan13, 04:28

Sorry, I was writing a very long answer but than I notice I could not replay to the thread and I lost it. I try to summarize:

There are many ways to "georeference" the reconstruction, but there are not specific tools in PPT. This is our (ArcTeam, www.arcteam.com) way: we put near the object we want to document 4 (better more) targets (Ground Control Points, GCP), like in normalphotogrammetry (2D or 3D). Than we register the GCP's coordinates with a total station or a GPS (of corse you ca do it also"manually", but we work on beig archaeological areas and we need to be fast). Once collected all the data (photos and CP) andelaborated the 3D pointcloud, we build 4 small cubes with the coordinates of the GCP (with Blender or FreeCAD), than we importthem in MeshLab (.ply is a good file format) and then we "georeference" the 3D pointcloud with a tool called "pick up points" (moreor the in the same way you would georeference and rectify a normal 2D photo with normal GCP). At this point, the model has theright dimensions and the right inclination. This system is fast and simple if you work with local coordinates systems, but is a littlebit tricky if you want the model in a real geographic system (like UTMWGS84), because MeshLab does not support geographiccoordinates (are too big), so you have to cut the cifres in the GCP (better till the last 3 cifres before the comma) and restore themin the final ply surce file.

#11

Join Date:Posts:

Dec 20126

luca_bezzi Member

Originally Posted by Scrible

btw. lucas, does PPT have a tool for georeferencing (and scaling) the reconstruction?

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 7/9

Onether way is to georerence everything directly in GRASS GIS (the way we use modt, actuay). You can read here a tutorial aboutit: http://arcteamopenresearch.blogsp...withopen.htmlIn this last way you van keep geographic coordinates (of corse is not a problem for GRASS), but kkep in mind that sooner or lateryou have to build the mesh with a meshediting software, like MeshLab (building the surface in a GIS is not a good idea forcomplex models...). I hope it was useful. Ciao.

Reply With Quote

01Jan13, 11:32

Thanks for those tips Scrible, they definitely help !

Here is another attempt using my own higherresolution images. I had to reduce them to 2000x1500 (50% of full fize) PPTcrashes at their full size (perhaps I should be using 64bit Python); also 3MP is the limit for 123D. Still, the higher resolution andbetter lighting makes a very big difference.

Here are the results using 123D (light side, dark side, textured view) :Attachment 209690

And here is the result from PPT (same views + Mesh Lab point cloud) :

The Mesh Lab view shows that PPT did a good job of constructing the point cloud, albeit not as good as 123D in the shaded areas.Mesh Lab seems to have more problems filling in the missing data than 123D however, hence the strange lumps beneath themouth and tail. I guess I need to a couple more light sources and take some pictures from below.

Still, getting better... and happy new year to everyone !

#12

Join Date:Posts:

Jul 20021,397

Rhysy 2 Member

Rhysy.Net a nice facetious website dedicated to the art of Rhysy now works in all browsers ! Hurrah !Physicists of the Caribbean follow my pointless adventures in a blog

Reply With Quote

01Jan13, 14:26

Hi Rhysy 2!

I'm curious with the results, but one of these doesnt appear. Can you send again?

And have the possibility of you share the pictures to us make a test too?

A big hug and happy new year!

#13

Join Date:Location:Posts:

Jul 2005SinopMT, Brazil93

cogitas3d Member

www.ciceromoraes.com.br

Reply With Quote

01Jan13, 17:33

Sure ! Here are the original attachments :www.rhysy.net/WIPS/123D.jpgwww.rhysy.net/WIPS/PPTViews.jpg

And here is a zip file of all the TRex images (134mb) :www.rhysy.net/WIPS/TRexPhotos.zip

#14

Join Date:Posts:

Jul 20021,397

Rhysy 2 Member

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 8/9

Rhysy.Net a nice facetious website dedicated to the art of Rhysy now works in all browsers ! Hurrah !Physicists of the Caribbean follow my pointless adventures in a blog

Reply With Quote

02Jan13, 07:02

Hi Rhysy 2!

A did the test and appear similar to your experiment.

When I do a reconstruction I take pictures around the objects with some levels of height.

Thank you for share the files and tests, this will help us to increase the quality of the technique.

Happy new year and a big hug!

#15

Join Date:Location:Posts:

Jul 2005SinopMT, Brazil93

cogitas3d Member

www.ciceromoraes.com.br

Reply With Quote

02Jan13, 12:08

hi therei tried to install Python Photogrametry Toolbox on ubuntu 12.10, but i couldn't can anyone help me please

#16

Join Date:Posts:

Jan 20134

nawwaf Member

Reply With Quote

02Jan13, 16:59

Hi nawwaf! Whats happen?

Did you install the dependences before?

A big hug!

#17

Join Date:Location:Posts:

Jul 2005SinopMT, Brazil93

cogitas3d Member

www.ciceromoraes.com.br

Reply With Quote

02Jan13, 23:54

first thank you for your concern.

I will tell you what i did:1. I downloaded 2 files under ArcheOS 4 32bit / Debian 6 (Squeeze) 32bit (because i didn't konw which one to use) from: http://arcteamopenresearch.blogsp...turesand.html

2. Unzipped them trying to follow the instructions on: http://arcteamopenresearch.blogsp...turesand.html

3. i couldn't find the ppt_gui_start to edit it.

4. setting in front of my screen lost & confused

by the way i don't know what do you mean by dependencessorry for my bad englishthanks again

#18

Join Date:Posts:

Jan 20134

nawwaf Member

Originally Posted by cogitas3d

Hi nawwaf! Whats happen?

Did you install the dependences before?

A big hug!

Reply With Quote

02Jan13, 23:58

sorry but i don't know how to delete this post.. so i delete the text

#19

Join Date:Posts:

Jan 20134

nawwaf Member

Last edited by nawwaf; 03Jan13 at 09:05. Reason: sorry but i don't know how to delete this post

10/4/2015 How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

http://blenderartists.org/forum/showthread.php?276668Howtomake3dscanwithpicturesandthePythonPhotogrammetryToolboxGUI 9/9

CGCOOKIE Network

Blender Cookie

Blender Workshops

SITE SUPPORT

Contact Team Leader

Website Support Forum

Advertise

Support Blender

BLENDER ARTIST SOCIAL NETWORKS

Facebook Group

Twitter

POWER BY CG COOKIE

About CG Cookie

Studio

Wordpress Plugins

All times are GMT 5. The time now is 08:03.

Powered by vBulletin® Version 4.2.2 Copyright © 2015 vBulletin Solutions, Inc. All rights reserved.

Part of the Blender Cookie Training Network All trademarks and copyrights owned by their respective owners. Comments are owned by the Poster.

Forum Support Tutorials, Tips and Tricks How to make 3d scan with pictures and the Python Photogrammetry Toolbox GUI

« Previous Thread | Next Thread »

Reply With Quote

03Jan13, 06:20

Hey Rhysy,I took a look at your images and one thing I noticed, which I haven't mentioned before is that using a high ISO does influence thequality of the reconstruction due to the additional noise.

Try setting up a brighter enviroment or use a tripod for the images. Use the lowest ISO as possible (50/ 100) and it might improvethe results.

Cheers.

#20

Join Date:Location:Posts:

May 2011Berlin113

Scrible Member

Originally Posted by Rhysy 2

And here is a zip file of all the TRex images (134mb)

Reply With Quote

Page 1 of 2 1 2 Last

Blender Artists Facebook GroupBlender NationBlender Cookie

Bookmarks

You may not post new threadsYou may not post repliesYou may not post attachmentsYou may not edit your posts

Posting Permissions

BB code is OnSmilies are On[IMG] code is On[VIDEO] code is OnHTML code is Off

Forum Rules

BA: Dark Theme BlenderArtistsArchiveTop

© 2014 CG Cookie, Inc. All Rights Reserved. Terms & Privacy.