Photo adjustment for face modeling
Answered
Greetings!
We have a problem with kids face photogrammetry. In some cases 3d model assembles correctly (smoothly):
and sometimes it adds a lot of noise:
We can't retake this photos, so we are looking for other ways to reduce this noise. What parameters should we adjust to correct this issue? Is this even possible?
Thanks a lot!
We have a problem with kids face photogrammetry. In some cases 3d model assembles correctly (smoothly):
kid1.jpg
and sometimes it adds a lot of noise:
kid2.jpg
We can't retake this photos, so we are looking for other ways to reduce this noise. What parameters should we adjust to correct this issue? Is this even possible?
Thanks a lot!
-
kid1.jpg
-
kid2.jpg
-
Hi Arseniy
Are you using a single camera scanning or multi camera head scanner ? -
Wishgranter wrote:Hi Arseniy
Are you using single cam scanning or multi camera head scanner ?
We using multi camera studio-
stud.jpg
-
-
Hi Arseniy
Ok and the scanner is with FIXED cameras or you change the cam setup per subject ?? -
there is fixed cameras setup
-
Hi Arseniy
create a mock-up with newspaper on them, approximately of the size of the subject head. the newspaper will help align it very well.
then select ALL images and use METADATA (XMPs) and export camera positions, set the LOCKED option in the export settings of XMPs.
But keep in mind the images MUST have the same filenames !!!! or it will not work..
then just copy the XMPs next to the data you need to reconstruct and hit align. the XMPs will be used and no additional settings need to be used... -
Hello, Wishgranter!
You mean to create a physical mockup and take a photo scan from that? -
Hi Arseniy
YES.. a mockup that will be used for calibration of the scanner.... -
Okey, thank you!
Ill try it and then report you :) -
one more question..
is it available to export XMPs in demo RC version ? -
Hi Arseniy
NO, from the demo you cannot export XMPs -
What are the 6 numbers in XMP file between xcr:Rotation marks, I was expecting 3, heading, pitch and bank. I need to put these manually in Lightwave. Position works. -
Hi Boris
Why don’t you use FBX to transfer the camera parameters ? -
Hello, Wishgranter!
Here the results of my test.. The mockup camera calibrations is really good. But the same XMPs is not working on child photos. We have locked camera positions on the studio, but the angles coult be changed on 5-10%. Is that cause failure like that or I`d make some mistakes?
Thanks a lot!-
695Без имени-1 копия.jpghttps://www.capturingreality.com/forum/download/file.php?id=6952097281imageFile jpgБез имени-1 копия.jpg
-
696Без имени-1 копия2.jpghttps://www.capturingreality.com/forum/download/file.php?id=6962097281imageFile jpgБез имени-1 копия2.jpg
-
-
Hi Arseniy
Interesting... do you have the same filenames for XMPs and images ?
Can you send me the mockup data and test dataset so that I can take a look at it ? -
Yes, filenames is the same, I had check it couple of times
Were should I send it? on your e-mail? -
Hi Arseniy
Yes, send it to my email -
I`ve send it via https://wetransfer.com/, you might have a notification
-
Greetings, Wishgranter!
Any news regarding my issue? Thanks! -
Hi, one Idea, did you shoot raw photos?
You can colorcorrect before processing, that might help too. Remember, also when you focus on your subject, your camera actually changes it's properties. -
vilem.duha wrote:Hi, one Idea, did you shoot raw photos?
You can colorcorrect before processing, that might help too. Remember, also when you focus on your subject, your camera actually changes it's properties.
Yes, you`re right, colorcorrection actually helps, but not too much -
Hi Arseniy
So I have inspected the dataset and:
1. images are NOT in the same positions as the reference dataset for creating XMPs = moved, adjusted camera positions, angles ??
or image names are not correct ? ( image numbering issue ? )
that is why you get BAD reconstruction that is far away from ideal results, as your cameras have different angles from the reference data and it is not possible to use them....
2. photos of kids are in JPEGs with pretty bad quality ? you did not send me the RAW files.... -
Arsenyi, some more tips:
try setting in alignment settings image downscale factor to 1
I am in a similar situation, reconstructing some data from a not much rich camera array(only 11 cams).This improved the calibration for me. But I have similar problem, some models are very noisy, while others smooth. It's a lot about the models skin shininess I think....
Another important parameter is Adaptive blending start in advanced reconstruction settings. It can, If I understand it correctly, determine influence of depth maps, and in case of not having 360 degrees covered, it might improve the coverage. Sadly, by now the parameter can't go over 0.5. Default is 0.45. Wishgranter, would it be possible to allow higher values for this parameter? Not sure if I understood it right, but by my tests it behaves this way( direction of depthmap vs normal of suface -> depth map is used or not on a certain area).
I am also curious if you find another ways to improve the result.
Please sign in to leave a comment.
Comments
22 comments