Photo adjustment for face modeling

Answered
Follow
Avatar
Arseniy
Greetings!

We have a problem with kids face photogrammetry. In some cases 3d model assembles correctly (smoothly):
kid1.jpg

and sometimes it adds a lot of noise:
kid2.jpg


We can't retake this photos, so we are looking for other ways to reduce this noise. What parameters should we adjust to correct this issue? Is this even possible?

Thanks a lot!
0

Comments

22 comments

Sort by Date Votes
  • Avatar
    Wishgranter
    Hi Arseniy
    Are you using a single camera scanning or multi camera head scanner ?
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Wishgranter wrote:
    Hi Arseniy


    Are you using single cam scanning or multi camera head scanner ?


    We using multi camera studio
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy

    Ok and the scanner is with FIXED cameras or you change the cam setup per subject ??
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    there is fixed cameras setup
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy
    create a mock-up with newspaper on them, approximately of the size of the subject head. the newspaper will help align it very well.
    then select ALL images and use METADATA (XMPs) and export camera positions, set the LOCKED option in the export settings of XMPs.

    But keep in mind the images MUST have the same filenames !!!! or it will not work..

    then just copy the XMPs next to the data you need to reconstruct and hit align. the XMPs will be used and no additional settings need to be used...
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Hello, Wishgranter!

    You mean to create a physical mockup and take a photo scan from that?
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy

    YES.. a mockup that will be used for calibration of the scanner....
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Okey, thank you!

    Ill try it and then report you :)
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    one more question..
    is it available to export XMPs in demo RC version ?
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy
    NO, from the demo you cannot export XMPs
    0
    Comment actions Permalink
  • Avatar
    Boris Goreta
    What are the 6 numbers in XMP file between xcr:Rotation marks, I was expecting 3, heading, pitch and bank. I need to put these manually in Lightwave. Position works.
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Boris
    Why don’t you use FBX to transfer the camera parameters ?
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Hello, Wishgranter!

    Here the results of my test.. The mockup camera calibrations is really good. But the same XMPs is not working on child photos. We have locked camera positions on the studio, but the angles coult be changed on 5-10%. Is that cause failure like that or I`d make some mistakes?

    Thanks a lot!
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy
    Interesting... do you have the same filenames for XMPs and images ?

    Can you send me the mockup data and test dataset so that I can take a look at it ?
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Yes, filenames is the same, I had check it couple of times

    Were should I send it? on your e-mail?
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy
    Yes, send it to my email
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    I`ve send it via https://wetransfer.com/, you might have a notification
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    Greetings, Wishgranter!

    Any news regarding my issue? Thanks!
    0
    Comment actions Permalink
  • Avatar
    steam
    Hi, one Idea, did you shoot raw photos?
    You can colorcorrect before processing, that might help too. Remember, also when you focus on your subject, your camera actually changes it's properties.
    0
    Comment actions Permalink
  • Avatar
    Arseniy
    vilem.duha wrote:
    Hi, one Idea, did you shoot raw photos?
    You can colorcorrect before processing, that might help too. Remember, also when you focus on your subject, your camera actually changes it's properties.


    Yes, you`re right, colorcorrection actually helps, but not too much
    0
    Comment actions Permalink
  • Avatar
    Wishgranter
    Hi Arseniy
    So I have inspected the dataset and:

    1. images are NOT in the same positions as the reference dataset for creating XMPs = moved, adjusted camera positions, angles ??
    or image names are not correct ? ( image numbering issue ? )
    that is why you get BAD reconstruction that is far away from ideal results, as your cameras have different angles from the reference data and it is not possible to use them....

    2. photos of kids are in JPEGs with pretty bad quality ? you did not send me the RAW files....
    0
    Comment actions Permalink
  • Avatar
    steam
    Arsenyi, some more tips:
    try setting in alignment settings image downscale factor to 1
    I am in a similar situation, reconstructing some data from a not much rich camera array(only 11 cams).This improved the calibration for me. But I have similar problem, some models are very noisy, while others smooth. It's a lot about the models skin shininess I think....

    Another important parameter is Adaptive blending start in advanced reconstruction settings. It can, If I understand it correctly, determine influence of depth maps, and in case of not having 360 degrees covered, it might improve the coverage. Sadly, by now the parameter can't go over 0.5. Default is 0.45. Wishgranter, would it be possible to allow higher values for this parameter? Not sure if I understood it right, but by my tests it behaves this way( direction of depthmap vs normal of suface -> depth map is used or not on a certain area).

    I am also curious if you find another ways to improve the result.
    0
    Comment actions Permalink

Please sign in to leave a comment.

Didn't find what you were looking for?

New post