tl;dr: Reality Capture uses masked pixels when projecting texture and it shouldn't.
I'm scanning a model where I intentionally need to key out the background. For this example, I used some neon pink sticky notes to highlight the problem:
I generated a mask in Photoshop by keying out the hue.
When processing the model, Reality Capture correctly ignores the masked area to generate the model.
Next, I reduce the model's poly count and project the texture.
As you can see, there's some pink showing through on the border of the model even though every pink pixel is masked out in the source photos. A closer view:
When running the simplify algorithm, a polygon is created between two peaks that doesn't exist in the high poly version. As a result, when projecting RC captures pink background pixels. RC should not use masked pixels when generating textures.
Please sign in to leave a comment.