Running out of memory during alignment

Answered

Comments

8 comments

  • Avatar
    Jules_A

    I have the same kind of issue. Same kind of powerful workstation. This is a new bug.

    The latest update?

    1
    Comment actions Permalink
  • Avatar
    Zuzana Ďuríčková CR

    Hello,  

    what alignment settings do you use? With the default settings you are able to align approx. 16K images at once on a machine with 128 GB of RAM.

    In order to align this number of inputs, you need to lower the Max features per image or use components workflow. 

    1
    Comment actions Permalink
  • Avatar
    John B

    Hello Zuzana,

    thank you for your response and support. Just today I did reset the application like a clean install. This helped me to register 14k along with a lot of little components.

    My first question concerning this problem and so that I can get this straight: Can I even align that many photos (20-25k) with my setup and if yes only in batches? If no... the out of core algorithm would not compensate the lack of RAM?

     

    0
    Comment actions Permalink
  • Avatar
    John B

    Any thoughts on my last question?

    0
    Comment actions Permalink
  • Avatar
    Erik Kubiňan CR
    Yes, it should be possible with the following technique - Whenever you try to work with such big number of images (larger than what the limit is -16K for your 128 RAM) you should split your images into at least 3 separate components. Once you do this, select all of the images and in the "Selected input" menu go to Feature source option and set it to "Use component features". Also navigate to alignment settings and in the advanced set "Merge components only" to Yes.
    1
    Comment actions Permalink
  • Avatar
    Mark Christensen

    As an option, you can just increase your computers virtual memory aka paging file size on you systems hard drive. I only recommend using with an ssd system drive. I only have 64gb of ram and use 200gb of virtual memory and am processing 30k images at 70000 features per picture. Using virtual memory means not a efficient as using ram only, but it works for me.

    1
    Comment actions Permalink
  • Avatar
    Jonathan Banz

    Thank you Mark—That is very good point. I have just added my entire optane harddrive (450GB) to the virtual memory. How do you see that RC actually takes advantage of the additional virtual memory during the process?

    0
    Comment actions Permalink
  • Avatar
    Erik Kubiňan CR

    You can get a realtime drive checking software to see the usage of it. There will also be other solutions on the web as paging file is quite popular and a real good solution here too, without it if your memory leaks and there is none it can get stuck.

    0
    Comment actions Permalink

Please sign in to leave a comment.