Upgrade steps that need to survive server restarts

[hvelarde]

check this thread:

Best practices on reindexing the catalog

we are working on some upgrade steps for an add-on to make some changes on stuff like updating static resources and interfaces used and provided by a Dexterity-based content type. as part of the upgrade process we need to reindex all items in the catalog for this specific content type and that could be tricky sometimes as sites could have tens of thousands of object instances. my main concerns here are memory usage, speed and resiliency. this is the code we have right know: def get_valid_obj…