84EM built a plugin that lets a client upload a CSV containing a list of URLs to bulk set the index/noindex value for the robots meta tag.
The plugin uses the Action Scheduler library for background processing, allowing the client to process thousands of URLs at a time in a fast & efficient manner.