Skip to content

[Process] add a process manager allowing to run commands in parallel (queueing up if needed) #8454

@gggeek

Description

@gggeek

A common pattern when writing batch scripts importing huge number of existing data into an app is to write the batch script so that it can execute its work in parallel. Running the script with eg. 8 instances in parallel allows to finish the import task in a fraction of the time.
Depending on the platform in use, the developer might use forking, threading, pnctl and a myriad other techniques to achieve parallelism. There's no rocket science in that code, but it still quite a chore and bug-prone.

I suggest that the Sf Process component gets extended with a process manager class, which can be used to execute multiple processes in parallel.

Sample code - not based on Sf currently - is available at https://gist.github.com/gggeek/5956177 for discussion

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      pFad - Phonifier reborn

      Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

      Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


      Alternative Proxies:

      Alternative Proxy

      pFad Proxy

      pFad v3 Proxy

      pFad v4 Proxy