LSSTApplications
19.0.0-14-gb0260a2+72efe9b372,20.0.0+7927753e06,20.0.0+8829bf0056,20.0.0+995114c5d2,20.0.0+b6f4b2abd1,20.0.0+bddc4f4cbe,20.0.0-1-g253301a+8829bf0056,20.0.0-1-g2b7511a+0d71a2d77f,20.0.0-1-g5b95a8c+7461dd0434,20.0.0-12-g321c96ea+23efe4bbff,20.0.0-16-gfab17e72e+fdf35455f6,20.0.0-2-g0070d88+ba3ffc8f0b,20.0.0-2-g4dae9ad+ee58a624b3,20.0.0-2-g61b8584+5d3db074ba,20.0.0-2-gb780d76+d529cf1a41,20.0.0-2-ged6426c+226a441f5f,20.0.0-2-gf072044+8829bf0056,20.0.0-2-gf1f7952+ee58a624b3,20.0.0-20-geae50cf+e37fec0aee,20.0.0-25-g3dcad98+544a109665,20.0.0-25-g5eafb0f+ee58a624b3,20.0.0-27-g64178ef+f1f297b00a,20.0.0-3-g4cc78c6+e0676b0dc8,20.0.0-3-g8f21e14+4fd2c12c9a,20.0.0-3-gbd60e8c+187b78b4b8,20.0.0-3-gbecbe05+48431fa087,20.0.0-38-ge4adf513+a12e1f8e37,20.0.0-4-g97dc21a+544a109665,20.0.0-4-gb4befbc+087873070b,20.0.0-4-gf910f65+5d3db074ba,20.0.0-5-gdfe0fee+199202a608,20.0.0-5-gfbfe500+d529cf1a41,20.0.0-6-g64f541c+d529cf1a41,20.0.0-6-g9a5b7a1+a1cd37312e,20.0.0-68-ga3f3dda+5fca18c6a4,20.0.0-9-g4aef684+e18322736b,w.2020.45
LSSTDataManagementBasePackage
|
Classes | |
class | Cache |
class | Comm |
class | Debugger |
class | NoOp |
class | PickleHolder |
class | Pool |
class | PoolMaster |
class | PoolNode |
class | PoolSlave |
class | PoolWrapper |
class | PoolWrapperMeta |
class | ReductionThread |
class | SingletonMeta |
Metaclass to produce a singleton. More... | |
class | Tags |
Functions | |
def | unpickleInstanceMethod (obj, name) |
def | pickleInstanceMethod (method) |
def | unpickleFunction (moduleName, funcName) |
def | pickleFunction (function) |
def | getBatchType () |
def | setBatchType (batchType) |
def | abortOnError (func) |
def | guessPickleObj () |
def | pickleSniffer (abort=False) |
def | catchPicklingError (func) |
def | startPool (comm=None, root=0, killSlaves=True) |
Start a process pool. More... | |
Variables | |
string | NODE = "%s:%d" % (os.uname()[1], os.getpid()) |
def lsst.ctrl.pool.pool.abortOnError | ( | func | ) |
def lsst.ctrl.pool.pool.catchPicklingError | ( | func | ) |
def lsst.ctrl.pool.pool.getBatchType | ( | ) |
def lsst.ctrl.pool.pool.guessPickleObj | ( | ) |
def lsst.ctrl.pool.pool.pickleFunction | ( | function | ) |
Pickle a function This assumes that we can recreate the function object by grabbing it from the proper module. This may be violated if the function is a lambda or in __main__. In that case, I recommend recasting the function as an object with a __call__ method. Another problematic case may be a wrapped (e.g., decorated) method in a class: the 'method' is then a function, and recreating it is not as easy as we assume here.
Definition at line 71 of file pool.py.
def lsst.ctrl.pool.pool.pickleInstanceMethod | ( | method | ) |
def lsst.ctrl.pool.pool.pickleSniffer | ( | abort = False | ) |
Context manager to sniff out pickle problems If there's a pickle error, you're normally told what the problem class is. However, all SWIG objects are reported as "SwigPyObject". In order to figure out which actual SWIG-ed class is causing problems, we need to go digging. Use like this: with pickleSniffer(): someOperationInvolvingPickle() If 'abort' is True, will call MPI abort in the event of problems.
Definition at line 187 of file pool.py.
def lsst.ctrl.pool.pool.setBatchType | ( | batchType | ) |
def lsst.ctrl.pool.pool.startPool | ( | comm = None , |
|
root = 0 , |
|||
killSlaves = True |
|||
) |
Start a process pool.
Returns a PoolMaster object for the master node. Slave nodes are run and then optionally killed.
If you elect not to kill the slaves, note that they will emerge at the point this function was called, which is likely very different from the point the master is at, so it will likely be necessary to put in some rank dependent code (e.g., look at the 'rank' attribute of the returned pools).
Note that the pool objects should be deleted (either by going out of scope or explicit 'del') before program termination to avoid a segmentation fault.
comm | MPI communicator |
root | Rank of root/master node |
killSlaves | Kill slaves on completion? |
Definition at line 1216 of file pool.py.
def lsst.ctrl.pool.pool.unpickleFunction | ( | moduleName, | |
funcName | |||
) |
def lsst.ctrl.pool.pool.unpickleInstanceMethod | ( | obj, | |
name | |||
) |