LSSTApplications
17.0+124,17.0+14,17.0+73,18.0.0+37,18.0.0+80,18.0.0-4-g68ffd23+4,18.1.0-1-g0001055+12,18.1.0-1-g03d53ef+5,18.1.0-1-g1349e88+55,18.1.0-1-g2505f39+44,18.1.0-1-g5315e5e+4,18.1.0-1-g5e4b7ea+14,18.1.0-1-g7e8fceb+4,18.1.0-1-g85f8cd4+48,18.1.0-1-g8ff0b9f+4,18.1.0-1-ga2c679d+1,18.1.0-1-gd55f500+35,18.1.0-10-gb58edde+2,18.1.0-11-g0997b02+4,18.1.0-13-gfe4edf0b+12,18.1.0-14-g259bd21+21,18.1.0-19-gdb69f3f+2,18.1.0-2-g5f9922c+24,18.1.0-2-gd3b74e5+11,18.1.0-2-gfbf3545+32,18.1.0-26-g728bddb4+5,18.1.0-27-g6ff7ca9+2,18.1.0-3-g52aa583+25,18.1.0-3-g8ea57af+9,18.1.0-3-gb69f684+42,18.1.0-3-gfcaddf3+6,18.1.0-32-gd8786685a,18.1.0-4-gf3f9b77+6,18.1.0-5-g1dd662b+2,18.1.0-5-g6dbcb01+41,18.1.0-6-gae77429+3,18.1.0-7-g9d75d83+9,18.1.0-7-gae09a6d+30,18.1.0-9-gc381ef5+4,w.2019.45
LSSTDataManagementBasePackage
|
Public Member Functions | |
def | run (self, measCat, exposure, noiseImage=None, exposureId=None, beginOrder=None, endOrder=None) |
def | runPlugins (self, noiseReplacer, measCat, exposure, beginOrder=None, endOrder=None) |
def | measure (self, measCat, exposure) |
def | getPluginLogName (self, pluginName) |
def | initializePlugins (self, kwds) |
def | callMeasure (self, measRecord, args, kwds) |
def | doMeasurement (self, plugin, measRecord, args, kwds) |
def | callMeasureN (self, measCat, args, kwds) |
def | doMeasurementN (self, plugin, measCat, args, kwds) |
def | emptyMetadata (self) |
def | getSchemaCatalogs (self) |
def | getAllSchemaCatalogs (self) |
def | getFullMetadata (self) |
def | getFullName (self) |
def | getName (self) |
def | getTaskDict (self) |
def | makeSubtask (self, name, keyArgs) |
def | timer (self, name, logLevel=Log.DEBUG) |
def | makeField (cls, doc) |
def | __reduce__ (self) |
Public Attributes | |
schema | |
doBlendedness | |
blendPlugin | |
undeblendedPlugins | |
metadata | |
log | |
config | |
Static Public Attributes | |
ConfigClass = DipoleMeasurementConfig | |
string | NOISE_SEED_MULTIPLIER = "NOISE_SEED_MULTIPLIER" |
string | NOISE_SOURCE = "NOISE_SOURCE" |
string | NOISE_OFFSET = "NOISE_OFFSET" |
string | NOISE_EXPOSURE_ID = "NOISE_EXPOSURE_ID" |
plugins = None | |
algMetadata = None | |
Measurement of Sources, specifically ones from difference images, for characterization as dipoles Parameters ---------- sources : 'lsst.afw.table.SourceCatalog' Sources that will be measured badFlags : `list` of `dict` A list of flags that will be used to determine if there was a measurement problem Notes ----- The list of badFlags will be used to make a list of keys to check for measurement flags on. By default the centroid keys are added to this list Description This class provides a default configuration for running Source measurement on image differences. .. code-block:: py class DipoleMeasurementConfig(SingleFrameMeasurementConfig): "Measurement of detected diaSources as dipoles" def setDefaults(self): SingleFrameMeasurementConfig.setDefaults(self) self.plugins = ["base_CircularApertureFlux", "base_PixelFlags", "base_SkyCoord", "base_PsfFlux", "ip_diffim_NaiveDipoleCentroid", "ip_diffim_NaiveDipoleFlux", "ip_diffim_PsfDipoleFlux", "ip_diffim_ClassificationDipole", ] self.slots.calibFlux = None self.slots.modelFlux = None self.slots.instFlux = None self.slots.shape = None self.slots.centroid = "ip_diffim_NaiveDipoleCentroid" self.doReplaceWithNoise = False These plugins enabled by default allow the user to test the hypothesis that the Source is a dipole. This includes a set of measurements derived from intermediate base classes DipoleCentroidAlgorithm and DipoleFluxAlgorithm. Their respective algorithm control classes are defined in DipoleCentroidControl and DipoleFluxControl. Each centroid and flux measurement will have _neg (negative) and _pos (positive lobe) fields. The first set of measurements uses a "naive" alrogithm for centroid and flux measurements, implemented in NaiveDipoleCentroidControl and NaiveDipoleFluxControl. The algorithm uses a naive 3x3 weighted moment around the nominal centroids of each peak in the Source Footprint. These algorithms fill the table fields ip_diffim_NaiveDipoleCentroid* and ip_diffim_NaiveDipoleFlux* The second set of measurements undertakes a joint-Psf model on the negative and positive lobe simultaneously. This fit simultaneously solves for the negative and positive lobe centroids and fluxes using non-linear least squares minimization. The fields are stored in table elements ip_diffim_PsfDipoleFlux*. Because this Task is just a config for SingleFrameMeasurementTask, the same result may be acheived by manually editing the config and running SingleFrameMeasurementTask. For example: .. code-block:: py config = SingleFrameMeasurementConfig() config.plugins.names = ["base_PsfFlux", "ip_diffim_PsfDipoleFlux", "ip_diffim_NaiveDipoleFlux", "ip_diffim_NaiveDipoleCentroid", "ip_diffim_ClassificationDipole", "base_CircularApertureFlux", "base_SkyCoord"] config.slots.calibFlux = None config.slots.modelFlux = None config.slots.instFlux = None config.slots.shape = None config.slots.centroid = "ip_diffim_NaiveDipoleCentroid" config.doReplaceWithNoise = False schema = afwTable.SourceTable.makeMinimalSchema() task = SingleFrameMeasurementTask(schema, config=config)- Debug variables The ``lsst.pipe.base.cmdLineTask.CmdLineTask`` command line task interface supports a flag-d/--debug to import debug.py from your PYTHONPATH. The relevant contents of debug.py for this Task include: .. code-block:: py import sys import lsstDebug def DebugInfo(name): di = lsstDebug.getInfo(name) if name == "lsst.ip.diffim.dipoleMeasurement": di.display = True # enable debug output di.maskTransparency = 90 # display mask transparency di.displayDiaSources = True # show exposure with dipole results return di lsstDebug.Info = DebugInfo lsstDebug.frame = 1 config.slots.calibFlux = None config.slots.modelFlux = None config.slots.gaussianFlux = None config.slots.shape = None config.slots.centroid = "ip_diffim_NaiveDipoleCentroid" config.doReplaceWithNoise = False This code is dipoleMeasTask.py in the examples directory, and can be run as e.g. .. code-block:: none examples/dipoleMeasTask.py examples/dipoleMeasTask.py --debug examples/dipoleMeasTask.py --debug --image /path/to/image.fits Start the processing by parsing the command line, where the user has the option of enabling debugging output and/or sending their own image for demonstration (in case they have not downloaded the afwdata package). .. code-block:: py if __name__ == "__main__": import argparse parser = argparse.ArgumentParser( description="Demonstrate the use of SourceDetectionTask and DipoleMeasurementTask") parser.add_argument('--debug', '-d', action="store_true", help="Load debug.py?", default=False) parser.add_argument("--image", "-i", help="User defined image", default=None) args = parser.parse_args() if args.debug: try: import debug debug.lsstDebug.frame = 2 except ImportError as e: print(e, file=sys.stderr) run(args) The processing occurs in the run function. We first extract an exposure from disk or afwdata, displaying it if requested: .. code-block:: py def run(args): exposure = loadData(args.image) if args.debug: afwDisplay.Display(frame=1).mtv(exposure) Create a default source schema that we will append fields to as we add more algorithms: .. code-block:: py schema = afwTable.SourceTable.makeMinimalSchema() Create the detection and measurement Tasks, with some minor tweaking of their configs: .. code-block:: py # Create the detection task config = SourceDetectionTask.ConfigClass() config.thresholdPolarity = "both" config.background.isNanSafe = True config.thresholdValue = 3 detectionTask = SourceDetectionTask(config=config, schema=schema) # And the measurement Task config = DipoleMeasurementTask.ConfigClass() config.plugins.names.remove('base_SkyCoord') algMetadata = dafBase.PropertyList() measureTask = DipoleMeasurementTask(schema, algMetadata, config=config) Having fully initialied the schema, we create a Source table from it: .. code-block:: py # Create the output table tab = afwTable.SourceTable.make(schema) Run detection: .. code-block:: py # Process the data results = detectionTask.run(tab, exposure) Because we are looking for dipoles, we need to merge the positive and negative detections: .. code-block:: py # Merge the positve and negative sources fpSet = results.fpSets.positive growFootprint = 2 fpSet.merge(results.fpSets.negative, growFootprint, growFootprint, False) diaSources = afwTable.SourceCatalog(tab) fpSet.makeSources(diaSources) print("Merged %s Sources into %d diaSources (from %d +ve, %d -ve)" % (len(results.sources), len(diaSources), results.fpSets.numPos, results.fpSets.numNeg)) Finally, perform measurement (both standard and dipole-specialized) on the merged sources: .. code-block:: py measureTask.run(diaSources, exposure) Optionally display debugging information: .. code-block:: py # Display dipoles if debug enabled if args.debug: dpa = DipoleAnalysis() dpa.displayDipoles(exposure, diaSources)
Definition at line 123 of file dipoleMeasurement.py.
|
inherited |
Pickler.
|
inherited |
Call ``measure`` on all plugins and consistently handle exceptions. Parameters ---------- measRecord : `lsst.afw.table.SourceRecord` The record corresponding to the object being measured. Will be updated in-place with the results of measurement. *args Positional arguments forwarded to ``plugin.measure`` **kwds Keyword arguments. Two are handled locally: beginOrder : `int` Beginning execution order (inclusive). Measurements with ``executionOrder`` < ``beginOrder`` are not executed. `None` for no limit. endOrder : `int` Ending execution order (exclusive). Measurements with ``executionOrder`` >= ``endOrder`` are not executed. `None` for no limit. Others are forwarded to ``plugin.measure()``. Notes ----- This method can be used with plugins that have different signatures; the only requirement is that ``measRecord`` be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin. This method should be considered "protected": it is intended for use by derived classes, not users.
Definition at line 289 of file baseMeasurement.py.
|
inherited |
Call ``measureN`` on all plugins and consistently handle exceptions. Parameters ---------- measCat : `lsst.afw.table.SourceCatalog` Catalog containing only the records for the source family to be measured, and where outputs should be written. *args Positional arguments forwarded to ``plugin.measure()`` **kwds Keyword arguments. Two are handled locally: beginOrder: Beginning execution order (inclusive): Measurements with ``executionOrder`` < ``beginOrder`` are not executed. `None` for no limit. endOrder: Ending execution order (exclusive): measurements with ``executionOrder`` >= ``endOrder`` are not executed. `None` for no ``limit``. Others are are forwarded to ``plugin.measure()``. Notes ----- This method can be used with plugins that have different signatures; the only requirement is that ``measRecord`` be the first argument. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin. This method should be considered "protected": it is intended for use by derived classes, not users.
Definition at line 375 of file baseMeasurement.py.
|
inherited |
Call ``measure`` on the specified plugin. Exceptions are handled in a consistent way. Parameters ---------- plugin : subclass of `BasePlugin` Plugin that will be executed. measRecord : `lsst.afw.table.SourceRecord` The record corresponding to the object being measured. Will be updated in-place with the results of measurement. *args Positional arguments forwarded to ``plugin.measure()``. **kwds Keyword arguments forwarded to ``plugin.measure()``. Notes ----- This method can be used with plugins that have different signatures; the only requirement is that ``plugin`` and ``measRecord`` be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin. This method should be considered "protected": it is intended for use by derived classes, not users.
Definition at line 333 of file baseMeasurement.py.
|
inherited |
Call ``measureN`` on the specified plugin. Exceptions are handled in a consistent way. Parameters ---------- plugin : subclass of `BasePlugin` Plugin that will be executed. measCat : `lsst.afw.table.SourceCatalog` Catalog containing only the records for the source family to be measured, and where outputs should be written. *args Positional arguments forwarded to ``plugin.measureN()``. **kwds Keyword arguments forwarded to ``plugin.measureN()``. Notes ----- This method can be used with plugins that have different signatures; the only requirement is that the ``plugin`` and ``measCat`` be the first two arguments. Subsequent positional arguments and keyword arguments are forwarded directly to the plugin. This method should be considered "protected": it is intended for use by derived classes, not users.
Definition at line 418 of file baseMeasurement.py.
|
inherited |
Empty (clear) the metadata for this Task and all sub-Tasks.
Definition at line 153 of file task.py.
|
inherited |
Get schema catalogs for all tasks in the hierarchy, combining the results into a single dict. Returns ------- schemacatalogs : `dict` Keys are butler dataset type, values are a empty catalog (an instance of the appropriate lsst.afw.table Catalog type) for all tasks in the hierarchy, from the top-level task down through all subtasks. Notes ----- This method may be called on any task in the hierarchy; it will return the same answer, regardless. The default implementation should always suffice. If your subtask uses schemas the override `Task.getSchemaCatalogs`, not this method.
|
inherited |
Get metadata for all tasks. Returns ------- metadata : `lsst.daf.base.PropertySet` The `~lsst.daf.base.PropertySet` keys are the full task name. Values are metadata for the top-level task and all subtasks, sub-subtasks, etc.. Notes ----- The returned metadata includes timing information (if ``@timer.timeMethod`` is used) and any metadata set by the task. The name of each item consists of the full task name with ``.`` replaced by ``:``, followed by ``.`` and the name of the item, e.g.:: topLevelTaskName:subtaskName:subsubtaskName.itemName using ``:`` in the full task name disambiguates the rare situation that a task has a subtask and a metadata item with the same name.
Definition at line 210 of file task.py.
|
inherited |
Get the task name as a hierarchical name including parent task names. Returns ------- fullName : `str` The full name consists of the name of the parent task and each subtask separated by periods. For example: - The full name of top-level task "top" is simply "top". - The full name of subtask "sub" of top-level task "top" is "top.sub". - The full name of subtask "sub2" of subtask "sub" of top-level task "top" is "top.sub.sub2".
Definition at line 235 of file task.py.
|
inherited |
Get the name of the task. Returns ------- taskName : `str` Name of the task. See also -------- getFullName
|
inherited |
Definition at line 239 of file baseMeasurement.py.
|
inherited |
Get the schemas generated by this task. Returns ------- schemaCatalogs : `dict` Keys are butler dataset type, values are an empty catalog (an instance of the appropriate `lsst.afw.table` Catalog type) for this task. Notes ----- .. warning:: Subclasses that use schemas must override this method. The default implemenation returns an empty dict. This method may be called at any time after the Task is constructed, which means that all task schemas should be computed at construction time, *not* when data is actually processed. This reflects the philosophy that the schema should not depend on the data. Returning catalogs rather than just schemas allows us to save e.g. slots for SourceCatalog as well. See also -------- Task.getAllSchemaCatalogs
|
inherited |
Get a dictionary of all tasks as a shallow copy. Returns ------- taskDict : `dict` Dictionary containing full task name: task object for the top-level task and all subtasks, sub-subtasks, etc..
Definition at line 264 of file task.py.
|
inherited |
Initialize plugins (and slots) according to configuration. Parameters ---------- **kwds Keyword arguments forwarded directly to plugin constructors. Notes ----- Derived class constructors should call this method to fill the `plugins` attribute and add corresponding output fields and slot aliases to the output schema. In addition to the attributes added by `BaseMeasurementTask.__init__`, a ``schema``` attribute holding the output schema must be present before this method is called. Keyword arguments are forwarded directly to plugin constructors, allowing derived classes to use plugins with different signatures.
Definition at line 242 of file baseMeasurement.py.
|
inherited |
Make a `lsst.pex.config.ConfigurableField` for this task. Parameters ---------- doc : `str` Help text for the field. Returns ------- configurableField : `lsst.pex.config.ConfigurableField` A `~ConfigurableField` for this task. Examples -------- Provides a convenient way to specify this task is a subtask of another task. Here is an example of use:: class OtherTaskConfig(lsst.pex.config.Config) aSubtask = ATaskClass.makeField("a brief description of what this task does")
Definition at line 329 of file task.py.
|
inherited |
Create a subtask as a new instance as the ``name`` attribute of this task. Parameters ---------- name : `str` Brief name of the subtask. keyArgs Extra keyword arguments used to construct the task. The following arguments are automatically provided and cannot be overridden: - "config". - "parentTask". Notes ----- The subtask must be defined by ``Task.config.name``, an instance of pex_config ConfigurableField or RegistryField.
|
inherited |
|
inherited |
Run single frame measurement over an exposure and source catalog. Parameters ---------- measCat : `lsst.afw.table.SourceCatalog` Catalog to be filled with the results of measurement. Must contain all the `lsst.afw.table.SourceRecord`\ s to be measured (with `lsst.afw.detection.Footprint`\ s attached), and have a schema that is a superset of ``self.schema``. exposure : `lsst.afw.image.ExposureF` Image containing the pixel data to be measured together with associated PSF, WCS, etc. noiseImage : `lsst.afw.image.ImageF`, optional Can be used to specify the a predictable noise replacement field for testing purposes. exposureId : `int`, optional Unique exposure identifier used to calculate the random number generator seed during noise replacement. beginOrder : `float`, optional Start execution order (inclusive): measurements with ``executionOrder < beginOrder`` are not executed. `None` for no limit. endOrder : `float`, optional Final execution order (exclusive): measurements with ``executionOrder >= endOrder`` are not executed. `None` for no limit.
Definition at line 207 of file sfm.py.
|
inherited |
Call the configured measument plugins on an image. Parameters ---------- noiseReplacer : `NoiseReplacer` Used to fill sources not being measured with noise. measCat : `lsst.afw.table.SourceCatalog` Catalog to be filled with the results of measurement. Must contain all the `lsst.afw.table.SourceRecord`\ s to be measured (with `lsst.afw.detection.Footprint`\ s attached), and have a schema that is a superset of ``self.schema``. exposure : `lsst.afw.image.ExposureF` Image containing the pixel data to be measured together with associated PSF, WCS, etc. beginOrder : `float`, optional Start execution order (inclusive): measurements with ``executionOrder < beginOrder`` are not executed. `None` for no limit. endOrder : `float`, optional Final execution order (exclusive): measurements with ``executionOrder >= endOrder`` are not executed. `None` for no limit.
Definition at line 260 of file sfm.py.
|
inherited |
Context manager to log performance data for an arbitrary block of code. Parameters ---------- name : `str` Name of code being timed; data will be logged using item name: ``Start`` and ``End``. logLevel A `lsst.log` level constant. Examples -------- Creating a timer context:: with self.timer("someCodeToTime"): pass # code to time See also -------- timer.logInfo
Definition at line 301 of file task.py.
|
staticinherited |
Definition at line 224 of file baseMeasurement.py.
|
inherited |
|
static |
Definition at line 343 of file dipoleMeasurement.py.
|
inherited |
|
staticinherited |
|
staticinherited |
|
staticinherited |
|
staticinherited |
|
staticinherited |
Definition at line 217 of file baseMeasurement.py.
|
inherited |
|
inherited |
Definition at line 234 of file baseMeasurement.py.