lsst.pipe.tasks.skyCorrection.SkyCorrectionTask Class Reference

Inheritance diagram for lsst.pipe.tasks.skyCorrection.SkyCorrectionTask:

Public Member Functions
	__init__ (self, *args, **kwargs)
	runQuantum (self, butlerQC, inputRefs, outputRefs)
	run (self, calExps, calBkgs, skyFrames, camera)

Static Public Attributes
	ConfigClass = SkyCorrectionConfig

Protected Member Functions
	_restoreBackgroundRefineMask (self, calExps, calBkgs)
	_subtractVisitBackground (self, calExps, calBkgs, camera, config)
	_subtractDetectorBackground (self, calExp, bgModel)
	_subtractSkyFrame (self, calExps, skyFrames, calBkgs)
	_binAndMosaic (self, exposures, camera, binning, ids=None, refExps=None)

Static Protected Attributes
str	_DefaultName = "skyCorr"

Detailed Description

Perform a full focal plane sky correction.

Definition at line 208 of file skyCorrection.py.

Constructor & Destructor Documentation

__init__()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask.__init__	(		self,
		*	args,
		**	kwargs )

Definition at line 214 of file skyCorrection.py.

    def __init__(self, *args, **kwargs):
        super().__init__(**kwargs)
        self.makeSubtask("sky")
        self.makeSubtask("maskObjects")
 

Member Function Documentation

_binAndMosaic()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._binAndMosaic ( self, exposures, camera, binning, ids = None, refExps = None )

protected

Bin input exposures and mosaic across the entire focal plane.

Input exposures are binned and then mosaicked at the position of
the detector in the focal plane of the camera.

Parameters
----------
exposures : `list`
    Detector level list of either calexp `ExposureF` types or
    calexpBackground `BackgroundList` types.
camera : `lsst.afw.cameraGeom.Camera`
    Camera matching the input data to process.
binning : `int`
    Binning size to be applied to input images.
ids : `list` [`int`], optional
    List of detector ids to iterate over.
refExps : `list` [`lsst.afw.image.exposure.ExposureF`], optional
    If supplied, mask planes from these reference images will be used.
Returns
-------
mosaicImage : `lsst.afw.image.exposure.ExposureF`
    Mosaicked full focal plane image.

Definition at line 525 of file skyCorrection.py.

    def _binAndMosaic(self, exposures, camera, binning, ids=None, refExps=None):
        """Bin input exposures and mosaic across the entire focal plane.
 
        Input exposures are binned and then mosaicked at the position of
        the detector in the focal plane of the camera.
 
        Parameters
        ----------
        exposures : `list`
            Detector level list of either calexp `ExposureF` types or
            calexpBackground `BackgroundList` types.
        camera : `lsst.afw.cameraGeom.Camera`
            Camera matching the input data to process.
        binning : `int`
            Binning size to be applied to input images.
        ids : `list` [`int`], optional
            List of detector ids to iterate over.
        refExps : `list` [`lsst.afw.image.exposure.ExposureF`], optional
            If supplied, mask planes from these reference images will be used.
        Returns
        -------
        mosaicImage : `lsst.afw.image.exposure.ExposureF`
            Mosaicked full focal plane image.
        """
        refExps = np.resize(refExps, len(exposures))  # type: ignore
        binnedImages = []
        for exp, refExp in zip(exposures, refExps):
            try:
                nativeImage = exp.getMaskedImage()
            except AttributeError:
                nativeImage = afwImage.makeMaskedImage(exp.getImage())
                if refExp:
                    nativeImage.setMask(refExp.getMask())
            binnedImage = afwMath.binImage(nativeImage, binning)
            binnedImages.append(binnedImage)
        mosConfig = VisualizeMosaicExpConfig()
        mosConfig.binning = binning
        mosTask = VisualizeMosaicExpTask(config=mosConfig)
        imageStruct = mosTask.run(binnedImages, camera, inputIds=ids)
        mosaicImage = imageStruct.outputData
        return mosaicImage

_restoreBackgroundRefineMask()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._restoreBackgroundRefineMask ( self, calExps, calBkgs )

protected

Restore original background to each calexp and invert the related
background model; optionally refine the mask plane.

The original visit-level background is restored to each calibrated
exposure and the existing background model is inverted in-place. If
doMaskObjects is True, the mask map associated with the exposure will
be iteratively updated (over nIter loops) by re-estimating the
background each iteration and redetecting footprints.

The background model modified in-place in this method will comprise the
first N elements of the skyCorr dataset type, i.e., these N elements
are the inverse of the calexpBackground model. All subsequent elements
appended to skyCorr will be additive such that, when skyCorr is
subtracted from a calexp, the net result will be to undo the initial
per-detector background solution and then apply the skyCorr model
thereafter. Adding skyCorr to a calexpBackground will effectively
negate the calexpBackground, returning only the additive background
components of the skyCorr background model.

Parameters
----------
calExps : `lsst.afw.image.exposure.ExposureF`
    Detector level calexp images to process.
calBkgs : `lsst.afw.math._backgroundList.BackgroundList`
    Detector level background lists associated with the calexps.

Returns
-------
calExps : `lsst.afw.image.exposure.ExposureF`
    The calexps with the initially subtracted background restored.
skyCorrBases : `lsst.afw.math._backgroundList.BackgroundList`
    The inverted initial background models; the genesis for skyCorrs.

Definition at line 321 of file skyCorrection.py.

    def _restoreBackgroundRefineMask(self, calExps, calBkgs):
        """Restore original background to each calexp and invert the related
        background model; optionally refine the mask plane.
 
        The original visit-level background is restored to each calibrated
        exposure and the existing background model is inverted in-place. If
        doMaskObjects is True, the mask map associated with the exposure will
        be iteratively updated (over nIter loops) by re-estimating the
        background each iteration and redetecting footprints.
 
        The background model modified in-place in this method will comprise the
        first N elements of the skyCorr dataset type, i.e., these N elements
        are the inverse of the calexpBackground model. All subsequent elements
        appended to skyCorr will be additive such that, when skyCorr is
        subtracted from a calexp, the net result will be to undo the initial
        per-detector background solution and then apply the skyCorr model
        thereafter. Adding skyCorr to a calexpBackground will effectively
        negate the calexpBackground, returning only the additive background
        components of the skyCorr background model.
 
        Parameters
        ----------
        calExps : `lsst.afw.image.exposure.ExposureF`
            Detector level calexp images to process.
        calBkgs : `lsst.afw.math._backgroundList.BackgroundList`
            Detector level background lists associated with the calexps.
 
        Returns
        -------
        calExps : `lsst.afw.image.exposure.ExposureF`
            The calexps with the initially subtracted background restored.
        skyCorrBases : `lsst.afw.math._backgroundList.BackgroundList`
            The inverted initial background models; the genesis for skyCorrs.
        """
        skyCorrBases = []
        for calExp, calBkg in zip(calExps, calBkgs):
            image = calExp.getMaskedImage()
 
            # Invert all elements of the existing bg model; restore in calexp
            for calBkgElement in calBkg:
                statsImage = calBkgElement[0].getStatsImage()
                statsImage *= -1
            skyCorrBase = calBkg.getImage()
            image -= skyCorrBase
 
            # Iteratively subtract bg, re-detect sources, and add bg back on
            if self.config.doMaskObjects:
                self.maskObjects.findObjects(calExp)
 
            stats = np.nanpercentile(skyCorrBase.array, [50, 75, 25])
            self.log.info(
                "Detector %d: Initial background restored; BG median = %.1f counts, BG IQR = %.1f counts",
                calExp.getDetector().getId(),
                -stats[0],
                np.subtract(*stats[1:]),
            )
            skyCorrBases.append(skyCorrBase)
        return calExps, skyCorrBases
 

_subtractDetectorBackground()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._subtractDetectorBackground ( self, calExp, bgModel )

protected

Generate CCD background model and subtract from image.

Translate the full focal plane background into CCD coordinates and
subtract from the original science exposure image.

Parameters
----------
calExp : `lsst.afw.image.exposure.ExposureF`
    Exposure to subtract the background model from.
bgModel : `lsst.pipe.tasks.background.FocalPlaneBackground`
    Full focal plane camera-level background model.

Returns
-------
calExp : `lsst.afw.image.exposure.ExposureF`
    Background subtracted input exposure.
calBkgElement : `lsst.afw.math._backgroundList.BackgroundList`
    Detector level realization of the full focal plane bg model.

Definition at line 463 of file skyCorrection.py.

    def _subtractDetectorBackground(self, calExp, bgModel):
        """Generate CCD background model and subtract from image.
 
        Translate the full focal plane background into CCD coordinates and
        subtract from the original science exposure image.
 
        Parameters
        ----------
        calExp : `lsst.afw.image.exposure.ExposureF`
            Exposure to subtract the background model from.
        bgModel : `lsst.pipe.tasks.background.FocalPlaneBackground`
            Full focal plane camera-level background model.
 
        Returns
        -------
        calExp : `lsst.afw.image.exposure.ExposureF`
            Background subtracted input exposure.
        calBkgElement : `lsst.afw.math._backgroundList.BackgroundList`
            Detector level realization of the full focal plane bg model.
        """
        image = calExp.getMaskedImage()
        with warnings.catch_warnings():
            warnings.filterwarnings("ignore", r"invalid value encountered")
            calBkgElement = bgModel.toCcdBackground(calExp.getDetector(), image.getBBox())
        image -= calBkgElement.getImage()
        return calExp, calBkgElement
 

_subtractSkyFrame()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._subtractSkyFrame ( self, calExps, skyFrames, calBkgs )

protected

Determine the full focal plane sky frame scale factor relative to
an input list of calibrated exposures and subtract.

This method measures the sky frame scale on all inputs, resulting in
values equal to the background method solveScales(). The sky frame is
then subtracted as in subtractSkyFrame() using the appropriate scale.

Input calExps and calBkgs are updated in-place, returning sky frame
subtracted calExps and sky frame updated calBkgs, respectively.

Parameters
----------
calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
    Calibrated exposures to be background subtracted.
skyFrames : `list` [`lsst.afw.image.exposure.ExposureF`]
    Sky frame calibration data for the input detectors.
calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
    Background lists associated with the input calibrated exposures.

Definition at line 490 of file skyCorrection.py.

    def _subtractSkyFrame(self, calExps, skyFrames, calBkgs):
        """Determine the full focal plane sky frame scale factor relative to
        an input list of calibrated exposures and subtract.
 
        This method measures the sky frame scale on all inputs, resulting in
        values equal to the background method solveScales(). The sky frame is
        then subtracted as in subtractSkyFrame() using the appropriate scale.
 
        Input calExps and calBkgs are updated in-place, returning sky frame
        subtracted calExps and sky frame updated calBkgs, respectively.
 
        Parameters
        ----------
        calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
            Calibrated exposures to be background subtracted.
        skyFrames : `list` [`lsst.afw.image.exposure.ExposureF`]
            Sky frame calibration data for the input detectors.
        calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
            Background lists associated with the input calibrated exposures.
        """
        skyFrameBgModels = []
        scales = []
        for calExp, skyFrame in zip(calExps, skyFrames):
            skyFrameBgModel = self.sky.exposureToBackground(skyFrame)
            skyFrameBgModels.append(skyFrameBgModel)
            # return a tuple of gridded image and sky frame clipped means
            samples = self.sky.measureScale(calExp.getMaskedImage(), skyFrameBgModel)
            scales.append(samples)
        scale = self.sky.solveScales(scales)
        for calExp, skyFrameBgModel, calBkg in zip(calExps, skyFrameBgModels, calBkgs):
            # subtract the scaled sky frame model from each calExp in-place,
            # also updating the calBkg list in-place
            self.sky.subtractSkyFrame(calExp.getMaskedImage(), skyFrameBgModel, scale, calBkg)
        self.log.info("Sky frame subtracted with a scale factor of %.5f", scale)
 

_subtractVisitBackground()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._subtractVisitBackground ( self, calExps, calBkgs, camera, config )

protected

Perform a full focal-plane background subtraction for a visit.

Generate a full focal plane background model, binning all masked
detectors into bins of [bgModelN.xSize, bgModelN.ySize]. After,
subtract the resultant background model (translated back into CCD
coordinates) from the original detector exposure.

Return a list of background subtracted images and a list of full focal
plane background parameters.

Parameters
----------
calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
    Calibrated exposures to be background subtracted.
calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
    Background lists associated with the input calibrated exposures.
camera : `lsst.afw.cameraGeom.Camera`
    Camera description.
config : `lsst.pipe.tasks.background.FocalPlaneBackgroundConfig`
    Configuration to use for background subtraction.

Returns
-------
calExps : `list` [`lsst.afw.image.maskedImage.MaskedImageF`]
    Background subtracted exposures for creating a focal plane image.
calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
    Updated background lists with a visit-level model appended.

Definition at line 380 of file skyCorrection.py.

    def _subtractVisitBackground(self, calExps, calBkgs, camera, config):
        """Perform a full focal-plane background subtraction for a visit.
 
        Generate a full focal plane background model, binning all masked
        detectors into bins of [bgModelN.xSize, bgModelN.ySize]. After,
        subtract the resultant background model (translated back into CCD
        coordinates) from the original detector exposure.
 
        Return a list of background subtracted images and a list of full focal
        plane background parameters.
 
        Parameters
        ----------
        calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
            Calibrated exposures to be background subtracted.
        calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
            Background lists associated with the input calibrated exposures.
        camera : `lsst.afw.cameraGeom.Camera`
            Camera description.
        config : `lsst.pipe.tasks.background.FocalPlaneBackgroundConfig`
            Configuration to use for background subtraction.
 
        Returns
        -------
        calExps : `list` [`lsst.afw.image.maskedImage.MaskedImageF`]
            Background subtracted exposures for creating a focal plane image.
        calBkgs : `list` [`lsst.afw.math._backgroundList.BackgroundList`]
            Updated background lists with a visit-level model appended.
        """
        # Set up empty full focal plane background model object
        bgModelBase = FocalPlaneBackground.fromCamera(config, camera)
 
        # Loop over each detector, bin into [xSize, ySize] bins, and update
        # summed flux (_values) and number of contributing pixels (_numbers)
        # in focal plane coordinates. Append outputs to bgModels.
        bgModels = []
        for calExp in calExps:
            bgModel = bgModelBase.clone()
            bgModel.addCcd(calExp)
            bgModels.append(bgModel)
 
        # Merge detector models to make a single full focal plane bg model
        for bgModel, calExp in zip(bgModels, calExps):
            msg = (
                "Detector %d: Merging %d unmasked pixels (%.1f%s of detector area) into focal plane "
                "background model"
            )
            self.log.debug(
                msg,
                calExp.getDetector().getId(),
                bgModel._numbers.getArray().sum(),
                100 * bgModel._numbers.getArray().sum() / calExp.getBBox().getArea(),
                "%",
            )
            bgModelBase.merge(bgModel)
 
        # Map full focal plane bg solution to detector; subtract from exposure
        calBkgElements = []
        for calExp in calExps:
            _, calBkgElement = self._subtractDetectorBackground(calExp, bgModelBase)
            calBkgElements.append(calBkgElement)
 
        msg = (
            "Focal plane background model constructed using %.2f x %.2f mm (%d x %d pixel) superpixels; "
            "FP BG median = %.1f counts, FP BG IQR = %.1f counts"
        )
        with warnings.catch_warnings():
            warnings.filterwarnings("ignore", r"invalid value encountered")
            stats = np.nanpercentile(bgModelBase.getStatsImage().array, [50, 75, 25])
        self.log.info(
            msg,
            config.xSize,
            config.ySize,
            int(config.xSize / config.pixelSize),
            int(config.ySize / config.pixelSize),
            stats[0],
            np.subtract(*stats[1:]),
        )
 
        for calBkg, calBkgElement in zip(calBkgs, calBkgElements):
            calBkg.append(calBkgElement[0])
        return calExps, calBkgs
 

run()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask.run	(		self,
			calExps,
			calBkgs,
			skyFrames,
			camera )

Perform sky correction on a visit.

The original visit-level background is first restored to the calibrated
exposure and the existing background model is inverted in-place. If
doMaskObjects is True, the mask map associated with this exposure will
be iteratively updated (over nIter loops) by re-estimating the
background each iteration and redetecting footprints.

An initial full focal plane sky subtraction (bgModel1) will take place
prior to scaling and subtracting the sky frame.

If doSky is True, the sky frame will be scaled to the flux in the input
visit.

If doBgModel2 is True, a final full focal plane sky subtraction will
take place after the sky frame has been subtracted.

The first N elements of the returned skyCorr will consist of inverted
elements of the calexpBackground model (i.e., subtractive). All
subsequent elements appended to skyCorr thereafter will be additive
such that, when skyCorr is subtracted from a calexp, the net result
will be to undo the initial per-detector background solution and then
apply the skyCorr model thereafter. Adding skyCorr to a
calexpBackground will effectively negate the calexpBackground,
returning only the additive background components of the skyCorr
background model.

Parameters
----------
calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
    Detector calibrated exposure images for the visit.
calBkgs : `list` [`lsst.afw.math.BackgroundList`]
    Detector background lists matching the calibrated exposures.
skyFrames : `list` [`lsst.afw.image.exposure.ExposureF`]
    Sky frame calibration data for the input detectors.
camera : `lsst.afw.cameraGeom.Camera`
    Camera matching the input data to process.

Returns
-------
results : `Struct` containing:
    skyCorr : `list` [`lsst.afw.math.BackgroundList`]
        Detector-level sky correction background lists.
    calExpMosaic : `lsst.afw.image.exposure.ExposureF`
        Visit-level mosaic of the sky corrected data, binned.
        Analogous to `calexp - skyCorr`.
    calBkgMosaic : `lsst.afw.image.exposure.ExposureF`
        Visit-level mosaic of the sky correction background, binned.
        Analogous to `calexpBackground + skyCorr`.

Definition at line 241 of file skyCorrection.py.

    def run(self, calExps, calBkgs, skyFrames, camera):
        """Perform sky correction on a visit.
 
        The original visit-level background is first restored to the calibrated
        exposure and the existing background model is inverted in-place. If
        doMaskObjects is True, the mask map associated with this exposure will
        be iteratively updated (over nIter loops) by re-estimating the
        background each iteration and redetecting footprints.
 
        An initial full focal plane sky subtraction (bgModel1) will take place
        prior to scaling and subtracting the sky frame.
 
        If doSky is True, the sky frame will be scaled to the flux in the input
        visit.
 
        If doBgModel2 is True, a final full focal plane sky subtraction will
        take place after the sky frame has been subtracted.
 
        The first N elements of the returned skyCorr will consist of inverted
        elements of the calexpBackground model (i.e., subtractive). All
        subsequent elements appended to skyCorr thereafter will be additive
        such that, when skyCorr is subtracted from a calexp, the net result
        will be to undo the initial per-detector background solution and then
        apply the skyCorr model thereafter. Adding skyCorr to a
        calexpBackground will effectively negate the calexpBackground,
        returning only the additive background components of the skyCorr
        background model.
 
        Parameters
        ----------
        calExps : `list` [`lsst.afw.image.exposure.ExposureF`]
            Detector calibrated exposure images for the visit.
        calBkgs : `list` [`lsst.afw.math.BackgroundList`]
            Detector background lists matching the calibrated exposures.
        skyFrames : `list` [`lsst.afw.image.exposure.ExposureF`]
            Sky frame calibration data for the input detectors.
        camera : `lsst.afw.cameraGeom.Camera`
            Camera matching the input data to process.
 
        Returns
        -------
        results : `Struct` containing:
            skyCorr : `list` [`lsst.afw.math.BackgroundList`]
                Detector-level sky correction background lists.
            calExpMosaic : `lsst.afw.image.exposure.ExposureF`
                Visit-level mosaic of the sky corrected data, binned.
                Analogous to `calexp - skyCorr`.
            calBkgMosaic : `lsst.afw.image.exposure.ExposureF`
                Visit-level mosaic of the sky correction background, binned.
                Analogous to `calexpBackground + skyCorr`.
        """
        # Restore original backgrounds in-place; optionally refine mask maps
        numOrigBkgElements = [len(calBkg) for calBkg in calBkgs]
        _ = self._restoreBackgroundRefineMask(calExps, calBkgs)
 
        # Bin exposures, generate full-fp bg, map to CCDs and subtract in-place
        _ = self._subtractVisitBackground(calExps, calBkgs, camera, self.config.bgModel1)
 
        # Subtract a scaled sky frame from all input exposures
        if self.config.doSky:
            self._subtractSkyFrame(calExps, skyFrames, calBkgs)
 
        # Bin exposures, generate full-fp bg, map to CCDs and subtract in-place
        if self.config.doBgModel2:
            _ = self._subtractVisitBackground(calExps, calBkgs, camera, self.config.bgModel2)
 
        # Make camera-level images of bg subtracted calexps and subtracted bgs
        calExpIds = [exp.getDetector().getId() for exp in calExps]
        skyCorrExtras = []
        for calBkg, num in zip(calBkgs, numOrigBkgElements):
            skyCorrExtra = calBkg.clone()
            skyCorrExtra._backgrounds = skyCorrExtra._backgrounds[num:]
            skyCorrExtras.append(skyCorrExtra)
        calExpMosaic = self._binAndMosaic(calExps, camera, self.config.binning, ids=calExpIds, refExps=None)
        calBkgMosaic = self._binAndMosaic(
            skyCorrExtras, camera, self.config.binning, ids=calExpIds, refExps=calExps
        )
 
        return Struct(skyCorr=calBkgs, calExpMosaic=calExpMosaic, calBkgMosaic=calBkgMosaic)
 

runQuantum()

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask.runQuantum	(		self,
			butlerQC,
			inputRefs,
			outputRefs )

Definition at line 219 of file skyCorrection.py.

    def runQuantum(self, butlerQC, inputRefs, outputRefs):
        # Sort the calExps, calBkgs and skyFrames inputRefs and the
        # skyCorr outputRef by detector ID to ensure reproducibility.
        detectorOrder = [ref.dataId["detector"] for ref in inputRefs.calExps]
        detectorOrder.sort()
        inputRefs.calExps = _reorderAndPadList(
            inputRefs.calExps, [ref.dataId["detector"] for ref in inputRefs.calExps], detectorOrder
        )
        inputRefs.calBkgs = _reorderAndPadList(
            inputRefs.calBkgs, [ref.dataId["detector"] for ref in inputRefs.calBkgs], detectorOrder
        )
        inputRefs.skyFrames = _reorderAndPadList(
            inputRefs.skyFrames, [ref.dataId["detector"] for ref in inputRefs.skyFrames], detectorOrder
        )
        outputRefs.skyCorr = _reorderAndPadList(
            outputRefs.skyCorr, [ref.dataId["detector"] for ref in outputRefs.skyCorr], detectorOrder
        )
        inputs = butlerQC.get(inputRefs)
        inputs.pop("rawLinker", None)
        outputs = self.run(**inputs)
        butlerQC.put(outputs, outputRefs)
 

Member Data Documentation

_DefaultName

str lsst.pipe.tasks.skyCorrection.SkyCorrectionTask._DefaultName = "skyCorr"

staticprotected

Definition at line 212 of file skyCorrection.py.

ConfigClass

lsst.pipe.tasks.skyCorrection.SkyCorrectionTask.ConfigClass = SkyCorrectionConfig

static

Definition at line 211 of file skyCorrection.py.

---

The documentation for this class was generated from the following file:

• /j/snowflake/release/lsstsw/stack/lsst-scipipe-8.0.0/Linux64/pipe_tasks/gc07e1c2157+f6e5778202/python/lsst/pipe/tasks/skyCorrection.py