LSST Applications g063fba187b+cac8b7c890,g0f08755f38+6aee506743,g1653933729+a8ce1bb630,g168dd56ebc+a8ce1bb630,g1a2382251a+b4475c5878,g1dcb35cd9c+8f9bc1652e,g20f6ffc8e0+6aee506743,g217e2c1bcf+73dee94bd0,g28da252d5a+1f19c529b9,g2bbee38e9b+3f2625acfc,g2bc492864f+3f2625acfc,g3156d2b45e+6e55a43351,g32e5bea42b+1bb94961c2,g347aa1857d+3f2625acfc,g35bb328faa+a8ce1bb630,g3a166c0a6a+3f2625acfc,g3e281a1b8c+c5dd892a6c,g3e8969e208+a8ce1bb630,g414038480c+5927e1bc1e,g41af890bb2+8a9e676b2a,g7af13505b9+809c143d88,g80478fca09+6ef8b1810f,g82479be7b0+f568feb641,g858d7b2824+6aee506743,g89c8672015+f4add4ffd5,g9125e01d80+a8ce1bb630,ga5288a1d22+2903d499ea,gb58c049af0+d64f4d3760,gc28159a63d+3f2625acfc,gcab2d0539d+b12535109e,gcf0d15dbbd+46a3f46ba9,gda6a2b7d83+46a3f46ba9,gdaeeff99f8+1711a396fd,ge79ae78c31+3f2625acfc,gef2f8181fd+0a71e47438,gf0baf85859+c1f95f4921,gfa517265be+6aee506743,gfa999e8aa5+17cd334064,w.2024.51
LSST Data Management Base Package
|
Class that handles the astrometric least squares problem. More...
#include <AstrometryFit.h>
Public Member Functions | |
AstrometryFit (std::shared_ptr< Associations > associations, std::shared_ptr< AstrometryModel > astrometryModel, double posError) | |
this is the only constructor | |
AstrometryFit (AstrometryFit const &)=delete | |
No copy or move: there is only ever one fitter of a given type. | |
AstrometryFit (AstrometryFit &&)=delete | |
AstrometryFit & | operator= (AstrometryFit const &)=delete |
AstrometryFit & | operator= (AstrometryFit &&)=delete |
void | assignIndices (std::string const &whatToFit) override |
Set parameters to fit and assign indices in the big matrix. | |
void | freezeErrorTransform () |
The transformations used to propagate errors are freezed to the current state. | |
void | offsetParams (Eigen::VectorXd const &delta) override |
Offset the parameters by the requested quantities. | |
std::shared_ptr< AstrometryModel > | getModel () const |
Return the model being fit. | |
void | checkStuff () |
DEBUGGING routine. | |
MinimizeResult | minimize (std::string const &whatToFit, double nSigmaCut=0, double sigmaRelativeTolerance=0, bool doRankUpdate=true, bool doLineSearch=false, std::string const &dumpMatrixFile="") |
Does a 1 step minimization, assuming a linear model. | |
Chi2Statistic | computeChi2 () const |
Returns the chi2 for the current state. | |
void | leastSquareDerivatives (TripletList &tripletList, Eigen::VectorXd &grad) const |
Evaluates the chI^2 derivatives (Jacobian and gradient) for the current whatToFit setting. | |
virtual void | saveChi2Contributions (std::string const &baseName) const |
Save the full chi2 term per star that was used in the minimization, for debugging. | |
Protected Member Functions | |
void | saveChi2MeasContributions (std::string const &filename) const override |
Save a CSV file containing residuals of measurement terms. | |
void | saveChi2RefContributions (std::string const &filename) const override |
Save a CSV file containing residuals of reference terms. | |
std::size_t | findOutliers (double nSigmaCut, MeasuredStarList &msOutliers, FittedStarList &fsOutliers, double &cut) const |
Find Measurements and references contributing more than a cut, computed as. | |
void | outliersContributions (MeasuredStarList &msOutliers, FittedStarList &fsOutliers, TripletList &tripletList, Eigen::VectorXd &grad) |
Contributions to derivatives from (presumably) outlier terms. | |
void | removeMeasOutliers (MeasuredStarList &outliers) |
Remove measuredStar outliers from the fit. No Refit done. | |
void | removeRefOutliers (FittedStarList &outliers) |
Remove refStar outliers from the fit. No Refit done. | |
Protected Attributes | |
std::shared_ptr< Associations > | _associations |
std::string | _whatToFit |
Eigen::Index | _lastNTrip |
Eigen::Index | _nTotal |
Eigen::Index | _nModelParams |
Eigen::Index | _nStarParams |
LOG_LOGGER | _log |
Private Member Functions | |
void | leastSquareDerivativesMeasurement (CcdImage const &ccdImage, TripletList &tripletList, Eigen::VectorXd &grad, MeasuredStarList const *msList=nullptr) const override |
Compute the derivatives of the measured stars and model for one CcdImage. | |
void | leastSquareDerivativesReference (FittedStarList const &fittedStarList, TripletList &tripletList, Eigen::VectorXd &grad) const override |
Compute the derivatives of the reference terms. | |
void | accumulateStatImageList (CcdImageList const &ccdImageList, Chi2Accumulator &accum) const override |
Compute the chi2 (per star or total, depending on which Chi2Accumulator is used) for measurements. | |
void | accumulateStatRefStars (Chi2Accumulator &accum) const override |
Compute the chi2 (per star or total, depending on which Chi2Accumulator is used) for RefStars. | |
void | getIndicesOfMeasuredStar (MeasuredStar const &measuredStar, IndexVector &indices) const override |
this routine is to be used only in the framework of outlier removal | |
Class that handles the astrometric least squares problem.
This is the class that actually computes the quantities required to carry out a LS astrometric fit wrt distortion mappings and coordinates of common objects. Namely it computes the Jacobian and gradient of the chi2 (w.r.t. parameters), and the Chi2 itself. It interfaces with the actual modelling of distortions via a mimimum virtual interface AstrometryModel, and the actual mappings via an other virtual interface : Mapping.
In short AstrometryFit aims at computing derivatives of least quares. The terms of the chi2 are of two kinds:
kind 1 -> (T(X_M) - p(F))^T W (T(X_M) - p(F))
with X_M is a measured (2d) position in CCD coordinates, F refers to the position of the object in some space, defined in practise by p. There is one such term per measurement. The default setup would be that p is the projection from sky to some tangent plane and hence T maps the CCD coordinates onto this TP. p is obtained via the DistorsionModel and can be different for all CcdImage's. Depending on what is beeing fitted, one could imagine cases where the projector p is the same for all CcdImages.
Kind 2 -> (p'(F)-p'(R))^T W_R (p'(F)-p'(R)) R refers to some externally-provided reference object position, and p' to some projector from sky to some plane. The reference objects define the overall coordinate frame, which is required when all T and all F are fitted simultaneously. There is one such term per external reference object. There can be more F (fitted) objects than R (reference) objects.
In the same framework, one can fit relative transforms between images by setting p = Identity for all input CcdImages and not fitting T for one of the CcdImage's. One does not need reference object and would then naturally not have any Kind 2 terms.
Definition at line 78 of file AstrometryFit.h.
lsst::jointcal::AstrometryFit::AstrometryFit | ( | std::shared_ptr< Associations > | associations, |
std::shared_ptr< AstrometryModel > | astrometryModel, | ||
double | posError ) |
this is the only constructor
Definition at line 66 of file AstrometryFit.cc.
|
delete |
No copy or move: there is only ever one fitter of a given type.
|
delete |
|
overrideprivatevirtual |
Compute the chi2 (per star or total, depending on which Chi2Accumulator is used) for measurements.
Implements lsst::jointcal::FitterBase.
Definition at line 372 of file AstrometryFit.cc.
|
overrideprivatevirtual |
Compute the chi2 (per star or total, depending on which Chi2Accumulator is used) for RefStars.
Implements lsst::jointcal::FitterBase.
Definition at line 378 of file AstrometryFit.cc.
|
overridevirtual |
Set parameters to fit and assign indices in the big matrix.
[in] | whatToFit | Valid strings: zero or more of "Distortions", "Positions", "PM" which define which parameter set is going to be variable when computing derivatives (leastSquareDerivatives) and minimizing (minimize()). whatToFit="Positions Distortions" will minimize w.r.t mappings and objects positions, and not w.r.t proper motions and refraction modeling. However if proper motions and/or refraction parameters have already been set, then they are accounted for when computing residuals. The string is forwarded to the AstrometryModel, and it can then be used to turn subsets of distortion parameter on or off, if the AstrometryModel implements such a thing. |
Implements lsst::jointcal::FitterBase.
Definition at line 423 of file AstrometryFit.cc.
void lsst::jointcal::AstrometryFit::checkStuff | ( | ) |
DEBUGGING routine.
Definition at line 480 of file AstrometryFit.cc.
|
inherited |
Returns the chi2 for the current state.
Definition at line 43 of file FitterBase.cc.
|
protectedinherited |
Find Measurements and references contributing more than a cut, computed as.
\[ <chi2> + nSigmaCut + rms(chi2). \]
The outliers are NOT removed, and no refit is done.
After returning from here, there are still measurements that contribute above the cut, but their contribution should be evaluated after a refit before discarding them.
[in] | nSigmaCut | Number of sigma to select on. |
[out] | msOutliers | list of MeasuredStar outliers to populate |
[out] | fsOutliers | list of FittedStar outliers to populate |
[out] | cut | value of chi2 that defines which objects are outliers |
Definition at line 53 of file FitterBase.cc.
|
inline |
The transformations used to propagate errors are freezed to the current state.
The routine can be called when the mappings are roughly in place. After the call, the transformations used to propage errors are no longer affected when updating the mappings. This allows to have an exactly linear fit, which can be useful.
Definition at line 117 of file AstrometryFit.h.
|
overrideprivatevirtual |
this routine is to be used only in the framework of outlier removal
it fills the array of indices of parameters that a Measured star constrains. Not really all of them if you check.
Implements lsst::jointcal::FitterBase.
Definition at line 404 of file AstrometryFit.cc.
|
inline |
Return the model being fit.
Definition at line 122 of file AstrometryFit.h.
|
inherited |
Evaluates the chI^2 derivatives (Jacobian and gradient) for the current whatToFit setting.
The Jacobian is given as triplets in a sparse matrix, the gradient as a dense vector. The parameters which vary, and their indices, are to be set using assignIndices.
tripletList | tripletList of (row,col,value) representing the Jacobian of the chi2. |
grad | The gradient of the chi2. |
Definition at line 347 of file FitterBase.cc.
|
overrideprivatevirtual |
Compute the derivatives of the measured stars and model for one CcdImage.
The last argument will process a sub-list for outlier removal.
Implements lsst::jointcal::FitterBase.
Definition at line 107 of file AstrometryFit.cc.
|
overrideprivatevirtual |
Compute the derivatives of the reference terms.
Implements lsst::jointcal::FitterBase.
Definition at line 236 of file AstrometryFit.cc.
|
inherited |
Does a 1 step minimization, assuming a linear model.
This is a complete Newton Raphson step. Compute first and second derivatives, solve for the step and apply it, with an optional line search.
It calls assignIndices, leastSquareDerivatives, solves the linear system and calls offsetParams, then removes outliers in a loop if requested. Relies on sparse linear algebra via Eigen's CholmodSupport package.
[in] | whatToFit | See child method assignIndices for valid string values. |
[in] | nSigmaCut | How many sigma to reject outliers at. Outlier rejection ignored for nSigmaCut=0. |
[in] | sigmaRelativeTolerance | Percentage change in the chi2 cut for outliers tolerated for termination. If value is zero, minimization iterations will continue until there are no outliers. |
[in] | doRankUpdate | Use CholmodSimplicialLDLT2.update() to do a fast rank update after outlier removal; otherwise do a slower full recomputation of the matrix. Only matters if nSigmaCut != 0. |
[in] | doLineSearch | Use boost's brent_find_minima to perform a line search after the gradient solution is found, and apply the scale factor to the computed offsets. The line search is done in the domain [-1, 2], but if the scale factor is far from 1.0, then the problem is likely in a significantly non-linear regime. |
[in] | dumpMatrixFile | Write the pre-fit Hessian matrix and gradient to the files with "-mat.txt" and "-grad.txt". Be aware, this requires a large increase in memory usage to create a dense matrix before writing it; the output file may be large. Writing the matrix can be helpful for debugging bad fits. Read it and compute the real eigenvalues (recall that the Hessian is symmetric by construction) with numpy: hessian = np.matrix(np.loadtxt("dumpMatrixFile-mat.txt"))
values, vectors = np.linalg.eigh(hessian)
|
Definition at line 179 of file FitterBase.cc.
|
overridevirtual |
Offset the parameters by the requested quantities.
The used parameter layout is the one from the last call to assignIndices or minimize(). There is no easy way to check that the current setting of whatToFit and the provided Delta vector are compatible: we can only test the size.
[in] | delta | vector of offsets to apply |
Implements lsst::jointcal::FitterBase.
Definition at line 454 of file AstrometryFit.cc.
|
delete |
|
delete |
|
protectedinherited |
Contributions to derivatives from (presumably) outlier terms.
No discarding done.
Definition at line 322 of file FitterBase.cc.
|
protectedinherited |
Remove measuredStar outliers from the fit. No Refit done.
Definition at line 333 of file FitterBase.cc.
|
protectedinherited |
Remove refStar outliers from the fit. No Refit done.
Definition at line 341 of file FitterBase.cc.
|
virtualinherited |
Save the full chi2 term per star that was used in the minimization, for debugging.
Saves results to text files "baseName-meas.csv" and "baseName-ref.csv" for the MeasuredStar and RefStar contributions, respectively. This method is mostly useful for debugging: we will probably want to create a better persistence system for jointcal's internal representations in the future (see DM-12446).
Definition at line 355 of file FitterBase.cc.
|
overrideprotectedvirtual |
Save a CSV file containing residuals of measurement terms.
Implements lsst::jointcal::FitterBase.
Definition at line 496 of file AstrometryFit.cc.
|
overrideprotectedvirtual |
Save a CSV file containing residuals of reference terms.
Implements lsst::jointcal::FitterBase.
Definition at line 569 of file AstrometryFit.cc.
|
protectedinherited |
Definition at line 165 of file FitterBase.h.
|
protectedinherited |
Definition at line 168 of file FitterBase.h.
|
protectedinherited |
Definition at line 174 of file FitterBase.h.
|
protectedinherited |
Definition at line 170 of file FitterBase.h.
|
protectedinherited |
Definition at line 171 of file FitterBase.h.
|
protectedinherited |
Definition at line 169 of file FitterBase.h.
|
protectedinherited |
Definition at line 166 of file FitterBase.h.