LSST Applications g063fba187b+fee0456c91,g0f08755f38+ea96e5a5a3,g1653933729+a8ce1bb630,g168dd56ebc+a8ce1bb630,g1a2382251a+90257ff92a,g20f6ffc8e0+ea96e5a5a3,g217e2c1bcf+937a289c59,g28da252d5a+daa7da44eb,g2bbee38e9b+253935c60e,g2bc492864f+253935c60e,g3156d2b45e+6e55a43351,g32e5bea42b+31359a2a7a,g347aa1857d+253935c60e,g35bb328faa+a8ce1bb630,g3a166c0a6a+253935c60e,g3b1af351f3+a8ce1bb630,g3e281a1b8c+c5dd892a6c,g414038480c+416496e02f,g41af890bb2+afe91b1188,g599934f4f4+0db33f7991,g7af13505b9+e36de7bce6,g80478fca09+da231ba887,g82479be7b0+a4516e59e3,g858d7b2824+ea96e5a5a3,g89c8672015+f4add4ffd5,g9125e01d80+a8ce1bb630,ga5288a1d22+bc6ab8dfbd,gb58c049af0+d64f4d3760,gc28159a63d+253935c60e,gcab2d0539d+3f2b72788c,gcf0d15dbbd+4ea9c45075,gda6a2b7d83+4ea9c45075,gdaeeff99f8+1711a396fd,ge79ae78c31+253935c60e,gef2f8181fd+3031e3cf99,gf0baf85859+c1f95f4921,gfa517265be+ea96e5a5a3,gfa999e8aa5+17cd334064,w.2024.50
LSST Data Management Base Package
|
A helper class for subdividing pybind11 module across multiple translation units (i.e. More...
#include <python.h>
Public Types | |
using | WrapperCallback = std::function<void(pybind11::module &)> |
Function handle type used to hold deferred wrapper declaration functions. | |
Public Member Functions | |
WrapperCollection (pybind11::module module_, std::string const &package) | |
Construct a new WrapperCollection. | |
WrapperCollection (WrapperCollection &&other) noexcept | |
WrapperCollection (WrapperCollection const &)=delete | |
WrapperCollection & | operator= (WrapperCollection const &)=delete |
WrapperCollection & | operator= (WrapperCollection &&)=delete |
~WrapperCollection () noexcept | |
WrapperCollection | makeSubmodule (std::string const &name) |
Create a WrapperCollection for a submodule defined in the same binary. | |
void | collectSubmodule (WrapperCollection &&submodule) |
Merge deferred definitions in the given submodule into the parent WrapperCollection. | |
void | addInheritanceDependency (std::string const &name) |
Indicate an external module that provides a base class for a subsequent addType call. | |
void | addSignatureDependency (std::string const &name) |
Indicate an external module that provides a type used in function/method signatures. | |
void | wrap (WrapperCallback function) |
Add a set of wrappers without defining a class. | |
template<typename PyType , typename ClassWrapperCallback > | |
PyType | wrapType (PyType cls, ClassWrapperCallback function, bool setModuleName=true) |
Add a type (class or enum) wrapper, deferring method and other attribute definitions until finish() is called. | |
template<typename CxxException , typename CxxBase > | |
auto | wrapException (std::string const &pyName, std::string const &pyBase, bool setModuleName=true) |
Wrap a C++ exception as a Python exception. | |
void | finish () |
Invoke all deferred wrapper-declaring callables. | |
A helper class for subdividing pybind11 module across multiple translation units (i.e.
source files).
Merging wrappers for different classes into a single compiled module can dramatically decrease the total size of the binary, but putting the source for multiple wrappers into a single file slows down incremental rebuilds and makes editing unwieldy. The right approach is to define wrappers in different source files and link them into a single module at build time. In simple cases, that's quite straightforward: pybind11 declarations are just regular C++ statements, and you can factor them out into different functions in different source files.
That approach doesn't work so well when the classes being wrapped are interdependent, because bindings are only guaranteed to work when all types used in a wrapped method signature have been declared to pybind11 before the method using them is itself declared. Naively, then, each source file would thus have to have multiple wrapper-declaring functions, so all type-wrapping functions could be executed before any method-wrapping functions. Of course, each type-wrapping function would also have to pass its type object to at least one method-wrapping function (to wrap the types own methods), and the result is a tangled mess of wrapper-declaring functions that obfuscate the code with a lot of boilerplate.
WrapperCollection provides a way out of that by allowing type wrappers and their associated methods to be declared at a single point, but the method wrappers wrapped in a lambda to defer their execution. A single WrapperCollection instance is typically constructed at the beginning of a PYBIND11_MODULE block, then passed by reference to wrapper-declaring functions defined in other source files. As type and method wrappers are added to the WrapperCollection by those functions, the types are registered immediately, and the method-wrapping lambdas are collected. After all wrapper-declaring functions have been called, finish() is called at the end of the PYBIND11_MODULE block to execute the collecting method-wrapping lambdas.
Typical usage:
Note that we recommend the use of universal lambdas (i.e. auto &
parameters) to reduce verbosity.
using lsst::cpputils::python::WrapperCollection::WrapperCallback = std::function<void(pybind11::module &)> |
|
inlineexplicit |
Construct a new WrapperCollection.
A WrapperCollection should be constructed at or near the top of a PYBIND11_MODULE
block.
[in] | module_ | Module instance passed to the PYBIND11_MODULE macro. |
[in] | package | String name of the package all wrapped classes should appear to be from (by resetting their __module__ attribute). Note that this can lead to problems if classes are not also lifted into the package namespace in its __init__.py (in addition to confusing users, this will prevent unpickling from working). |
|
inlinenoexcept |
|
delete |
|
inlinenoexcept |
|
inline |
Indicate an external module that provides a base class for a subsequent addType call.
Dependencies that provide base classes cannot be deferred until after types are declared, and are always imported immediately.
[in] | name | Name of the module to import (absolute). |
Definition at line 343 of file python.h.
|
inline |
Indicate an external module that provides a type used in function/method signatures.
Dependencies that provide classes are imported after types in the current module are declared and before any methods and free functions in the current module are declared.
[in] | name | Name of the module to import (absolute). |
|
inline |
Merge deferred definitions in the given submodule into the parent WrapperCollection.
submodule | A WrapperCollection created by makeSubmodule. Will be consumed (and must be an rvalue). |
Definition at line 329 of file python.h.
|
inline |
Invoke all deferred wrapper-declaring callables.
finish()
should be called exactly once, at or near the end of a PYBIND11_MODULE
block.
Definition at line 435 of file python.h.
|
inline |
Create a WrapperCollection for a submodule defined in the same binary.
WrapperCollections created with makeSubmodule should generally be destroyed by moving them into a call to collectSubmodule; this will cause all deferred definitions to be executed when the parent WrapperCollection's finish() method is called.
name | Relative name of the submodule. |
Attributes added to the returned WrapperCollection will actually be put in a submodule that adds an underscore prefix to name
, with __module__
set with the expectation that they will be lifted into a package without that leading underscore by a line in __init__.py
like:
from ._package import _submodule as submodule
This is necessary to make importing _package
possible when submodule
already exists as a normal (i.e. directory-based) package. Of course, in that case, you'd instead use a submodule/__init__.py
with a line like:
from .._package._submodule import *
__module__
of any classes added to it to {package}.{name}
. Definition at line 318 of file python.h.
|
delete |
|
delete |
|
inline |
Add a set of wrappers without defining a class.
[in] | function | A callable object that takes a single pybind11::module argument (by reference) and adds pybind11 wrappers to it, to be called later by finish() . |
|
inline |
Wrap a C++ exception as a Python exception.
CxxException | C++ Exception type to wrap. |
CxxBase | Base class of CxxException. |
[in] | pyName | Python name of the new exception. |
[in] | pyBase | Python name of the pex::exceptions Exception type the new exception inherits from. |
[in] | setModuleName | If true (default), set cls.__module__ to the package string this WrapperCollection was initialized with. |
pybind11::class_
instance (template parameters unspecified) representing the Python type of the new exception. Definition at line 421 of file python.h.
|
inline |
Add a type (class or enum) wrapper, deferring method and other attribute definitions until finish() is called.
[in] | cls | A pybind11::class_ or enum_ instance. |
[in] | function | A callable object that takes a pybind11::module argument and a pybind11::class_ (or enum_ ) argument (both by reference) and defines wrappers for the class's methods and other attributes. Will be called with this->module and cls by finish() . |
[in] | setModuleName | If true (default), set cls.__module__ to the package string this WrapperCollection was initialized with. |
cls
argument for convenience Definition at line 391 of file python.h.