Extending HDP for Mutational Signatures: Incorporating Evolutionary Trees
My previous blog post derived a Hierarchical Dirichlet Process (HDP) for discovering mutational signatures, estimating their activities across samples, and learning the number of signatures from the data. That model shares information across samples but does not encode their evolutionary relationships.
Here I extend it with a phylogenetic tree. The prior then favors similar mutational signature activities in evolutionarily related cells.
Biological motivation
Single-cell sequencing lets us model how mutational signature activities vary within a tumor. Evolutionarily related cells should have more similar activities than distantly related ones.
In cancer, a subclone represents a set of tumor cells descending from the same ancestor and hence sharing mutations. For many measurement modalities, there are established methods to infer relationships between subclones, often represented as tree structures. Examples include:
The model needs a reliable tree topology but does not depend on a particular construction method.
Consider the following example tree, where edges represent evolutionary relatedness:

The nodes can have different numbers of cells, including none. Dropping the cell counts and enumerating the nodes gives:

Let represent the topology of the tree. Without loss of generality, we assume a single tree for our input data. If multiple trees exist, such as when separate trees are constructed for different tumors, we can combine them by introducing a new root node and connecting the root nodes of the individual trees to this new root.
This tree consists of nodes . Each node can represent a subclone or serve as a connecting node. For each node we observe trinucleotide mutations . Note that is allowed. Let denote the activity catalogue in node .
Subclones with a closer evolutionary history should have more similar mutational signature activity. Let be a measure of dissimilarity on . In the above example we expect that . When we have access to tree topology , we can incorporate into our model as prior knowledge when inferring and consequently and .
The tree-structured HDP model
Instead of making every sample depend directly on a common base distribution , each tree node gets a Dirichlet Process based on its parent.
Sticking to the color coding from above, the graphical model of the proposed model looks as follows:

Each variable is a Dirichlet Process. For simplicity, we have omitted the scaling parameters for each Dirichlet process from the graph. In this example, we observe trinucleotide mutations in nodes but not in .
Because and vary around , while and vary around , the prior makes more similar to than to . This induces the same relationship among , , and that motivated the extension.
In the above example, is the base probability distribution of . Therefore, the support of is a subset of the support of , i.e., . A major shift in signature activity from node to could present a challenge for the model. It would be valuable to investigate whether such a shift is biologically plausible and, if so, to test the model in that scenario.
Mathematical formulation
The sampling of , , and works exactly as in the classical HDP model from my previous post:
The change is in the sampling of . Consider a tree topology . We write if and only if the -th node is a child of the -th node. Then we model the Dirichlet Process at each node of the tree as:
In words, at each node of the tree we draw from a Dirichlet Process with an individual scaling parameter and the base probability distribution from the parent node. By the mathematical properties of the Dirichlet Process, varies around the probability distribution of its parent node. Hence, distribution properties of get propagated to and further down the tree, ensuring that evolutionarily related nodes have similar mutational signature activities.
Data requirements
The model requires sequencing at the single-cell or subclonal level to construct a tree. The tumor sample must also contain enough trinucleotide mutations, typically seen in late-stage tumors, and the sequencing must cover a large enough genomic region to measure them.
Implementation and evaluation
Implementation
The current prototype is a fork of the HDP implementation by Nicola Roberts in R with some helper functions. A Python port would make it accessible to more users.
Benchmarking against standard methods
The tree-structured HDP also needs to be benchmarked against standard approaches. The evaluation would involve:
- Dataset Selection: Choose a dataset suitable for the proposed method with available tree topology
- Method Comparison: Estimate mutational signatures using:
- Classical NMF approach: and
- Tree-structured HDP: and
- Evaluation: Compare how well the estimated signature activities and respect the known tree topology
Alternative approaches
Instead of the Hierarchical Dirichlet Process approach, we could use variations of Non-negative Matrix Factorization. Given observed mutation catalogue and a constructed tree topology , we could introduce a penalization term to ensure that the tree topology is respected:
A desirable property of the function would be that for samples attached to nodes in the graph which are close to each other, we have similar and .
Alternatively, we could explore hierarchical NMF approaches. There is abundant literature on NMF and its variations, including Sugahara et al., Ding et al., Ferreira et al., and Schmidt & Raphael.
Extension to other mutational events
Instead of focusing solely on trinucleotide mutational events, we could study other mutational events with the proposed model. For example, we could study chromosomal instability events using the approach described in Drews et al.. However, this would introduce additional requirements to the input data, such as high read depth, and such datasets are not yet widely available.
Recommended material for chromosomal instability events
- https://markowetz.cruk.cam.ac.uk/cincompendium/
- https://github.com/markowetzlab/CINSignatureQuantification
- calculateFeatures function
- R package to quantify signatures of chromosomal instability on absolute copy number profiles as described in Drews et al.
Comparison with existing literature
The proposed approach should also be compared with existing work such as Alam et al. to identify its theoretical and practical differences.
Conclusion
The tree-structured HDP encodes the expectation that evolutionarily related cells should have more similar mutational signature activities.
Each node has its own Dirichlet Process based on its parent, so distribution properties propagate down the tree instead of treating samples independently.
Making the model practical still requires suitable data, an implementation, and benchmarks against the alternatives described above.