Skip to content

fabian-s/ba-ma-expos

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Topics for BA or MA Theses

Working Group FDA

Last update: 2025-06-27

Please contact Fabian Scheipl if you’re interested in one of these BA or MA thesis topics or if you want to discuss (related) ideas of your own.
For BA theses, we would keep the focus on refactoring, evaluating and describing existing implementations and/or applying them to real data, for MA theses either novel developments with detailed theory along with clean and performant implementations would be expected, or challenging analyses of more complex data sets with advanced methods.

Topic Area: Improving tidyfun and related packages

tidyfun is an R package for functional data analysis currently under development. Some of the issues tracked on Github for this and its underlying infrastructure package tf could also be good topics for theses could also be good topics for theses: see here or here.

Topic: Implementing and comparing functional principal component-based representations for functional data (BA/MA)

Functional data $x_i(t)$ can be represented very efficiently in terms of their eigenfunctions (functional principal components: FPCs), but this requires estimating their auto-covariance function $\text{Cov}(x_i(t), x_i(t'))$ from potentially noisy and/or partially missing data. The functional data literature contains a multitude of proposals on how to do so (E.g. Shang (2011) provides a slightly out-of-date review of background and basic approaches.).
For your thesis, you will describe the most important algorithms, (re-)implement some of them for use in tf (or: write glue code to integrate existing implementations into tf), and compare their performance in an extensive benchmark study on real and synthetic data sets.

The topic is suitable for a wide range of programming skills and scientific ambitions. If both are high, this topic can even be extended to something that could result in a publication, especially if extended to FPC representations for non-Gaussian data like Dey et al., 2024, or to NN-based covariance estimators like Sarkar et al., 2022.

Topic: Implementing and comparing quantile methods for functional data (BA/MA)

The functional data literature contains many possible definitions of “function-valued quantiles”, e.g. (Gil & Romo, 2013), (Gijbels & Nagy, 2017). We would pick out some of the most relevant/interesting of these, summarize the relevant theory behind them, implement them for use within tidyfun, and perform a comparison based on real and/or synthetic data sets.

A minimal BA thesis in this topic area could be re-implementing, documenting and validating (most of) the methods in the rainbow package integrated into / as an add-on package for tf & tidyfun.
MA theses about this topic would go deeper into the theory of functional data depths (e.g. Nieto-Reyes & Battey, 2018)) and/or tackle additional complicating factors such as methods for incompletely observed curves (e.g. (Elías et al., 2022), (Elías et al., 2021)).

Topic: Implementing multivariate functions in tf (MA, maybe BA)

Extend tf-classes and methods for multivariate functions with vector outputs: $f:\mathbb R \to \mathbb R^d$ for $d>1$.

This is a large SWE task - scope would probably be limited to extending either the tfd or tfb classes, and may require some major refactoring of tf to make such an extension work smoothly and consistently (e.g. it probably requires defining new classes and logic for function domains).

Topic: Representation and computation for probability densities in Bayes space (BA, maybe MA)

The Bayes Space paradigm developed by v.d. Boogart, Hron, Egozcue and others (e.g. v.d. Boogart et al. (2014), Hron et al. (2016)) provides a way to represent probability measures so that their addition and multiplication are well defined, enabling simple summary statistics (means etc) as well as methods such as PCA or linear regression for probability-density-valued data – i.e. the unit of observation is represented by an entire probability distribution, not a single value, and the inferential goal is typically to understand how other covariates are associated with changes in these distributions. This has many interesting applications, for example see Meier et al. (2021) for differential effects of family formation on gender-specific income distributions in East and West Germany or Menafoglio et al. (2021) for an application to groundwater monitoring.
A thesis on this topic would

  • summarize the necessary theoretic background and literature
  • implement functionality for tf and tidyfun that represents density data and performs arithmetic operations as well as basic statistics in Bayes space (e.g. also implement suitable ZB-Splines, see Skorna et al (2024)
  • apply this to an interesting real-world data set (or: replicate a published analysis in this context with the new implementation).

Topic: Functional Data Representation with Merge Trees (MA)

Pegoraro & Secchi (2023) develop representations of (noisy, heterogenous) functional data that are invariant to misalignment, i.e. representations that are suitable for comparing and analyzing the shapes of unregistered curves while discarding even fairly complex phase variability. In this thesis, you would summarize the relevant mathematical background, implement the techniques from the paper in R & evaluate them on some data.
This topic involves quite advanced and interesting mathematics from topology, metric spaces, and graph theory as well as differential geometry. The paper to implement is state of the art, so this makes an excellent topic for people considering staying in academia and looking for a thesis topic that might turn into something publishable, especially if any of the stretch goals below become part of the thesis.

Tasks would include:

  • summarizing/explaining the maths behind the method
  • re-implementing the algorithms and visualizations from the paper in R, preferably using infrastructure of / integrated into tf/tidyfun
  • benchmarking against similar approaches available in R
  • evaluation of the performance on real world datasets (e.g. mouse brain stem audiograms, bodyweight fitness movement patterns, story arc data, …)

Stretch goals could include developing a variant of Kim, Dasgupta, Srivastava (2023) based on merge trees instead of peak persistence diagrams or accommodating functional fragments/unequal domains with functions of different observed lengths.

Topic Area: Improving manifun (BA/MA)

manifun is a small, unpublished R package for dimension reduction and embedding visualization (primarily) for functional data. Possible tasks include implementing suitable interfaces to mlr3 and/or tidyfun. Implementing AUMVC framework could be included in this topic area as well.

Topic: Improved interactive visualization of functional data embeddings (MA)

The central goal of the project is to improve existing and implement new embedding (i.e. dimension reduction) visualization approaches. Fairly flexible, interactive versions of the kind of visualization shown below: that includes e.g. tooltips/interactive highlighting when hovering over specific data points, brushing for selecting and highlighting specific embedding regions or curves, etc have already been implemented in a previous MA thesis (EmbedIt, Jennert 2023).

Thesis goals could include:

  • Re-implementing EmbedIt based on more performant software like D3.js or refactoring it for better responsiveness etc
  • Adding interactive 3D visualizations
  • Implementing a “grand tour” and other classic multivariate exploration tools (c.f. tourr)
  • Adding pre-processing and embedding steps to the existing app
  • Writing up interesting case studies based on real world datasets (e.g. mouse brain stem audiograms, bodyweight fitness movement patterns, story arc data, …)

Topic Area: (FDA) Outlier Detection

Beyond the methodological/theoretical topics below, we could develop more applied thesis topics in this context together with external partners that deal with large functional data sets such as the German Mouse Clinic (e.g. auditory brain stem response curves) or with (partners of) Prof. Christian Müller’s group at the Institute of Statistics.

Topic: Implementing the AUMVC framework (MA)

The area-under-the-mass-volume-curve (AUMVC, pdf) can be used to tune outlier detection algorithms. Yet, a major caveat is that it relies on MC simulations for approximating integrals and is thus not applicable to high-dimensional settings. Combining it with dimension reduction and manifold learning may allow to solve this issue.
The goal of this project is to implement the AUMVC framework in manifun and to conduct initial experiments. The central questions to be answered are:

  • How robust is the AUMVC approach to the ambient dimensionality of the data? This could be assessed by comparing results on image and functional data.
  • A further question, which may be investigated: are there any distance measures for complex data such as images, which can be used to induce suitable bias for AUMVC to work on (embeddings of) such data?
  • stretch goal: can AUMVC be adapted to sample only from the relevant space so it scales better to (nominally) high-dimensional data? e.g. by simulating data uniformly from the (convex hull) of the observed data or from lower dimensional (but: almost losslessly compressed) representations/embeddings of the data?

Topic: Criterion for structural outlyingness (BA)

Multi-dimensional scaling (MDS) can be used to represent the outlier structure of functional datasets (pdf). However, MDS embeddings represent the entire data structure (… hopefully, at least), not just structural outlyingness. Since MDS embedding dimensions are sorted by decreasing amount of “explained structure”, this might lead to components of structural outlyingness being represented only in “late” embedding dimensions in datasets with few outliers and complex structured variation of high rank.
You would develop and evaluate a procedure for identifying embedding dimensions (or 2D-subspaces of such embeddings) in which structural outlyingness is reflected, i.e. the goal is to find relevant (combinations of) embedding dimensions for outlier visualization/detection (and, possibly, for tuning AUMVC if embeddings are too high-dimensional, see below). Possible approaches:

  • use something like HiCS (Link; this is computationally heavy)
  • run Local Outlier Factor (LOF) or similar methods on each 2D-subspace and pick the ones where upper-tail (!) dependencies with global LOF scores are maximal – “upper-tail” only because the strength of association between global LOF scores and corresponding subspace LOF scores for low/intermediate values is irrelevant for this issue.

Topic: Multivariate Functional Outlier Visualization and Detection (BA)

Replicate the simulation study and application examples of Aléman-Gomez et al. (2021) based on a less arbitrary geometrical-topological approach and compare results.

Topic Area: Cluster Analysis

Topic: Embedding-based cluster analysis of overlapping / fuzzy clusters (MA)

Both UMAP and t-SNE, state-of-the-art manifold learning methods, can be used to detect and represent the cluster structure of complex, high-dimensional data. However, which method is more suitable for the task (or specific aspects of the task) under which conditions remains an open question. Answering this question is complicated since several hyperparameters need to be tuned for both methods and the underlying task is unsupervised (i.e., tuning is hard…).
While there are indications that UMAP leads to “better” clusterings (smaller intra-cluster distances, larger inter-cluster distances) when high-dimensional data consists of clearly separate clusters, the situation is less clear in situations with very close or even overlapping clusters. The focus of this project is to assess the latter setting and tasks include the following:

  • set up extensive synthetic experiments to obtain an initial understanding of the problem. Possible factors to assess:
    • Overlap/Separability as a function of mean and variance of the underlying data generating processes
    • Parameter sensitivity w.r.t. to dimensionality and number of observations
    • Relevant parameters for improving separability
  • investigate whether measures of separability (pdf) can be used to reliably infer the structure of data set

Topic Area: Regression Models with/for functional data

Simultaneous, auto-correlation-corrected confidence bands for functional regression coefficients (BA, MA possible with some extensions)

Confidence intervals for refund’s functional regression models estimated by pffr rely on very restrictive assumptions about model residuals and are only valid point-wise, not simultaneously across the function. Therefore, they are inappropriate in many applications and tend to yield over-optimistic results.
For this thesis, you would implement Liebl & Reimherr’s (2020) proposal for fast and fair simultaneous CIs for pffr-fits and compare its operating characteristics to bootstrap-based and conventional alternatives.

Refactoring refund::pffr & refund::pfr (MA)

These fairly old and rather badly written functions implement very general classes of penalized regression models (GAMs and GAMMs) for functional responses and/or predictors. Your thesis would be to re-write them from scratch with my help, using best practices for R programming like proper unit tests, input validation, and extensive documentation. This could also include developing a more stream-lined, consistent formula interface and developing better methods to deal with factor covariates and interaction effects as well as writing up some interesting case studies to be published as a vignette accompanying the package. See Scheipl & Greven (2017) for a review of the underlying methodology.

Validating and extending fastFMM::fui (MA)

The “Fast Univariate Inference for Longitudinal Functional Models”-framework (Cui et al, 2021) is an extremely efficient and powerful approach for large-scale regression models with functional responses, but the current implementation in fastFMM is somewhat limited and could be extended in a couple of directions:

  1. Only linear effects of scalar covariates - nonlinear effects are a fairly straightforward extension.
  2. Only (effects of) functional covariates that are measured concurrently with the response can be included, i.e., fui currently makes the restrictive assumption that functional covariates are measured at the same times as functional responses and only associated with functional responses at each common timepoint, not cumulatively or with some time lag. More flexible effects for functional covariates not measured on the same domain as the response or having cumulative or delayed effects similarly to those available in refund::pffr could be developed.
  3. Domain selection for functional effects (i.e. shrinking coefficient functions to 0 across parts of the domain) could be added to improve interpretability and parsimony of the fitted models.
  4. Only functional responses on regular, common grids are currently possible – a Master’s thesis could set up some simulation experiments to investigate to what extent this requirement can be loosened, e.g. by interpolating or binning irregularly measured functional responses in a pre-processing step to turn them into functional data on a regular grid.
  5. The current version does not implement convenience functions like predict, resid, summary etc that users rely on for quick post-processing (model diagnostics, evaluation, etc) – these should be added.

For this thesis, you would fork the fastFMM-code and solve (a subset of) the tasks above.

About

Thesis topics for BA/MA

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published