Student research projects & theses
    Login
  • Designing Cultural Verification Frameworks for Large Language Models (LLMs) (Mandeep Rathee)
    Current alignment techniques, such as RLHF (Reinforcement Learning from Human Feedback), typically rely on a centralized set of "safety guidelines" that reflect the cultural norms of the model's developers. This often leads to cultural misalignment, where the LLM may inadvertently erase local nuances, apply inappropriate social taboos, or fail to recognize regional linguistic etiquette.
    This thesis aims to move beyond "cultural awareness" toward Cultural Verification. The student will design a systematic framework to evaluate and verify whether an LLM’s outputs adhere to the specific socio-cultural norms, value systems, and historical contexts of a target demographic.

    Key Responsibilities & Tasks:

    The research will be structured around four primary pillars, beginning with the development of a comprehensive Taxonomy of Cultural Correctness to define the specific dimensions—such as social hierarchy, religious sensitivities, and gender roles—necessary for nuanced LLM evaluation. Building upon this foundation, the study will propose a Verification Methodology centered on a "Cultural Guardrail" architecture, utilizing both programmatic checks and human-in-the-loop oversight to validate model responses. To test the efficacy of this framework, a specialized Benchmark will be curated, featuring a localized "red-teaming" suite designed to expose cultural hallucinations and latent insensitivities. Finally, a Comparative Analysis will be conducted to measure the performance of leading models, including GPT-4, Llama 3, and Claude, against these proposed designs across two or more distinct cultural contexts.



    Requirements:
    - Experience with LLMs, HuggingFace
    - LLM fine-tuning
    - Python
    - Knowledge of German culture and language is a plus.

    Related Work:
    - Atari et al. (2023): "Which Humans? Probabilistic Expectations and Social Values in LLMs."
    - Wang, Jiahao, Songkai Xue, Jinghui Li, and Xiaozhen Wang. "Diverse Human Value Alignment for Large Language Models via Ethical Reasoning." In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, vol. 8, no. 3, pp. 2637-2648. 2025.
    - Venktesh, V., Mandeep Rathee, and Avishek Anand. "Trust but verify! a survey on verification design for test-time scaling." arXiv preprint arXiv:2508.16665 (2025).


    Project/Thesis language:
    English

    Contact:
    Please contact Mandeep Rathee if you are interested in discussing this topic.
  • Road-Shoulder Traversability from Stereo/LiDAR for Mowing Robots (Dr. Nicolás Navarro)
    In this thesis, you will derive road-shoulder traversability from stereo/LiDAR, capturing slope, curb, ditch, and surface roughness to enable safe planning near road edges, and validate predictions against real field logs.

    The tasks include:
    * Build a pipeline to fuse stereo depth and/or LiDAR into terrain primitives: slope, curb/edge step, ditch depth, roughness (e.g., surface variance, ESF/planarity).
    * Convert primitives to a traversability costmap/risk layer with clear thresholds and uncertainty.
    * Evaluate on off-road/roadside datasets (e.g., RELLIS-3D, RUGD) and replay field logs for end-to-end validation (near-miss/stop rates, path feasibility).
    * Report metrics: ROC/PR for traversable vs. non-traversable, curb F1/AP, slope/roughness error vs. ground truth or survey labels, and planning success on replays.

    Requirements:
    * Robotics/Perception basics; 3D geometry & point-cloud processing
    * Python/C++ (ROS 2), Git, Linux

    Related Work:
    Jiang, P., Osteen, P., Wigness, M., & Saripalli, S. (2021). RELLIS-3D Dataset: Data, Benchmarks and Analysis. IEEE ICRA, 1110–1116. https://doi.org/10.1109/ICRA48506.2021.9561251

    Wigness, M., Eum, S., Rogers, J., & Kwon, H. (2019). A RUGD Dataset for Autonomous Navigation and Visual Perception in Unstructured Outdoor Environments. IEEE/RSJ IROS. https://doi.org/10.1109/IROS40897.2019.8968283

    Gasparino, M. V., Sivakumar, A. N., Liu, Y., Velasquez, A. E. B., Higuti, V. A. H., Tran, H., & Chowdhary, G. (2022). WayFAST: Navigation with Predictive Traversability in the Field. IEEE Robotics and Automation Letters, 7(4), 10651–10658. https://arxiv.org/abs/2203.12071

    Project/Thesis language:
    English

    Contact:
    Please contact Dr. Nicolás Navarro if you are interested in discussing this topic.
  • Autonomous Off-road driving using 3D Voxel Maps (Dr. Nicolás Navarro)
    In this thesis, you will build a multi-modal 3D voxel mapping stack (elevation + occupancy/ESDF with semantics) for lane-less roadside terrain, producing uncertainty-aware traversability that outperforms 2D costmaps.

    The tasks include:
    * Integrate stereo/LiDAR (+ optional IMU/GNSS) into a real-time voxel map (TSDF/ESDF); maintain map updates under motion.
    * Fuse semantic cues (grass/curb/obstacle masks) into elevation/occupancy; model uncertainty for risk-aware planning.
    * Validate planner-ready layers (ESDF, traversability) and benchmark vs. 2D baselines on roadside datasets.
    * Run ablations on depth sparsity/noise, voxel resolution, and update rates.

    Requirements:
    * Robotics/SLAM basics; probability & linear algebra
    * C++ and/or Python; ROS 2; Git, Linux

    Related Work:
    Oleynikova, H., Taylor, Z., Fehr, M., Nieto, J., & Siegwart, R. (2017). Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning. IEEE/RSJ IROS, 1366–1373. https://doi.org/10.1109/IROS.2017.8202315

    Millane, A., Oleynikova, H., Wirbel, E., Steiner, R., Ramasamy, V., Tingdahl, D., & Siegwart, R. (2024). nvblox: GPU-Accelerated Incremental Signed Distance Field Mappingnvblox: GPU-Accelerated Incremental Signed Distance Field Mapping. IEEE RA-L / ICRA. https://ieeexplore.ieee.org/document/10611532

    Miki, T., et al. (2022). Elevation Mapping for Locomotion and Navigation using GPU. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://ieeexplore.ieee.org/document/9981507

    Project/Thesis language:
    English

    Contact:
    Please contact Dr. Nicolás Navarro if you are interested in discussing this topic.
  • Continual Learning for Invasive Species Detection in Field Robotics (Dr. Nicolás Navarro)
    In this thesis, you will design a continual learning pipeline to handle distribution shift (new invasive grass types, seasonal/region changes) without catastrophic forgetting. Training occurs offboard (in the cloud/lab) with periodic rollout to robots; the system must propose new classes and preserve prior performance across the entire fleet.

    The tasks include:

    * Build a class-incremental pipeline (rehearsal/coresets, regularization, knowledge distillation) with reproducible splits (old vs. new classes).
    * Add novelty/OOD detection to flag potential new species; integrate weak labels and active learning loops.
    * Define metrics and dashboards for pre/post deployment (mAP on old classes, mAP on new classes, average forgetting, calibration).

    Requirements:
    * Machine Learning, Deep Learning (classification/detection)
    * Computer Vision (PyTorch/TensorFlow), Python, Git, Linux

    Related Work:
    Pagé-Fortin, M. (2023). Class-Incremental Learning of Plant and Disease Detection: Growing Branches with Knowledge Distillation. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVW 2023). https://doi.org/10.1109/ICCVW60793.2023.00066

    Li, D., Yin, Z., Zhao, Y., & Zhang, H. (2024). Rehearsal-based Class-Incremental Learning Approaches for Plant Disease Classification. Computers and Electronics in Agriculture, 224, 109211. https://doi.org/10.1016/j.compag.2024.109211

    Shmelkov, K., Schmid, C., & Alahari, K. (2017). Incremental Learning of Object Detectors without Catastrophic Forgetting. Proceedings of the IEEE International Conference on Computer Vision (ICCV 2017), 3420–3429. https://doi.org/10.1109/ICCV.2017.368

    Project/Thesis language:
    English

    Contact:
    Please contact Dr. Nicolás Navarro if you are interested in discussing this topic.
  • Robust Grass Recognition under Variable Conditions (lighting/weather/season/motion) (Dr. Nicolás Navarro)
    In this thesis, you will develop a robust vision method for recognizing invasive grass patches under challenging lighting conditions, weather conditions, seasonal changes, and motion blur—mitigating domain shift via domain generalization and test-time adaptation.
    The tasks include:

    * Curate a multi-condition dataset (day/night, sun/cloud, rain/fog, seasons, motion blur) and define train/val/test splits for robustness.
    * Implement strong baselines (e.g., SegFormer/FCN) with targeted augmentations/invariances (exposure, color, blur, weather).
    * Add domain generalization (e.g., style/appearance diversification) and test-time adaptation (entropy- or consistency-based).
    * Evaluate robustness across conditions (mIoU/mAP by domain; calibration), and validate in field tests on roadside scenes.

    Requirements:
    * Machine Learning, Computer Vision
    * Python, PyTorch/TensorFlow; Git, Linux

    Related Work:
    Lottes, P., Behley, J., Milioto, A., & Stachniss, C. (2018). Fully Convolutional Networks with Sequential Information for Robust Crop and Weed Detection in Precision Farming. IEEE Robotics and Automation Letters, 3(4), 3097–3104. https://doi.org/10.1109/LRA.2018.2846289

    Lottes, P., Behley, J., Chebrolu, N., Milioto, A., & Stachniss, C. (2020). Robust Joint Stem Detection and Crop–Weed Classification Using Image Sequences for Plant-Specific Treatment in Precision Farming. Journal of Field Robotics, 37(1), 20–34. https://doi.org/10.1002/rob.21901

    Wang, P., Tang, Y., Luo, F., Wang, L., Li, C., Niu, Q., & Li, H. (2022). Weed25: A Deep Learning Dataset for Weed Identification. Frontiers in Plant Science, 13, 1053329. https://doi.org/10.3389/fpls.2022.1053329

    Project/Thesis language:
    English

    Contact:
    Please contact Dr. Nicolás Navarro if you are interested in discussing this topic.
  • Federated Fine-Tuning of Large Language Models with Heterogeneous Low-Rank Adaptations (Dr. Marco Fisichella)
    This thesis investigates the intersection of federated learning and parameter-efficient fine-tuning of Large Language Models (LLMs), with a focus on Low-Rank Adaptation (LoRA) techniques. The goal is to develop and evaluate strategies for fine-tuning LLMs across decentralized clients, each using their own local LoRA modules tailored to their data distributions.

    ## The central research questions are: ##
    1. How can clients collaboratively fine-tune a shared LLM backbone using local, heterogeneous LoRA modules without sharing raw data?
    2. How can we effectively aggregate model updates in the presence of statistical heterogeneity across clients?
    3. What are the privacy, communication, and performance trade-offs of federated LoRA-based fine-tuning?

    The thesis will build upon recent work that shows it is possible to train LLMs in federated environments by exchanging only adapter weights. This project will extend that idea by exploring heterogeneous LoRA configurations—i.e., each client may choose its own rank, structure, or optimization setup—and study how such diversity affects convergence, model utility, and communication efficiency.

    ## Key components of the thesis: ##
    1. Implementation of federated fine-tuning protocols using LoRA and related adapter methods (e.g., QLoRA, AdaLoRA).
    2. Support for heterogeneous client-side LoRA configurations (e.g., different ranks, tasks, or target layers).
    3. Evaluation on benchmark NLP tasks (e.g., sentiment analysis, question answering) using common federated learning setups (e.g., LEAF, FedNLP).
    4. Investigation of aggregation strategies that accommodate non-iid client updates (e.g., FedAvg with normalization, FedProto, FedAdam).
    5. Optional exploration of privacy-preserving extensions (e.g., differential privacy, secure aggregation).

    ## Expected outcomes: ##
    1. A practical system that enables federated, privacy-conscious, and communication-efficient fine-tuning of LLMs.
    2. Empirical insights into the effects of heterogeneity in LoRA configurations across clients.
    3. A set of recommendations for scalable and modular federated LLM training pipelines.

    Requirements:
    Solid programming skills in Python.

    Experience with PyTorch and Hugging Face Transformers.

    Familiarity with basic concepts in machine learning, NLP, and distributed systems.

    Related Work:
    FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations.
    Link: https://arxiv.org/pdf/2409.05976

    Project/Thesis language:
    English

    Contact:
    Please contact Dr. Marco Fisichella if you are interested in discussing this topic.
  • Development of an Artificial Intelligence system for converting images into tactile representations (Prof. Dr. techn. Wolfgang Nejdl)
    The tactile interpretation of images requires the transformation of two-dimensional visual information into three-dimensional representations accessible through touch. This conversion presents significant challenges, particularly in the preservation of crucial expressive elements that in visual reality are highlighted through light and shadow.

    The project focuses on case studies of pictorial art; for example, works by Caravaggio, where chiaroscuro creates a true 'tactile map' through:
    - Anatomies highlighted by shadows (muscles, ribs, veins)
    - Movement-defining fabric folds
    - Depth of environments
    - Textures of objects (fruit, fabrics, metals)

    The objective of this thesis is to develop an AI system that overcomes current limitations in the automatic conversion of images into tactile representations, focusing on:
    - Recognition of elements that in visual reality are highlighted by light and shadow
    - Translation of these elements into appropriate depth maps
    - Preservation of key narrative elements
    - Optimisation of high relief rendering
    The project is being developed in parallel with tactile image production experts who will test the effectiveness of the developed solutions.

    The project offers the opportunity to:
    - Working on a concrete problem of cultural accessibility
    - Developing an innovative image interpretation system
    - Collaborating with experts in the field of tactile representations
    - Contributing to innovation in art accessibility

    Requirements:
    - Image processing
    - Interest in accessibility and art
    - Ability to interpret visual elements from a tactile perspective

    Project/Thesis language:
    English

    Contact:
    Please contact Prof. Dr. techn. Wolfgang Nejdl if you are interested in discussing this topic.