ELTE-SMARTER Research Group
The research group is engaged in model-driven machine learning, a new and rapidly evolving area of explainable artificial intelligence (XAI), which integrates mathematical and physical heuristics (e.g., sparsity, smoothness, dynamic characteristics) into the architectures, loss functions, or even the training data of machine learning algorithms. This approach helps reduce the heavy data dependency and complexity of deep learning, while making the decision-making mechanism of the trained models interpretable. The research outcomes are utilized in safety-critical applications, such as autonomous vehicle control, healthcare, intelligent transportation and energy systems, where, in addition to performance, the interpretability and transparency of decision-making are crucial.
Research group homepage: institute link
- Model-driven AI: we combine parametrized orthogonal projections, convex optimization techniques, and differential equations with AI models using different model-driven AI paradigms, i.e., variable projections, deep unfolding, and physics informed learning.
- Post-hoc XAI: Model-driven AI offers transparent decision-making, but may not align with domain expertise. For example, a mathematically explainable model might extract frequencies and statistics, yet be unclear to a cardiologist who relies on ECG morphology and timing for diagnosis. Therefore, we integrate model-based AI approaches with post-hoc interpretability analysis to offer valuable insights for practitioners and machine learning end users.
- Safety-critical applications: adopting model-based XAI methods in thermographic imaging for non-destructive testing, vehicle vibration analysis for brake disc deformation and bearing fault detection, multimodal biosignal analysis, such as EEG,
- ECG, and PPG processing, traffic load estimation and near-miss situation prediction in urban mobility, autonomous train control, and renewable energy forecasting.
- Edge hardware implementation: developing resource-efficient learning procedures that use less training data and computational power, fast algorithms for facilitating real-time processing and embedded AI solutions.
- Embedding physics-based priors, such as symmetries, and conservation laws, by hierarchical design of neural networks’ (NNs) architecture like graph NNs. Introducing learning biases using dynamical equations and soft penalty constraints in the loss.
- Converting iterative numerical algorithms (e.g., ADMM, FISTA) into neural networks, where each layer mimics an iteration with trainable parameters.
- Adapting post-hoc AI research methodologies, such as visualizations (heatmaps, t-SNE), case-based reasoning, evaluating feature attribution by Shapley values and integrated gradient methods.
- Dr. habil. Péter Kovács (research group leader, bibliography: MTMT)
- Dr. Tamás Dózsa, assistant professor
- Dr. Gergő Bognár, assistant professor
- Attila Miklós Ámon, EKÖP-KDP doctoral student (industrial partner: Siemens Mobility Hungary Ltd.)
- Gergő Galiger, EKÖP-KDP doctoral student (industrial partner: BKK, Department of Modelling and Data Analysis)
- BSc and MSc students
- 1 national grant (ELTE University Excellence Program EKA-KCS-24, No.: 2024/089-P253-1)
- 1 international grant (DAAD Programmes for Project-Related Personal Exchange 2024, No.: DAAD-2025-26-000009)
- 3 industrial projects in cooperation with Siemens Mobility Hungary Ltd., the Centre for Budapest Transport (BKK), Research Center for Non-Destructive Testing GmbH
- T. Dózsa, C. Böck, J. Meier, P. Kovács: Weighted Hermite variable projection networks for classifying visually evoked potentials, IEEE Transactions on Neural Networks and Learning Systems (2024) [DOI]
- E. Idrobo-Ávila, G. Bognár, D. Krefting, T. Penzel, P. Kovács, N. Spicher: Quantifying the suitability of biosignals acquired during surgery for multimodal analysis, IEEE Open Journal of Engineering in Medicine and Biology (2024) [DOI]
- T. Dózsa, V. Jurdana, B. S. Šegota, J. Volk, J. Radó, A. Soumelidis, P. Kovács: Road type classification using time-frequency representations of tire sensor signals, IEEE Access (2024) [DOI]
- T. Dózsa, P. Őri, M. Szabari, E. Simonyi, A. Soumelidis, I. Lakatos: Brake disc deformation detection using intuitive feature extraction and machine learning, Machines (2024) [DOI]
- P. Kovács, B. Lehner, G. Thummerer, G. Mayr, P. Burgholzer, M. Huemer: Surfing virtual waves to thermal tomography: from model- to deep learning-based reconstructions, IEEE Signal Processing Magazine, (2022) [DOI]
Dr. Péter Kovács: kovika@inf.elte.hu