Ortiz Torres, Mauricio and Lange, Markus and Raulf, Arne Peter (2025) On Advancements of the Forward-Forward Algorithm. Helmholtz AI Conference 2025, 2025-06-03 - 2025-06-05, Messe Karlsruhe.
|
PDF
735kB |
Abstract
The Forward-Forward algorithm has evolved in machine learning research, tackling more complex tasks that mimic real-life applications. In the last years, it has been improved by several techniques to perform better than its original version, handling a challenging dataset like CIFAR10 without losing its flexibility and low memory usage. We have shown in our results that improvements are achieved through a combination of learnable embeddings, learning rate schedules, and independent block structures during training that lead to a 20% decrease in test error percentage.
| Item URL in elib: | https://elib.dlr.de/215925/ | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Document Type: | Conference or Workshop Item (Poster) | ||||||||||||||||
| Title: | On Advancements of the Forward-Forward Algorithm | ||||||||||||||||
| Authors: |
| ||||||||||||||||
| Date: | 2025 | ||||||||||||||||
| Refereed publication: | No | ||||||||||||||||
| Open Access: | Yes | ||||||||||||||||
| Gold Open Access: | No | ||||||||||||||||
| In SCOPUS: | No | ||||||||||||||||
| In ISI Web of Science: | No | ||||||||||||||||
| Status: | Accepted | ||||||||||||||||
| Keywords: | Forward-Forward algorithm, Lighter models, Deep learning, Model optimization | ||||||||||||||||
| Event Title: | Helmholtz AI Conference 2025 | ||||||||||||||||
| Event Location: | Messe Karlsruhe | ||||||||||||||||
| Event Type: | national Conference | ||||||||||||||||
| Event Start Date: | 3 June 2025 | ||||||||||||||||
| Event End Date: | 5 June 2025 | ||||||||||||||||
| HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||
| HGF - Program: | Transport | ||||||||||||||||
| HGF - Program Themes: | Road Transport | ||||||||||||||||
| DLR - Research area: | Transport | ||||||||||||||||
| DLR - Program: | V ST Straßenverkehr | ||||||||||||||||
| DLR - Research theme (Project): | V - SaiNSOR | ||||||||||||||||
| Location: | other | ||||||||||||||||
| Institutes and Institutions: | Institute for AI Safety and Security | ||||||||||||||||
| Deposited By: | Ortiz Torres, Mauricio | ||||||||||||||||
| Deposited On: | 19 Aug 2025 13:27 | ||||||||||||||||
| Last Modified: | 19 Aug 2025 13:27 |
Repository Staff Only: item control page