In-Context Interference In Chat-Based Large Language Models

Coleman, E.N., Hurtado, J., Lomonaco, V. (2024). In-Context Interference In Chat-Based Large Language Models. European Robotics Forum 2024. ERF 2024. Springer Proceedings in Advanced Robotics, vol 32. DOI: 10.1007/978-3-031-76424-0_21

Abstract: Large Language Models (LLMs) have transformed society, but modifying their internal knowledge remains challenging. Here, we focus on interference in in-context learning, examining how new knowledge affects performance in self-aware robots. We propose an evaluation benchmark based on the bAbI dataset to assess the robot’s ability to manage interference, maintain stability, ensure flexible information routing, and facilitate task performance. Addressing these challenges is crucial for improving LLMs’ effectiveness in developing self-aware robots.