Calendar25 December 2024

Publication: Learning Multi-Reference Frame Skills from Demonstration with Task-Parameterized Gaussian Processes Publication: Learning Multi-Reference Frame Skills from Demonstration with Task-Parameterized Gaussian Processes

A central challenge in Learning from Demonstration is to generate representations that are adaptable and can generalize to unseen situations. In this work, EMERGE partners from Delft University of Technology propose to learn such a representation without using task-specific heuristics within the context of multi-reference frame skill learning by superimposing local skills in the global frame. Local policies are first learned by fitting the relative skills with respect to each frame using Gaussian Processes (GPs).

Then, another GP, which determines the relevance of each frame for every time step, is trained in a self-supervised manner from a different batch of demonstrations. The uncertainty quantification capability of GPs is exploited to stabilize the local policies and to train the frame relevance in a fully Bayesian way. The authors validate the method through a dataset of multi-frame tasks generated in simulation and on real-world experiments with a robotic manipulation pick-and-place re-shelving task. They evaluate the performance of their method with two metrics: how close the generated trajectories get to each of the task goals and the deviation between these trajectories and test expert trajectories. According to both of these metrics, the proposed method consistently outperforms the state-of-the-art baseline, Task-Parameterised Gaussian Mixture Model (TPGMM).

Read the paper in the link below.