Skip to content
PaperFren

Robot learning

Can a robot learn from its own lucky accidents?

Stewart TC, Kleinhans A, Mundy A, et al. · Frontiers in neurorobotics · 2016

Open access · cc by · source: Europe PMC

A neural robot controller learned new behaviours, like turning a particular way when facing a mirror, simply by being retrained on runs where it had happened to do the right thing.

Save to libraryView originalAsk PaperFrenStudy view

Study at a glance

Design
Computational / modelling — Spiking-network controller on SpiNNaker hardware driving a tracked robot in a T-maze, plus abstract simulations varying signal strength and number of positive examples.
N
No single N; robot tasks were trained from ten positive examples each, and simulation points were averaged over repeated random trials.
Population
A small mobile robot controlled by a neural network built with the Neural Engineering Framework, and simulated sensory signals.
Outcome
Similarity between network output and the desired action (normalised dot product); robot turning behaviour in a T-maze with and without a mirror.

Structured fields used in claim comparison tables when every cited study has a complete layer.

Key findings

In the idealised simulation, output matched the training example with a similarity of 0.99. With strong signals, a few examples were enough to generalise, while with weak signals the network latched onto chance correlations and improved only as examples accumulated, even when the signal was absent. On the real robot, ten positive examples were enough to make it turn left consistently, and to turn right when a mirror was present and left when it was not.

Methodology

The authors hand-built simple reflexes (drive forward, avoid walls, turn away from obstacles) as a spiking neural network running on low-power neuromorphic hardware. They let the robot wander a T-maze, kept the recordings of runs where it happened to do the desired thing, and trained new sensor-to-action connections to reproduce those runs. They also simulated an abstract version in which a weak or strong signal was buried in random sensory noise, varying how many positive examples were used.

Limitations

The robot results are demonstrations with plotted trajectories rather than systematic success rates across many tasks, environments or robots. The authors say it is not yet clear which real tasks provide strong enough sensory signals. The method uses only positive examples, with no punishment for wrong actions, and is not compared against standard reinforcement or imitation learning baselines.

How this study connects

Role on claims

Each row is a claim on a concept or method page where this paper supports, challenges, or qualifies the statement. Roles are hand-checked — not a model guess.

  • SupportsRobot learning from rewards, demonstrations and humansconcept

    Curiosity, inheritance and few-shot examples are viable but lightly tested.

    Alternative learning routes also work in constrained settings: inheriting learned controllers (Lamarckian evolution) produced faster simulated robots under small learning budgets, a curiosity-driven humanoid explored more evenly than random agents, and a neuromorphic robot learned to turn from ten positive examples.

    Evidence for the claim as stated.

Related papers in this topic

Same topic cluster — not a recommendation engine.