Curriculum Learning
Обучение по плану (так наверное можно перевести). Вроде достаточно очевидная вещь, особенно в ситуации, когда плохой ландшафт не позволяет найти глобальный минимум, просто выбирая сэмплы в случайном порядке и спускаясь градиентом:
https://www.google.ru/?gws_rd=ssl#newwindow=1&q=curriculum+learning+bengio
The basic idea is to start small, learn easier aspects of the task or easier sub-tasks, and then gradually increase the difficulty level. The experimental results and discussion presented by Elman (1993) suggested that successful learning of grammatical structure depends, not on innate knowledge of grammar, but on starting with a limited architecture that is at first quite restricted in complexity, but then expands its resources gradually as it learns.
И еще там же:
... Introducing Gradually More Difficult Examples Speeds-up Online Training ...
см. также Language Acquisition in the Absence of Explicit Negative Evidence: How Important is Starting Small (http://tedlab.mit.edu/~dr/Papers/RohdePlaut99.pdf)
https://www.google.ru/?gws_rd=ssl#newwindow=1&q=curriculum+learning+bengio
The basic idea is to start small, learn easier aspects of the task or easier sub-tasks, and then gradually increase the difficulty level. The experimental results and discussion presented by Elman (1993) suggested that successful learning of grammatical structure depends, not on innate knowledge of grammar, but on starting with a limited architecture that is at first quite restricted in complexity, but then expands its resources gradually as it learns.
И еще там же:
... Introducing Gradually More Difficult Examples Speeds-up Online Training ...
см. также Language Acquisition in the Absence of Explicit Negative Evidence: How Important is Starting Small (http://tedlab.mit.edu/~dr/Papers/RohdePlaut99.pdf)