The flat plate project is a pilot study for the creation of intelligent robotic systems. In these systems vision robotics and artificial intelligence aspects have to be combined. The final goal is to give a robot the capacity to learn to solve the problem represented by a toy for a two year old child. This toy is called the ''Holle Bol'' in Dutch. It consists of a plastic ball with differently shaped holes in it and a number of small blocks that must be put into the corresponding holes. To investigate the problems associated with this project first a simplification of the problem has been studied. In this case a flat plate with differently shaped holes is used. The paper describes the results of the flat plate pilot project.