The multi-instance multi-label (MIML) learning is a learning framework where each example is described by a bag of instances and corresponding to a set of labels. In some studies, the algorithms are applied to natural scene image classification and have achieved satisfied performance. We design a MIML algorithm based on RBF neural network for the natural scene image classification. In the framework, we compare classification accuracy based on the existing definitions of bag distance: maximum Hausdorff, minimum Hausdorff and average Hausdorff. Although the accuracy of average Hausdorff bag distance is the highest, we find average Hausdorff bag distance to weaken the role of the minimum distance between the instances in the two bags. So we redefine the average Hausdorff bag distance by introducing an adaptive adjustment coefficient, and it can change according to the minimum distance between the instances in the two bags. Finally, the experimental results show that the enhanced algorithm has a better result than the original algorithm.