With the development of multi-platform and diversified audio-visual multimedia, new requirements and technical problems have been put forward for the automatic integration and matching of audio and visual. Studies showed that synaesthesia has a solid physiological and psychological basis. As the Chinese traditional culture, Chinese traditional music and Chinese painting are closely connected by the cultural background, aesthetic connotation, spatial consciousness and emotional expression. In this paper, the synaesthesia rule between Chinese traditional music aesthetics and the Chinese painting composition elements was found through the visual synaesthesia experiment, which was verified by the multi-perception experiment. It can provide support for audio-visual interactive aesthetics, audio-visual intelligent matching calculation and music visualization.