Seed size, interior abnormal and damage of the tomato seeds will affect the germination. The purpose of this paper was to study the relationship between the internal morphology, seed size and seed germination of tomato. The preprocessing algorithm of X-ray image of tomato seeds was studied, and the internal structure characteristics of tomato seeds were extracted by image processing algorithm. By developing the image processing software, the cavity area between embryo and endosperm and the whole seed zone were determined. According to the difference of area of embryo and endosperm and Internal structural condition, seeds were divided into six categories, Respectively for three kinds of tomato seed germination test, the relationship between seed vigor and seed size , internal free cavity was explored through germination experiment. Through seedling evaluation test found that X-ray image analysis provide a perfect view of the inside part of the seed and seed morphology research methods. The larger the area of the endosperm and the embryo, the greater the probability of healthy seedlings sprout from the same size seeds. Mechanical damage adversely effects on seed germination, deterioration of tissue prone to produce week seedlings and abnormal seedlings.