The purpose of this paper is to determine the ripeness level and identify the variety of the Durian fruit through image processing using Principal Component Analysis (PCA) and Support Vector Machine (SVM) algorithms. The ripeness level is classified into three stages: unripe, ripe, and overripe. There are numerous varieties of durian available in the Philippines, and this study specifically uses Puyat, Arancillo, Cob, Davao Selection and UPLB Gold varieties. The study used 100 durian fruits, 80% of which were used for data training while the 20% were used for data testing. The study yields 95% overall accuracy and 5% misclassification rate.