The clos network is one of the earliest multistage interconnection networks. Recently, it has been widely studied in parallel optical information processing systems, and there have been many efforts to develop this network. In this paper, a smart and compact Clos network, including Clos(2,3,2) and Clos(2,4,2), is proposed by using polarizing beam-splitters (PBS), phase spatial light modulators (PSLM), and mirrors. PBS features that are s-component (perpendicular to the incident plane) of the incident light beam is reflected, and the p-component (parallel to the incident plane) passes through it. According to switching logic, under control of external electrical signals, PSLM functions to control routing paths of the signal beams, i.e., the polarization of each optical signal is rotated or not rotated 90° by a programmable PSLM. This new type of configuration grants the features of less optical components, compact in structure, efficient in performance, and insensitive to polarization of signal beam. In addition, the straight, the exchange, and the broadcast functions of the basic switch element are implemented bidirectionally in free-space. Furthermore, the new optical experimental module of 2×3 and 2×4 optical switch is also presented by a cascading polarization-independent bidirectional 2×2 optical switch. Simultaneously, the routing state-table of 2×3 and 2×4 optical switch to perform all permutation output and nonblocking switch for the input signal beam, is achieved. Since the proposed optical setup consists of only optical polarization elements, it is compact in structure, and possesses a low energy loss, a high signal-to-ratio, and an available large number of optical channels. Finally, the discussions and the experimental results show that the Clos network proposed here should be helpful in the design of large-scale network matrix, and may be used in optical communication and optical information processing.