Complete structure identification of complicate nonlinear system using extend Kalman filter (EKF) or unscented Kalman filter (UKF) may have the problems of divergence, huge computation and low estimation precision due to the large dimension of the extended state space for the system. In this article, a decentralized identification method of hysteretic system based on the joint EKF and UKF is proposed. The complete structure is divided into linear substructures and nonlinear substructures. The substructures are identified from the top to the bottom. For the linear substructure, EKF is used to identify the extended space including the displacements, velocities, stiffness and damping coefficients of the substructures, using the limited absolute accelerations and the identified interface force above the substructure. Similarly, for the nonlinear substructure, UKF is used to identify the extended space including the displacements, velocities, stiffness, damping coefficients and control parameters for the hysteretic Bouc-Wen model and the force at the interface of substructures. Finally a 10-story shear-type structure with multiple inter-story hysteresis is used for numerical simulation and is identified using the decentralized approach, and the identified results are compared with those using only EKF or UKF for the complete structure identification. The results show that the decentralized approach has the advantage of more stability, relative less computation and higher estimation precision.