In this study, the effect of the plastic deformation on the microscopic structure and the anisotropy of the elastic modulus in the cold-rolled steel sheet (SPCC) is investigated. Various uniaxial plastic strains (0%, 2.5%, 5%, 7.5%, and 10%) are applied to the annealed SPCC plates, then, the specimens for the tensile tests are cut out from them. The elastic moduli in the longitudinal direction and the transverse direction to the direction that are pre-strained are measured by the tensile tests. Cyclic tests are performed to investigate the effects of the internal friction caused by the movable dislocations in the elastic deformation. Also, the movable dislocations are quantified by the boundary tracking for TEM micrographs. In addition, the behaviors of the change of the elastic modulus in the solutionized and thermal aged aluminum alloy (A5052) are measured to investigate the effect on the movable dislocations with the amount of the depositions. As a result in SPCC, the elastic moduli of the 0° and 90° directions decrease more than 10% as 10% prestrain applied. On the other hand, the elastic modulus shows the recovery behavior after the strain aging and the annealing. The movable dislocation and the internal friction show a tendency to increase as the plastic strain increases. The marked anisotropy is not observed in the elastic modulus and the internal friction. The elastic modulus in A5052 with many and few depositions decreases similarly by the plastic deformation. From the above, the movable dislocations affect the elastic modulus strongly without depending on the deposition amount. Moreover, the elastic modulus recovers after the plastic deformation by reducing the effects of them with the strain aging and the heat treatment.