Focal Plane Array (FPA) detector has characteristics of low cost, operating at room temperature, compatibility with the silicon CMOS technology, and high detecting performance, therefore it becomes a hot spot in infrared (IR) or terahertz (THz) detect field recently. However, the tradition structure of micro-bolometer has the conflict of the pixel size and thermal performance. In order to improve the detecting performance of small pixel size bolometer, high fill factor and low thermal conductance design should be considered. In IR detecting, double layers structure is an efficient method to improve the absorption of micro-bolometer and reduce thermal conductance. The three-dimension model of small size micro-bolometer was built in this article. The thermal and mechanical characters of those models were simulated and optimized, and finally the double layer structure micro-bolometer was fabricated with multifarious semiconductor recipes on the readout integrated chip wafer. For THz detecting, to improve the detecting performance, different dimension THz detectors based on micro-bridge structure were designed and fabricated to get optimizing micro-bolometer parameters from the test results of membrane deformation. A nanostructured titanium thin film absorber is integrated in the micro-bridge structure of the VOx micro-bolometer to enhance the absorption of THz radiation. Continuous-wave THz detection and imaging are demonstrated with a 2.52 THz far infrared CO2 laser and fabricated 320×240 vanadium oxide micro-bolometer focal plane array with optimized cell structure. With this detecting system, THz imaging of metal concealed in wiping cloth and envelope is demonstrated.