A low-loss microstructure fiber is numerically investigated for convenient transmission of polarization maintaining terahertz (THz) waves. The dual-hole units (DHUs) are used inside the core of the kagome lattice microstructure to achieve high birefringence and low effective material loss (EML). It is demonstrated that by rotating the axis of orientation of the DHUs, it is possible to obtain low EML of
, low confinement loss of
, and high birefringence of 0.0354 at 0.85 THz. It is also reported that the transmission properties of the proposed microstructure fiber are varied with rotation angle, core diameter, and operating frequencies. Other guiding characteristics, such as single-mode propagation, power fraction, and dispersion, are also discussed thoroughly.