Today there is an increasing surge in Surface Plasmon based research and recent studies have shown that a wide range of plasmon-based optical elements and techniques have led to the development of a variety of active switches, passive waveguides, biosensors, lithography masks, to name just a few. The Terahertz (THz) frequency region of the electromagnetic spectrum is located between the traditional microwave spectrum and the optical frequencies, and offers a significant scientific and technological potential in many fields, such as in sensing, in imaging and in spectroscopy. Waveguiding in this intermediate spectral region is a major challenge. Amongst the various THz waveguides suggested, the metal-clad waveguides supporting surface plasmon modes waves and specifically hollow core structures, coated with insulating material are showing the greatest promise as low-loss waveguides for their use in active components and as well as passive waveguides. The H-field finite element method (FEM) based full-vector formulation is used to study the vectorial modal field properties and the complex propagation characteristics of Surface Plasmon modes of a hollow-core dielectric coated rectangular waveguide structure. Additionally, the finite difference time domain (FDTD) method is used to estimate the dispersion parameters and the propagation loss of the rectangular waveguide.