Tapered optical fibers can deliver guided light into and carry light out of micro/nanoscale systems with low loss and high spatial resolution, which makes them ideal tools in integrated photonics and microfluidics. Special geometries of tapered fibers are desired for probing monolithic devices in plane as well as optical manipulation of micro particles in fluids. However, for many specially shaped tapered fibers, it remains a challenge to fabricate them in a straightforward, controllable, and repeatable way. In this work, we fabricated and characterized two special geometries of tapered optical fibers, namely fiber loops and helices, that could be switched between one and the other. The fiber loops in this work are distinct from previous ones in terms of their superior mechanical stability and high optical quality factors in air, thanks to a post-annealing process. We experimentally measured an intrinsic optical quality factor of 32,500 and a finesse of 137 from a fiber loop. A fiber helix was used to characterize a monolithic cavity optomechanical device. Moreover, a microfluidic "roller coaster" was demonstrated, where microscale particles in water were optically trapped and transported by a fiber helix. Tapered fiber loops and helices can find various applications ranging from on-the-fly characterization of integrated photonic devices to particle manipulation and sorting in microfluidics.