Commercially available silica-fiber-based and ultra-broadband supercontinuum (SC) sources are typically generated by pumping close to the zero-dispersion wavelength (ZDW) of a photonic crystal fiber (PCF), using high-power picosecond or nanosecond laser pulses. Despite the extremely broad bandwidths, such sources are characterized by large intensity fluctuations, limiting their performance for applications in imaging such as optical coherence tomography (OCT). An approach to eliminate the influence of noise sensitive effects is to use a so-called all-normal dispersion (ANDi) fiber, in which the dispersion is normal for all the wavelengths of interest. Pumping these types of fibers with short enough femtosecond pulses allows to suppress stimulated Raman scattering (SRS), which is known to be as noisy process as modulation instability (MI), and coherent SC is generated through self-phase modulation (SPM) and optical wave breaking (OWB). In this study, we show the importance of the pump laser and fiber parameters in the design of low-noise ANDi based SC sources, for application in OCT. We numerically investigate the pulse-to-pulse fluctuations of the SC, calculating the relative intensity noise (RIN) as a function of the pump pulse duration and fiber length. Furthermore, we experimentally demonstrate the role of the fiber length on the RIN of the ANDi SC, validating the results calculated numerically. In the end, we compare the RIN of a commercial SC source based on MI and the ANDi SC source developed here, which shows better noise performance when it is carefully designed.