Colorful semitransparent organic photovoltaic cells (OPVs) are increasing in demand due to their application in building-integrated photovoltaics. In general, the colors in OPVs have been determined by the absorption properties of the active material, requiring one to use different active materials to achieve distinct colors. However, such a strategy presents challenges in fabrication, costs and implementation as different processes are needed to produce differently colored OPVs. Moreover, the photovoltaic performance cannot stay uniform from different active materials in colored OPVs. In this work, we present a simple solution to such problems by incorporating transmissive Fabry-Perot-type color filters (CFs) as the electrode in an OPV employing one type of active material. From this modification, we achieve widely tunable colors covering the whole visible range with high spectral purity, peak transmission efficiencies surpassing 25% at the expense of charge generation that is only a fraction of that of an opaque OPV, and uniformity in device performance regardless of transmitted color. Because the CF is spatially removed from the charge generation and transport pathway, the optical characteristics are largely decoupled from the electronic characteristics. This provides one the freedom to explore creative designs without having to consider the electronic properties and uniformity in performance. Furthermore, integration of CFs into OPVs ensures the transmitted colors to be spectrally pure, bidirectional, and of high saturation represented by sub-100nm resonance widths, providing optical characteristics suitable for use in colorful power generating windows.