The design of a multipurpose 1 - 5.5 micrometers infrared camera (NSFCAM) for the NASA Infrared Telescope Facility (IRTF) on Mauna Kea, Hawaii, is described. The camera is built around the new 256 X 256 InSb array manufactured by Santa Barbara Research Center (SBRC) and incorporates a variety of observing modes to fulfill its role as a major facility instrument. These include three remotely-selectable image scales, a selection of fixed bandpass filters, R equals 50 - 100 spectral resolution circularly variable filters, a grism, coronographic masks, and a polarization imaging capability. Through the use of flexible array clocking schemes, driven by programmable digital signal processors (DSPs), we plan to implement several new operating modes, including real-time shift and add for image stabilization, and fast subarray readouts for occultations. Simultaneous optical and infrared imaging of the same field will be possible through the use of a cold dichroic beamsplitter. This feature is primarily intended for use with the IRTF tip-tilt image stabilization system currently being built. Given a suitable guide star, the camera should achieve near-diffraction limited imaging at 2 - 5 micrometers . In this paper we discuss the design of the optics, cryogenic, electronics and software needed to provide the camera with these capabilities.