One of the greatest difficulties of dealing with medical images is their distinct characteristics, in terms of generation process and noise that requires different forms of treatment for visualization and processing. Besides that, medical images are only a compounding part of the patient’s history, which should be accessible for the user in an understandable way. Other factors that can be used to enhance the user capability and experience are: the computational power of the client machine; available knowledge about the case; if the access is local or remote and what kind of user is accessing the system (physician, nurse, administrator, etc...). These information compose the context of an application and should define its behavior during execution time. In this article, we present the architecture of a viewer that takes into account the contextual information that is present at the moment of execution. We also present a viewer of X-Ray Angiographic images that uses contextual information about the client's hardware and the kind of user to, if necessary, reduce the image size and hide demographic information of the patient. The proposed architecture is extensible, allowing the inclusion of new tools and viewers, being adaptive along time to the evolution of the medical systems.