A hologram provides a scene similar to the real world, and it can be used to display a virtual scene because it can be simulated numerically. However, the simulation is a computationally extensive task. Therefore, we accelerate it by enhancing the detail driven method. The design of the original method allows us to reduce the number of samples and limit the variability of elements without restricting scene contents. The proposed enhancements neither limit the diffusiveness of a surface nor require a minimum distance between a scene and a hologram. The computation time is reduced approximately 5× in the case of a typical scene. Hence, the method is able to calculate a hologram of 4096×4096 samples from a scene of 800 triangles in about 3.1 h on a regular 2.4-GHz CPU without any special hardware. This shows flexibility of the method and indicates that the method is acceptable for practical use.