Built to transcend its function by the quality of its forms and expression, the Dome is still standing in much of its original shape and with a good portion of its original decoration. Its wooden gilt dome, which is approximately 20 meters in diameter, rises to a height of some 30 meters above the surrounding stone-paved platform. It is supported by a circular arcade of four piers and twelve columns. Surrounding this circle is an octagonal arcade of eight piers and sixteen columns, which help support the dome. The outer wall repeats this octagon, each of the eight sides being about 18 meters wide and 8 meters high. Both the dome and the exterior walls contain many windows.

Extensive decoration from a variety of periods, including mosaics, painted wood, marble, multi-colored tiles, carpets, and carved stone, covers most of the exterior and interior of the building. Many of the 45,000 blue and gold exterior tiles were installed under Suleiman the Magnificent in the 1500s. Inside, 1,280 square meters of elaborate mosaics cover the walls that enshrine the mystical rock under the dome. The intricate patterns and geometric shapes of the mosaics replace figurative art since, according to Muslim belief, it would be impossible to represent Allah in any figurative form.

According to tradition, Muhammad first selected Jerusalem as the qibla, the direction the faithful should face during prayer. Later, the prophet redirected his followers to face the city of Mecca when praying, to symbolize Islam's independence from the other monotheistic religions that had chosen Jerusalem as their most holy city. In the late seventh century, however, Chaliph Abd El-Malik wanted to discourage his followers from making the pilgrimage to Mecca because he feared that they might fall under the influence of one of his Muslim rivals. He, therefore, constructed the Dome in the hopes of establishing Jerusalem as the major Muslim pilgrimage destination, so that he could keep his followers and attract new ones.