The museum was created in 1801 with the purchase of the Cacault collection and was located in is actual Palais des Beaux-Arts since 1900.

In 2009, the architect Stanton Williams won an international competition to transform the museum with a modern extension to become the Grand Musée d'Art.