The Palace was built for Count Jan Klemens Branicki, Great Crown Hetman and patron of art and science, raised in the French milieu of the Polish aristocracy, who transformed a previous house into the suitably magnificent residence of a great Polish noble, a rival to Wilanów Palace, making a start in 1726. He also laid out the central part of the town of Bialystok, not a large place in the 18th century, with its triangular market. of the Branicki Palace The original wooden manor of the Raczkowicz family that occupied the site was transformed in the 16th century into a brick two-storey castle for Piotr Wiesiołowski the Younger. The architect was Hiob Bretfus, who constructed the a gothic-renaissance structure with a moat and earth ramparts. Shortly after the property was inherited by Stefan Mikołaj Branicki he commissioned the transformation of the castle into a baroque mansion. The structure was thoroughly reconstructed during 1691–1697 by Tylman Gamerski, including one of the towers adapted to a staircase. During the subsequent reconstruction, the side outbuildings were enhanced, the Ionic colonnade above the main entrance was erected and the whole structure was adorned with sculptures. Further expansion of the palace was conducted by Jan Klemens Branicki and his wife Izabella Poniatowska. Starting in 1728 the reconstruction of the palace was directed by Johann Sigmund Deybel. Under his supervision, the structure was enhanced, the tympanum and domes on the towers were added. Deybel is also the author of the main façade. The existing pavilions and outbuildings were merged with the main building according to French model to form wings surrounding a horseshoe court - the courtyard of honour, which was closed with a gate built in 1758 by Jan Henryk Klemm. Among notable architects employed in reconstruction was Pierre Ricaud de Tirregaille. After the death of Deybel, in the years 1750–1771, the rebuilding of the palace was supervised by Jakub Fontana, who was an author of the palace's vestibule, rococo interiors and the staircase with statues by Jan Chrysostom Redler. The fence between the initial and honor courtyard was adorned in 1757 with two monumental sculptures by Redler - Hercules fighting the dragon and Hercules fighting the hydra. Interior decorations were conducted by artists such as Szymon Czechowicz, Ludwik Marteau, Augustyn Mirys, Jean-Baptiste Pillement, fresco painters such as Georg Wilhelm Neunhertz and Antoni Herliczka and stucco decorators Samuel Contesse and Antoni Vogt.
A straight avenue centered on the palace passes across the river on a three-arched bridge across the river, which is confined with deep stone embankment walling, to the large enclosed paved forecourt. The central block has two storeys upon a high arcaded basement story, with a pedimented central block displaying Branicki's coat-of-arms and end pavilions that have squared domes in two tiers. The roofline is an Italianate balustrade that masks a low attic story, and the heroic sculptural group of Atlas crowning all. Surrounding the Palace are the grounds. The garden front has a terrace raised on columns, which forms a podium for viewing the parterre in the French taste with a main central allée and French sphinxes, and a later "English garden," in the naturalistic taste associated with the English park, surrounding the grounds. The central axis continues to a guest pavilion. Other outbuildings include the Arsenal, Orangery and Italian and Tuscan Pavilions.