The castle was allegedly founded in the first half of the 13th century by Knight Blud of Bludov but, more likely, by his descendant Blud III – the predecessors of the Countsof Žerotín. Yet, the oldest documented owners of the castle were the Lords of Lipá, a powerful noble family from Bohemia. In 1346 Bludov obtained Lord Čeněk of Lipá, Highest Marshal of Bohemia and Moravia. The Lords of Lipá didn't resided in the castle but bestowed it, together with the surrounding estate, to lower nobles as the fief. Indebted Lord Čeněk of Lipá was forced to sell the castle in 1352 to John Henry, Margrave of Moravia. After his death, Bludov was inherited by his son, Margrave Prokop. During the period of possession of the castle by the margraves an extensive enlargement was done. The moat was extended around the whole castle and surrounded by a rampart. The inner castle was provided with a ward in the south-eastern part where was also newly situated main gate. On the northern side a vast fortification of the forecourt was built, surrounded by a moat with forward circular earthwork. On the northern and southern sides were erected fortifications to protect the castle from bombarding from the higher neighbouring hill. On the southern side were erected two forward log cabins, which shielded the castle from attacking and shelling from the south. At the turn of the 14th and 15th centuries the castle was often pawned, since 1397 it fell to the Lords of Kunštát. Smil of Kunštát used the castle as the base for raids into the surrounding area. Just at the beginning of the Hussite Revolution the castle passed in 1420 to royal hands. After the mid-15th century the castle was acquired by Moravian aristocratic family of Tunklové of Brníčko. Jiří Tunkl of Brníčko the Older was loyal to Hussite "heretic" King George of Poděbrady, for which reason his castles and estates were conquered and destroyed by the Hungarian royal army under the command of King Matthias Corvinus during the Bohemian–Hungarian War. When the Bludov estate was later sold to the Žerotín family, the castle was mentioned as already abandoned and ruined. During the following centuries the premises were gradually dismantled for building material; in the 19th century last remnants were used as a building material for newly paved road from Bludov to Šumperk, so just few structural elements like cellars and moats have been preserved until today.
