The yobs damaged displays, stole containers, and urinated in the nearby bus shelter overnight on Thursday.
Fortunately, after the displays had already been judged by Yorkshire In Bloom judges..
The displays are supported by donations from local businesses and are set up by members of Ruswarp Garden Society.
Its spokeswoman Julie Harrison said: "It's only the second year we've done it and local volunteers put a lot of time and effort into it.
"I don't think local people will have done it and it can't have been youngsters because the big plastic tub that was stolen would be too heavy for them to move.
"Everyone said how lovely it was but we aren't going to give up only next year we'll try to make the displays more vandal-proof."
In addition to the theft of the tub, the vandals pulled out flower displays at the rail station and stole or damaged containers on a bank just outside the main part of the village.
Volunteers have helped to transform the village by renovating the toilets clearing the trods cleared of litter and dog faeces and many areas planted with flowers and shrubs.
Susan Davies, chairman of Whitby in Bloom, said: "People who destroy the hard work of others and care only for their own benefit rarely prosper and flourish.
"I am very confident that those who did this will not have any luck until they make recompense. If you see a tub similar to the one in this photograph or know who did this, watch carefully justice will be done."
The thefts and damage have been reported to the police, who are investigating.