Police recovered a bomb-like object wrapped in a white bag and two litres of petrol from the premises of the shrine of Baul Samrat Fakir Lalon Shah at Chheuriya, Kushtia.
The suspicious object was spotted around 2am on Monday, said police.
A police bomb disposal team from Dhaka arrived at the site on Monday morning and examined the object.
Following the recovery of the bomb-like object and two litres of petrol, security was further tightened at the shrine and surrounding areas.
Additional police have been deployed at the shrine and nearby areas to prevent any untoward incident.
Officer-in-Charge of Kumarkhali Police Station Jamal Uddin said the miscreants might have placed the bomb-like object to create panic.