The Ministry of Public Administration issued a notification in this regard on Monday.
The decision came a day after Environment Adviser Syeda Rizwana Hasan publicly alleged that the local administration was complicit in the illegal stone extraction and promised swift action.
Meanwhile, the government has appointed Md. Sarwar Alam as the new Deputy Commissioner of Sylhet.
The ministry issued a separate notification on the same day confirming Sarwar's appointment, reports UNB.
He is a deputy secretary-level officer and currently serves as Private Secretary to Law Adviser Asif Nazrul.