Gunmen were able to take a police station and a security services building in the eastern Ukrainian city of Sloviansk.
Ukraine's interior minister, Arsen Avakov said that special forces were called upon and will be used to expel the "terrorists" from the buildings, reports BBC News. Andrei Deshchytsia, interim foreign minister, also asked Moscow to halt its continuing "provocative" actions.
According to Reuters, pro-Russian forces now have four buildings under their control in the eastern Ukraine near the Russian borders.
The first two buildings, which are located in Luhansk and Donetsk, were seized at the beginning of last week. The forces then pleaded with Moscow to send peacekeeping forces into the Ukraine to protect them.
Kiev has accused Russia of being quietly involved in the forces as a continuing way to cause chaos in the neighboring country, and reeling from the loss of Crimea. Russian officials have continued to deny they have had any involvement.
The gunmen who seized the buildings in Sloviansk announced they want "to live comfortably, peacefully free from the junta in Kiev who have seized the country."
The mayor of the town even appeared on television in support of the pro-Russian forces.