Staff have been removed from the Dolphin centre over safety fears after unstable concrete was found in part of the building’s structure.