Owners of a historic downtown building that's listed as an endangered place still plan to tear down the structure.