Little known castle opens to the public