The Great Yarmouth Borough Council has been threatened with a judicial review by the Residential Landlords Association (RLA).