Any officer or employee duly designated by the director shall have access to any factory or establishment, the operator of which holds a permit from the director, for the purpose of ascertaining whether or not the conditions of the permit are being complied with, and denial of access for such inspection shall be ground for suspension of the permit until such access is freely given by the operator.