You can hide the button outside service times or if no operator is available. You'll find this option in your Widget Editor under Chat > Advanced. You can adjust your service-times under Chat > Service-times.
This short video explains the steps in detail: