Choosing the right learning rate and possibly adjusting it during training is critical for the model optimization.
The following blog gives good guidelines on how to set the learning parameters:
{% embed url="https://towardsdatascience.com/estimating-optimal-learning-rate-for-a-deep-neural-network-ce32f2556ce0" %}