So, you should show gratitude with “thank you for the prompt response” when you’re surprised by the time taken to respond. It works best when the recipient gets back to you as quickly as possible.
It is polite to say “thank you for your reply.” It’s not rude and is highly effective in a formal email. It’s a professional way to show gratitude after someone gets back to you. It tends to work best when you’re.