Yes, you can restrict access to specific payment methods for different customer groups using Magento 2 Customer Group Restrictions Extension. This ensures that only the relevant payment options are available to each segment of your customers.

Read this Extension's configuration guide to restrict access to certain payment methods.

Also, here is the useful resource to help.
How to Restrict Payment Method for Specific Customer Groups in Magento 2.