I recommend you configure the DNS only specifically for your device (operating system), because, depending on the router, there might be some complications, which also depend on the DNS service used.
In other words, use something like
DNS Jumper on the specific device (operating system installation) in which you want to use the secure DNS service (DNS Jumper allows for seamless and easy DNS service configuration).
Like
@Kantry123 mentioned, configuring secure DNS on your router will indeed affect all devices connected to the router automatically, and as such there will be no need for manual configuration in every device.
However, when you configure the DNS service manually for every machine, you obviously have full control over which one of your devices is going to be using that DNS service.