Thank you both for the replies.
I can't verify that because I have no access to the router. It's managed by ISP and I can't even establish a connection to the interface. It refuses connection on both 80 and 443 ports. Packet analysis in Wireshark revealed that the router just replies with RST,ACK TCP packet so it seems this was blocked off in the router.
But I have physical access to the router and I'm going to check the model of the device and see whether it offers Wi-fi connectivity or not. I guess that if it has Wi-fi capability, it is possible this was activated by the ISP remotely.
No, I have only single device and I have my Wi-fi disabled. I don't think these are "randomly generated devices" based on my changing dynamic MAC address since these are completely different devices with their own names that are quite specific (non-random) such as Martin's phone etc....