You can disable the interface that is used to connect the device to the scanner. Make the restriction settings to restrict scanning other than via network.
You can also make settings on the scanner's control panel.
Memory Device: Settings > Basic Settings > USB Drive
PC Connection via USB: Settings > Basic Settings > PC Connection via USB
Access Web Config, and then select the Product Security tab > External Interface.
Select Disable on the functions you want to set.
Select Enable to remove the restriction.
Click OK.
Check that the disabled port cannot be used.