What is the maximum size of USB memory device or USB hard disk that can be used?

As long as the device supports FAT16, FAT32 or HFS+, there are no limits to the size within the format.