Did you format the drive on your Mac? If so, you probably used HFS+ for the file system format, which is great for your Mac, but is not readable on Windows (without additional software).
You probably want to format the drives as FAT 32 for use with Windows and your Mac. just remember that reformatting your drive will erase everything on it...