File Transfers Between ShARC/Bessemer and MS Windows Workstations

 A number of freely available utilities exist for transferring files between Windows and Linux platforms.

We have successfully used the following file transfer utilities to/from ShARC/Bessemer:

  • WinsCP    : Easiest to install ( just an EXE file really! ).
  • MobaXterm: This terminal access tool which can also be used for file transfers.
  • filezilla      : Available for Linux, Mac and Windows platforms ( set PORT to 22 when accessing HPC )

Problems to be aware of when transfering files between Linux & Windows platforms

End of line marker problems with ASCII files:

 When transferring files between Windows and Linux platforms one important pit-fall to watch out for is the fact that the end of line characters are different in these platforms.Therefore human readable ASCII text files will not have the same binary representation. Most file-transfer clients automatically detect ASCII files and translate the end-of-line characters correctly. However, occasionally this may fail and you may end up with a file on ShARC/Bessemer which looks the same but can not be processed. The cure is to print such suspect files by using the -v option of the cat command on ShARC/Bessemer.
I.e. cat -v filename
If you get ^M at the end of the lines that indicates that the file did not transfer correctly. You could either transfer the file again using the ASCII mode of transfer or better still use the dos2unix command.
dos2unix file_to_be_converted

Hidden system files in Linux directories:

As a general rule, any Linux file or directory that starts with a dot [.] in its name is a hidden file and should not be deleted, renamed or edited without due consideration. Unfortunately most file transfer clients make these files visible thus making it easy to delete them by accident while using file transfer clients.