Hadoop Linux Commands Reference
File/Directory Basics -
| Command | → | Description |
|---|---|---|
| mkdir | → | Making Directory |
| cd | → | Change the Directory |
| clear | → | Clear Commands |
| pwd | → | Present Working Directory |
| date | → | Display Date |
| who am I | → | Display the user name |
| rm | → | Delete files |
| ls | → | list files |
| cp | → | Copy files CP <source-path> <destination-path> |
| mv | → | Renaming the files mv <source-path> <renaming-path> |
| ln | → | Link files |
| rmdir | → | Remove directory |
File Viewing Commands -
| Command | → | Description |
|---|---|---|
| cat | → | View files |
| less | → | page through files |
| head | → | view file from beginning (1st 10 records will be displayed) |
| tail | → | view file ending (last 10 records will be displayed) |
| nl | → | displays number of lines |
| od | → | view the binary data |
| xxd | → | view hexa binary data |
| gv | → | view post script/pdf files |
| xdvi | → | view text dvi files |
File Creation & Editing -
| Command | → | Description |
|---|---|---|
| emacs | → | text editor |
| pico | → | text editor |
| vi | → | text editor |
| umask | → | set default file protections |
| abiword | → | edit word documents |
| gnumeric | → | edit excel documents |
File properties -
| Command | → | Description |
|---|---|---|
| stat | → | display file attributes |
| wc | → | count bytes/words/lines |
| du | → | measure disk usage |
| file | → | identify file types |
| touch | → | change the file stamps |
| chown | → | change the file owner |
| chgrp | → | change the file group |
| chmod | → | change file protections |
| chattr | → | change advance file attributes |
| lsattr | → | list advance file attributes |
File Searching -
| Command | → | Description |
|---|---|---|
| find | → | locate files |
| s locate | → | locate files via index |
| which | → | locate commands |
| whereis | → | locate standard files |
File text manipulation -
| Command | → | Description |
|---|---|---|
| grep | → | search text for matching lines |
| cut | → | extract columns |
| paste | → | append columns |
| tr | → | translate characters |
| sort | → | sort lines |
| uniq | → | locate identical lines |
| tee | → | copy stdin to a file and to stdout simultaneously |
File compression -
| Command | → | Description |
|---|---|---|
| gzip | → | compress files (GN Zip) |
| compress | → | compress files(unix) |
| bzip2 | → | compress files(bzip2) |
| zip | → | compress files(windows zip) |
File comparison -
| Command | → | Description |
|---|---|---|
| diff | → | compare files line by line |
| comm | → | compare sorted files |
| cmp | → | compare files byte by byte |
| md5sum | → | compute check sums |
Spelling operations -
| Command | → | Description |
|---|---|---|
| look | → | lookup spelling |
| aspell | → | check spelling interactively |
| spell | → | check spelling in batch |
Disk and file systems -
| Command | → | Description |
|---|---|---|
| df | → | show free space |
| mount | → | make a disk available |
| fsck | → | check the disk for errors |
| sync | → | flush disk caches |
Backups and remote storage -
| Command | → | Description |
|---|---|---|
| mt | → | control a tape device |
| dump | → | backup a disk |
| restore | → | restore a dump |
| tar | → | read/write tape archives |
| cd record | → | burn a cd |
| rsync | → | mirror a set of files |
Printing -
| Command | → | Description |
|---|---|---|
| lpr | → | print files |
| lpq | → | view print queue |
| lprm | → | remove print jobs |
Audio & video -
| Command | → | Description |
|---|---|---|
| grip | → | play CDs & ripmp3 |
| xmms | → | Play Audi files |
Processes -
| Command | → | Description |
|---|---|---|
| ps | → | List all processes |
| w | → | List user’s processes |
| uptime | → | view the system load |
| top | → | monitor processes |
| xload | → | monitor system load |
| free | → | display free memory |
| kill | → | terminate process |
| nice | → | Set process priorities |
| renice | → | change process priorities |
Scheduling jobs -
| Command | → | Description |
|---|---|---|
| sleep | → | wait for some time |
| watch | → | run programs at set intervals |
| at | → | schedule a job |
| crontab | → | Schedule repeated jobs |
Hosts -
| Command | → | Description |
|---|---|---|
| uname | → | print the system information |
| hostname | → | print the system’s hostname |
| ifconfig | → | set/display network information |
| host | → | lookup DNS |
| who is | → | lookup domain registrants. |
| Ping | → | check if the host is reachable |
| Trace route | → | view network path to host |
Networking -
| Command | → | Description |
|---|---|---|
| Ssh | → | securely login into remote hosts |
| telnet | → | log into remote hosts |
| scp | → | securely copy files between hosts |
| sftp | → | securely copy files between hosts |
| ftp | → | copy the files between shots |
| evolution | → | GUI email client |
| mutt | → | text-based email client |
| → | minimal email client | |
| Mozilla | → | web browser |
| Lynx | → | text only web browser |
| Wget | → | retrieve web pages to disk |
| Srln | → | read UseNet news |
| Gaim | → | instant messaging/IRC |
| Talk | → | linux/unix chat |
| Write | → | send mesgs to terminal |
| Mesg | → | prohibit talk/write |