Awk

data transformation

An old goody! For quick command line analysis of data.

The following examples were taken from the tldr page for awk:

Print the fifth column (a.k.a. field) in a space-separated file:

awk '{print $5}' filename

Print the second column of the lines containing “foo” in a space-separated file:

awk '/foo/ {print $2}' filename

Print the last column of each line in a file, using a comma (instead of space) as a field separator:

awk -F ',' '{print $NF}' filename

Sum the values in the first column of a file and print the total:

awk '{s+=$1} END {print s}' filename

Print every third line starting from the first line:

awk 'NR%3==1' filename

Print different values based on conditions:

awk '{if ($1 == "foo") print "Exact match foo"; else if ($1 ~ "bar") print "Partial match bar"; else print "Baz"}' filename

Print all lines where the 10th column value equals the specified value:

awk '($10 == value)'

Print all the lines which the 10th column value is between a min and a max:

awk '($10 >= min_value && $10 <= max_value)'