Data processing statements
Tuesday, February 22, 2011
3:27 PM
Simple data processing statements
FILTER-BY: keep only tuples satisfying some criteria.
FOREACH-GENERATE: do something with each tuple.
DISTINCT: eliminate duplicate tuples. 
ORDER: sort things into an order. 
LIMIT: only return n things where n is small. 
SAMPLE: randomly sample a subset!
SPLIT: put tuples into different datasets.
UNION: combine tuples from different datasets. 