Not easy to do:
Pay for everything in cash. Don't use my regular cellphone, landline or e-mail account. Use an anonymizing service to mask my Web surfing. Stay away from government buildings and airports (too many surveillance cameras), and wear a hat and sunglasses to foil cameras I can't avoid. Don't use automatic toll lanes.
(Hat tip: kottke)