It is a universal truth that textsmiths work with data formats. Yet formats are attempts to impose structure on messy reality, but no format can decide what the right structure is for you. So in this post, we are going to look at what data cleaning is.

These commands work beautifully for simple CSV files, but they are not full CSV parsers. Quoted fields containing commas, embedded newlines, escaped quotes, and similar cases are where awk needs care—or where a dedicated CSV parser becomes the right tool.

In the previous post, we looked at the table. But as textsmiths, we need to look at something that is so basic, something that we work with everyday, namely the comma-separated value file.

If ever there is one object that one has to understand in data analysis even before data collection, it is a table. A table is an organizing object of data.