Linked List : Three FOSS Tools to work with CSVs
If you work with Data, you can't escape working with CSVs. It's a universally accepted data format for sharing the data. I use the following tools to wrangle with it.
csvkit is a suite of command-line tools for converting to and working with CSV, the king of tabular file formats.csvkit
Written in Python, csvkit is a FOSS set of command-line tools. The toolkit includes CLIs for cutting, joining, importing (from excel, JSON), exporting(convert into other formats), inquiring, searching, sorting. They are all pipe-able.
They also include power tools where you can query CSV like SQL by importing into SQLite. You can also perform joins and unions on CSVs without importing them into SQLite.
JSON to CSV
These days more and more datasets are published as JSON. It's a handy format online. Offline when someone is trying to explore the data, it's not that useful. Mainly because there are not many easy JSON exploring tools, and it's meant for developers. A table format like CSV is more intuitive. So often, many convert JSON they obtained into CSV to play with data. JSON to CSV Converter is a simple FOSS online tool that for moderately sized JSON file. It's effortless to use.
If you are using a large JSON file, you can use our favorite tool-set csvkit. It can convert from JSON o CSV, for example, to convert icmr_testing_status.json from datameet/covid19 dataset; you can run
in2csv icmr_testing_status.json -f json -k rows
Simple command-line utility to convert CSV files to searchable and sortable HTML table. Supports large datasets and horizontal scrolling for large number of columns.CSVtoTable
So what are your favorite CSV tools?
You can subscribe to my blog using RSS Feed. But if you are the person who loves getting email, then you can join my readers by signing up.