Python Packages I use

Package	Category	Description
Arrow	Util, Data	Arrow is a Python library that offers a sensible, human-friendly approach to creating, manipulating, formatting and converting dates, times, and timestamps.
couchdbkit	NoSQL, CouchDB	Couchdbkit goal is to provide a framework for your Python application to access and manage Couchdb.
Dask	Data	Dask is a flexible parallel computing library for analytics.
requests	Web	Requests is an Apache2 Licensed HTTP library, written in Python, for human beings.
Tablib	Util, Data	Tablib is an MIT Licensed format-agnostic tabular dataset library, written in Python. It allows you to import, export, and manipulate tabular data sets. Advanced features include, segregation, dynamic columns, tags & filtering, and seamless format import & export.
GeoViews	Maps, Visualization	GeoViews is a Python library that makes it easy to explore and visualize geographical, meteorological, and oceanographic datasets, such as those used in weather, climate, and remote sensing research.
matplotlib	Visualization	matplotlib is a python 2D plotting library which produces publication quality figures in a variety of hardcopy formats and interactive
mongoframes	NoSQL, Database	MongoFrames - a fast unobtrusive MongoDB ODM for Python
Pandas	Data	pandas is an open source, BSD-licensed library providing high-performance, easy-to-use data structures and data analysis tools for the Python programming language.
pyquery	Scraping, Web	pyquery allows you to make jquery queries on xml/html documents. The API is as much as possible the similar to jquery. pyquery uses lxml for fast xml and html manipulation.
Eve	REST	Eve is an open source Python REST API framework designed for human beings. It allows to effortlessly build and deploy highly customizable, fully featured RESTful Web Services. Eve is powered by Flask, Redis, Cerberus, Events and offers support for both MongoDB and SQL backends.
Scrapy	Scraping	An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
walrus	NoSQL, Database	The purpose of walrus is to make working with Redis in Python a little easier by wrapping rich objects in Pythonic containers. Containers for the Redis object types Hash, List, Set, ZSet, HyperLogLog as well as a custom Array type. Cache implementation that exposes several decorators for caching function calls. Lock implementation that can also be used as a context manager or decorator.Model layer that support persisting structured information and performing queries using secondary indexes.
BeautifulSoup	Scraping	BeautifulSoup is the best api available to scrape the web pages.
Fabric	DevOps	Fabric provides operations for running local or remote shell commands (normally or via sudo) and uploading/downloading files, as well as auxiliary functionality such as prompting the running user for input, or aborting execution. Can be used for deployments, automating server tasks etc.
mkdocs	Documentation	MkDocs is a fast, simple and static site generator that's geared towards building project documentation. Documentation source files are written in Markdown, and configured with a single YAML configuration file. Can be styled using MkDocs, Read the Docs, Bootsrap. Also helps automated deploying to s3, FTP, Pypi and GH.
PyFunctional	Programming	Python library for functional programming with collections in a data pipeline style
Scapy	Network, Web	Scapy is a Python program that enables the user to send, sniff and dissect and forge network packets. This capability allows construction of tools that can probe, scan or attack networks. In other words, Scapy is a powerful interactive packet manipulation program. It is able to forge or decode packets of a wide number of protocols, send them on the wire, capture them, match requests and replies, and much more. Scapy can easily handle most classical tasks like scanning, tracerouting, probing, unit tests, attacks or network discovery. It can replace hping, arpspoof, arp-sk, arping, p0f and even some parts of Nmap, tcpdump, and tshark).
dataset	Database	dataset provides an option to access DB like a JSON file or NoSQL store. Also provides a CLI tool datafreeze to export (freeze) tables into a JSON or CSV as per the defnition provided using a YAML.
dryscrape	Scraping	dryscrape is a lightweight web scraping library for Python. It uses a headless Webkit instance to evaluate Javascript on the visited pages. This enables painless scraping of plain web pages as well as Javascript-heavy “Web 2.0” applications like Facebook.
Flask	Web	Flask is a micro web framework written in Python. It's light, simple to use and easy to learn. Can build really big apps with this small framework.
folium	Maps	Folium makes it easy to visualize data that’s been manipulated in Python on an interactive Leaflet map. It enables both the binding of data to a map for choropleth visualizations as well as passing Vincent/Vega visualizations as markers on the map.
cookiecutter	Setup	A command-line utility that creates projects from cookiecutters (project templates). Its useful to share the project templates.
Gooey	GUI	Turn (almost) any Python command line program into a full GUI application with one line
Ray Framework	API	Ray is a framework that helps you to deliver well-designed software without been stuck in your framework. Ray it's a ready to production framework that contains a uWSGI server ready to be used on production environment.With Ray you can develop powerful REST APIs in a simple way and have the core of your application not coupled with the framework.
Records	Database	Records is a very simple, but powerful, library for making raw SQL queries to most relational databases.
simplify.py	Maps	Polyline simplification dramatically reduces the number of points in a polyline while retaining its shape, giving a huge performance boost when processing it and also reducing visual noise.
Picotui	UI, MicroPython	Lightweight, pure-Python Text User Interface widget toolkit with minimal dependencies. Dedicated to MicroPython.
motorway	Data	Motorway is a real-time data pipeline, much like Apache Storm - but made in Python :-)
meza	Data	Meza is a dta processing toolkit. excels at reading/writing large files, and can process 10+ file types. Read/write csvtsv, xls/xlsx, mdb/dbf/sqlite, json/geojosn, html/yml etc Also, meza is better suited for ETL, or processing evented / streaming data
transitions	State Machine, Data	A lightweight, object-oriented state machine implementation in Python. Compatible with Python 2.7+ and 3.0+.
ua-parser	Web	Browser's user agent string parser.
Gunicorn	Web	Gunicorn 'Green Unicorn' is a Python WSGI HTTP Server for UNIX. It's a pre-fork worker model. The Gunicorn server is broadly compatible with various web frameworks, simply implemented, light on server resources, and fairly speedy.
fabulous	CLI	Fabulous is a Python library (and command line tools) designed to make the output of terminal applications look fabulous. Fabulous allows you to print colors, images, and stylized text to the console (without curses.) Fabulous also offers features to improve the usability of Python’s standard logging system.
Jinja2	Web, Util	Jinja is a fast, expressive, extensible templating engine. Special placeholders in the template allow writing code similar to Python syntax. Then the template is passed data to render the final document. Jinja’s philosophy is that while application logic belongs in Python if possible, it shouldn’t make the template designer’s job difficult by restricting functionality too much.
Pexpect	DevOps, Automation	Pexpect is a pure Python module for spawning child applications; controlling them; and responding to expected patterns in their output. Pexpect works like Don Libes’ Expect. Pexpect allows your script to spawn a child application and control it as if a human were typing commands. Pexpect can be used for automating interactive applications such as ssh, ftp, passwd, telnet, etc. It can be used to a automate setup scripts for duplicating software package installations on different servers. It can be used for automated software testing.
EasyGUI	GUI	EasyGUI is a module for very simple, very easy GUI programming in Python. EasyGUI is different from other GUI generators in that EasyGUI is NOT event-driven. Instead, all GUI interactions are invoked by simple function calls.
pyweb	Web	pywb is a python implementation of web archival replay tools, sometimes also known as ‘Wayback Machine’. pywb allows high-quality replay (browsing) of archived web data stored in standardized ARC and WARC, and it can also serve as a customizable rewriting proxy to live web content. The replay system is designed to accurately replay complex dynamic sites, including video and audio content and sites with complex JavaScript.
JobLib	Batch	Joblib is a set of tools to provide lightweight pipelining in Python. In particular, joblib offers, transparent disk-caching of the output values and lazy re-evaluation (memoize pattern), easy simple parallel computing, logging and tracing of the execution.
PyEnchant	Util	PyEnchant is a spellchecking library for Python, based on the excellent Enchant library.
robobrowser	Scraping, Testing	RoboBrowser is a simple, Pythonic library for browsing the web without a standalone web browser. RoboBrowser can fetch a page, click on links and buttons, and fill out and submit forms. If you need to interact with web services that don’t have APIs, RoboBrowser can help.
toyplot	Visualization	Simple, Clean but great plotting library. You can export the plots into HTML, Images etc
wrapt	Decorator	A Python module for decorators, wrappers and monkey patching. The aim of the wrapt module is to provide a transparent object proxy for Python, which can be used as the basis for the construction of function wrappers and decorator functions.
SQLAlchemy	Database	SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL. It provides a full suite of well known enterprise-level persistence patterns, designed for efficient and high-performing database access, adapted into a simple and Pythonic domain language.