Python Packages I use

PackageCategoryDescription
PyEnchantPyEnchant is a spellchecking library for Python, based on the excellent Enchant library.
Ray FrameworkAPIRay is a framework that helps you to deliver well-designed software without been stuck in your framework. Ray it's a ready to production framework that contains a uWSGI server ready to be used on production environment.With Ray you can develop powerful REST APIs in a simple way and have the core of your application not coupled with the framework.

JobLibBatchJoblib is a set of tools to provide lightweight pipelining in Python. In particular, joblib offers, transparent disk-caching of the output values and lazy re-evaluation (memoize pattern), easy simple parallel computing, logging and tracing of the execution.
fabulousCLIFabulous is a Python library (and command line tools) designed to make the output of terminal applications look fabulous. Fabulous allows you to print colors, images, and stylized text to the console (without curses.) Fabulous also offers features to improve the usability of Python’s standard logging system.
motorwayDataMotorway is a real-time data pipeline, much like Apache Storm - but made in Python :-)
mezaDataMeza is a dta processing toolkit. excels at reading/writing large files, and can process 10+ file types. Read/write csvtsv, xls/xlsx, mdb/dbf/sqlite, json/geojosn, html/yml etc Also, meza is better suited for ETL, or processing evented / streaming data
DaskDataDask is a flexible parallel computing library for analytics.
PandasDatapandas is an open source, BSD-licensed library providing high-performance, easy-to-use data structures and data analysis tools for the Python programming language.
datasetDatabasedataset provides an option to access DB like a JSON file or NoSQL store. Also provides a CLI tool datafreeze to export (freeze) tables into a JSON or CSV as per the defnition provided using a YAML.
wraptDecoratorA Python module for decorators, wrappers and monkey patching. The aim of the wrapt module is to provide a transparent object proxy for Python, which can be used as the basis for the construction of function wrappers and decorator functions.
FabricDevOps Fabric provides operations for running local or remote shell commands (normally or via sudo) and uploading/downloading files, as well as auxiliary functionality such as prompting the running user for input, or aborting execution. Can be used for deployments, automating server tasks etc.
PexpectDevOps, AutomationPexpect is a pure Python module for spawning child applications; controlling them; and responding to expected patterns in their output. Pexpect works like Don Libes’ Expect. Pexpect allows your script to spawn a child application and control it as if a human were typing commands.

Pexpect can be used for automating interactive applications such as ssh, ftp, passwd, telnet, etc. It can be used to a automate setup scripts for duplicating software package installations on different servers. It can be used for automated software testing.
mkdocsDocumentationMkDocs is a fast, simple and static site generator that's geared towards building project documentation. Documentation source files are written in Markdown, and configured with a single YAML configuration file. Can be styled using MkDocs, Read the Docs, Bootsrap. Also helps automated deploying to s3, FTP, Pypi and GH.
GooeyGUITurn (almost) any Python command line program into a full GUI application with one line
EasyGUIGUIEasyGUI is a module for very simple, very easy GUI programming in Python. EasyGUI is different from other GUI generators in that EasyGUI is NOT event-driven. Instead, all GUI interactions are invoked by simple function calls.
foliumMapsFolium makes it easy to visualize data that’s been manipulated in Python on an interactive Leaflet map. It enables both the binding of data to a map for choropleth visualizations as well as passing Vincent/Vega visualizations as markers on the map.
simplify.pyMapsPolyline simplification dramatically reduces the number of points in a polyline while retaining its shape, giving a huge performance boost when processing it and also reducing visual noise.
GeoViewsMaps, VisualizationGeoViews is a Python library that makes it easy to explore and visualize geographical, meteorological, and oceanographic datasets, such as those used in weather, climate, and remote sensing research.
ScapyNetwork, WebScapy is a Python program that enables the user to send, sniff and dissect and forge network packets. This capability allows construction of tools that can probe, scan or attack networks.

In other words, Scapy is a powerful interactive packet manipulation program. It is able to forge or decode packets of a wide number of protocols, send them on the wire, capture them, match requests and replies, and much more. Scapy can easily handle most classical tasks like scanning, tracerouting, probing, unit tests, attacks or network discovery. It can replace hping, arpspoof, arp-sk, arping, p0f and even some parts of Nmap, tcpdump, and tshark).
couchdbkitNoSQL, CouchDBCouchdbkit goal is to provide a framework for your Python application to access and manage Couchdb.
mongoframesNoSQL, DatabaseMongoFrames - a fast unobtrusive MongoDB ODM for Python
walrusNoSQL, DatabaseThe purpose of walrus is to make working with Redis in Python a little easier by wrapping rich objects in Pythonic containers. Containers for the Redis object types Hash, List, Set, ZSet, HyperLogLog as well as a custom Array type. Cache implementation that exposes several decorators for caching function calls. Lock implementation that can also be used as a context manager or decorator.Model layer that support persisting structured information and performing queries using secondary indexes.
EveRESTEve is an open source Python REST API framework designed for human beings. It allows to effortlessly build and deploy highly customizable, fully featured RESTful Web Services.

Eve is powered by Flask, Redis, Cerberus, Events and offers support for both MongoDB and SQL backends.
BeautifulSoupScrapingBeautifulSoup is the best api available to scrape the web pages.
ScrapyScrapingAn open source and collaborative framework for extracting the data you need from websites.
In a fast, simple, yet extensible way.
dryscrapeScrapingdryscrape is a lightweight web scraping library for Python. It uses a headless Webkit instance to evaluate Javascript on the visited pages. This enables painless scraping of plain web pages as well as Javascript-heavy “Web 2.0” applications like Facebook.
robobrowserScraping, TestingRoboBrowser is a simple, Pythonic library for browsing the web without a standalone web browser. RoboBrowser can fetch a page, click on links and buttons, and fill out and submit forms. If you need to interact with web services that don’t have APIs, RoboBrowser can help.
pyqueryScraping, Webpyquery allows you to make jquery queries on xml/html documents. The API is as much as possible the similar to jquery. pyquery uses lxml for fast xml and html manipulation.
cookiecutterSetupA command-line utility that creates projects from cookiecutters (project templates). Its useful to share the project templates.
transitionsState Machine, DataA lightweight, object-oriented state machine implementation in Python. Compatible with Python 2.7+ and 3.0+.
PicotuiUI, MicroPythonLightweight, pure-Python Text User Interface widget toolkit with minimal dependencies. Dedicated to MicroPython.
ArrowUtil, DataArrow is a Python library that offers a sensible, human-friendly approach to creating, manipulating, formatting and converting dates, times, and timestamps.
matplotlibVisualizationmatplotlib is a python 2D plotting library which produces publication quality figures in a variety of hardcopy formats and interactive
toyplotVisualizationSimple, Clean but great plotting library. You can export the plots into HTML, Images etc
requestsWebRequests is an Apache2 Licensed HTTP library, written in Python, for human beings.
pywebWebpywb is a python implementation of web archival replay tools, sometimes also known as ‘Wayback Machine’. pywb allows high-quality replay (browsing) of archived web data stored in standardized ARC and WARC, and it can also serve as a customizable rewriting proxy to live web content. The replay system is designed to accurately replay complex dynamic sites, including video and audio content and sites with complex JavaScript.
ua-parserWebBrowser's user agent string parser.
Do you like this post? Please rate, its just a click :) 1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...