Livy is an open source REST interface
for interacting with Spark. pylivy is a
Python client for Livy, enabling easy remote code execution on a Spark cluster.
$ pip install -U livyNote that pylivy requires Python 3.6 or later.
Documentation for pylivy is available at https://pylivy.readthedocs.io/.
Contributions to extend or improve pylivy are very welcome! Have a look at
the relevant docs page for more
information.