Merge branch 'release/0.4.0'

.env

@@ -0,0 +1,9 @@
+# Docker settings
+POSTGRES_HOST=localhost
+POSTGRES_PORT=42001
+POSTGRES_USER=postgres
+POSTGRES_PASSWORD=postgres
+POSTGRES_DB=rows
+
+# Test settings
+POSTGRESQL_URI=postgres://postgres:[email protected]:42001/rows

.gitignore

@@ -1,16 +1,22 @@
+*.db
 *.egg-info/
 *.pyc
+*.sqlite
+*.sw?
 *~
 .*.sw?
+.DS_Store
+.activate
 .coverage
 .directory
 .env
 .idea/*
+.ipynb_checkpoints/
+.pytest_cache/
 .tox
 MANIFEST
 build/*
 dist/*
+docs/_build
 reg_settings.py
 rows.1
-.DS_Store
-docs/_build

AUTHORS.md

@@ -26,3 +26,12 @@ Created and maintained by Álvaro Justen aka turicas:
 - Davi Oliveira <https://github.com/arloc>
 - Ellison Leão <https://github.com/ellisonleao>
 - Ramiro Luz <https://github.com/ramiroluz>
+- Humberto Rocha <https://github.com/humrochagf>
+- Sebastian Oliva <https://github.com/tian2992>
+- Guillermo Colmenero <https://github.com/narrowfail>
+- Izabela Borges <https://github.com/izabelacborges>
+- João S. O. Bueno <https://github.com/jsbueno>
+- Lucas Rangel Cezimbra <https://github.com/Lrcezimbra>
+- Marcelo Jorge Vieira <https://github.com/marcelometal>
+- Marcos Vinícius <https://github.com/marcosvbras>
+- Daniel Drumond <https://github.com/DanielDrumond>

Makefile

@@ -1,3 +1,6 @@
+envtest: clean
+	nosetests tests/
+
 test:
 	tox
 
@@ -8,6 +11,12 @@ clean:
 	rm -rf MANIFEST dist build *.egg-info
 	rm -rf rows.1
 	rm -rf .tox
+	coverage erase
+
+fix-imports:
+	autoflake --in-place --recursive --remove-unused-variables --remove-all-unused-imports .
+	isort -rc .
+	black .
 
 install:
 	make clean
@@ -27,4 +36,7 @@ man:
 	head -1 rows.1.txt > rows.1
 	txt2man rows.1.txt | egrep -v '^\.TH' >> rows.1
 
-.PHONY:	test clean lint lint-tests install uninstall man
+release:
+	python setup.py bdist bdist_wheel bdist_egg upload
+
+.PHONY:	test clean fix-imports lint lint-tests install uninstall man release

README.md

@@ -5,7 +5,7 @@
 [![Downloads per month on PyPI](https://img.shields.io/pypi/dm/rows.svg)](https://pypi.python.org/pypi/rows)
 ![Supported Python Versions](https://img.shields.io/pypi/pyversions/rows.svg)
 ![Software status](https://img.shields.io/pypi/status/rows.svg)
-[![License: GPLv3](https://img.shields.io/pypi/l/rows.svg)](https://github.com/turicas/rows/blob/develop/LICENSE)
+[![License: LGPLv3](https://img.shields.io/pypi/l/rows.svg)](https://github.com/turicas/rows/blob/develop/LICENSE)
 [![Donate](https://img.shields.io/gratipay/turicas.svg?style=social&label=Donate)](https://www.gratipay.com/turicas)
 
 No matter in which format your tabular data is: `rows` will import it,

docker-compose.yml

@@ -0,0 +1,9 @@
+version: '3'
+
+services:
+    db:
+        image: postgres:10
+        container_name: rows_postgresql
+        env_file: .env
+        ports:
+            - "42001:5432"

docs/changelog.md

@@ -1,10 +1,90 @@
 # rows' Log of Changes
 
-## Version `0.3.2`
+## Version `0.4.0`
 
-**Released on: (under development)**
+**Released on: 2019-02-09**
 
 
+### General Changes and Enhancements
+
+- [#243](https://github.com/turicas/rows/issues/243) Change license to LGPL3.0.
+- Added official Python 3.6 support.
+- `Table.__add__` does not depend on table sizes anymore.
+- Implemented `Table.__iadd__` (`table += other` will work).
+- [#234](https://github.com/turicas/rows/issues/234) Remove `BinaryField` from
+  the default list of detection types.
+
+### Plugins
+
+- [#224](https://github.com/turicas/rows/issues/224) Add `|` as possible
+  delimiter (CSV dialect detection).
+- Export CSV in batches.
+- Change CSV dialect detection sample size to 256KiB.
+- [#225](https://github.com/turicas/rows/issues/225) Create export callbacks
+  (CSV and SQLite plugins).
+- [#270](https://github.com/turicas/rows/pull/270) Added options to export
+  pretty text table frames (TXT plugin).
+- [#274](https://github.com/turicas/rows/issues/274) `start_row` and
+  `start_column` now behave the same way in XLS and XLSX (starting from 0).
+- [#261](https://github.com/turicas/rows/issues/261) Add support to `end_row`
+  and `end_column` on XLS and XLSX (thanks
+  [@Lrcezimbra](https://github.com/Lrcezimbra) for the suggestion).
+- [#4](https://github.com/turicas/rows/issues/4) Add PostgreSQL plugin (thanks
+  to [@juliano777](https://github.com/juliano777)).
+- [#290](https://github.com/turicas/rows/pull/290) Fix percent formatting
+  reading on XLSX and ODS file formats (thanks to
+  [@jsbueno](https://github.com/jsbueno)).
+- [#220](https://github.com/turicas/rows/issues/220) Do not use
+  non-import_fields and force_types columns on type detection algorithm.
+- [#50](https://github.com/turicas/rows/issues/50) Create PDF extraction plugin
+  with two backend libraries (`pymupdf` and `pdfminer.six`) and 3 table
+  extraction algorithms.
+- [#294](https://github.com/isses/294) Decrease XLSX reading time (thanks to
+  [@israelst](https://github.com/israelst)).
+- Change to pure Python version of Apache Thrift library (parquet plugin)
+- [@299](https://github.com/turicas/rows/issues/299) Change CSV field limit
+
+### Command-Line Interface
+
+- [#242](https://github.com/turicas/rows/issues/242) Add
+  `--fields`/`--fields-exclude` to `convert`, `join` and `sum` (and rename
+  `--fields-exclude` on `print`), also remove `--fields` from `query` (is not
+  needed).
+- [#235](https://github.com/turicas/rows/issues/235) Implement `--http-cache`
+  and `--http-cache-path`.
+- [#237](https://github.com/turicas/rows/issues/237) Implement `rows schema`
+  (generates schema in text, SQL and Django models).
+- Enable progress bar when downloading files.
+- Create `pgimport` and `pgexport` commands.
+- Create `csv-to-sqlite` and `sqlite-to-csv` commands.
+- Create `pdf-to-text` command.
+- Add shortcut for all command names: `2` can be used instead of `-to-` (so
+  `rows pdf2text` is a shortcut to `rows pdf-to-text`).
+
+### Utils
+
+- Create `utils.open_compressed` helper function: can read/write files,
+  automatically dealing with on-the-fly compression.
+- Add progress bar support to `utils.download_file` (thanks to `tqdm` library).
+- Add helper class `utils.CsvLazyDictWriter` (write as `dict`s without needing
+  to pass the keys in advance).
+- Add `utils.pgimport` and `utils.pgexport` functions.
+- Add `utils.csv2sqlite` and `utils.sqlite2csv` functions.
+
+### Bug Fixes
+
+- [#223](https://github.com/turicas/rows/issues/223) `UnicodeDecodeError` on
+  dialect detection.
+- [#214](https://github.com/turicas/rows/issues/214) Problem detecting dialect.
+- [#181](https://github.com/turicas/rows/issues/181) Create slugs inside
+  `Table.__init__`.
+- [#221](https://github.com/turicas/rows/issues/221) Error on `pip install rows`.
+- [#238](https://github.com/turicas/rows/issues/238) `import_from_dicts`
+  supports generator as input
+- [#239](https://github.com/turicas/rows/issues/239) Use correct field ordering
+- [#299](https://github.com/turicas/rows/issues/302) Integer field detected for
+  numbers started with zero
+
 ## Version `0.3.1`
 
 **Released on: 2017-05-08**
@@ -207,14 +287,14 @@
 ### CLI
 
 - Add option to disable SSL verification (`--verify-ssl=no`)
-- Add `print` subcommand
+- Add `print` command
 - Add `--version`
 - CLI is not installed by default (should be installed as
   `pip install rows[cli]`)
 - Automatically detect default encoding (if not specified)
-- Add `--order-by` to some subcommands and remove `sort` subcommand. #111
+- Add `--order-by` to some commands and remove `sort` command. #111
 - Do not use locale by default
-- Add `query` subcommand: converts (from many sources) internally to SQLite,
+- Add `query` command: converts (from many sources) internally to SQLite,
   execute the query and then export
 
 ## Version `0.1.1`
@@ -253,7 +333,7 @@
   - `join`
   - `transform`
   - `serialize`
-- Implement a command-line interface with the following subcommands:
+- Implement a command-line interface with the following commands:
   - `convert`
   - `join`
   - `sort`