Skip to content

Latest commit

 

History

History
67 lines (46 loc) · 1.5 KB

README.md

File metadata and controls

67 lines (46 loc) · 1.5 KB

sqlite3_arabic_tokenizer

This package provides an SQLite3 Python wrapper bundled with sqlite3_arabic_tokenizer. It's a drop-in replacement for the standard library's sqlite3 module as the std one doesn't support loading extension.

pip install sqlite3_arabic_tokenizer
import sqlite3_arabic_tokenizer

# load the tokenizer
sqlite3_arabic_tokenizer.load()

# has the same API as the default `sqlite3` module
conn = sqlite3_arabic_tokenizer.connect(":memory:")
conn.execute("create table quran(sura, ayah, text)")

# and comes with the `sqlite3_arabic_tokenizer`
cur = conn.execute("create table quran(sura, ayah, text, tokenize='arabic_tokenizer')")
print(cur.fetchone())

conn.close()

Installation

A binary package (wheel) is available for the following operating systems:

  • Windows (64-bit)
  • Linux (64-bit)
  • macOS (both Intel and Apple processors)
pip install sqlite3_arabic_tokenizer

Building from source

For development purposes only.

Prepare source files:

make prepare-src
make download-sqlite
make download-sqlite3_arabic_tokenizer

Build and test the package:

make clean
python setup.py build_ext -i
python -m test
python -m pip wheel . -w dist

Credits

Based on the pysqlite3 project. Available under the Zlib license. Packaging help from sqlean.py