All pull requests

Pull requests

• fix: handle punkt_tab fallback in split_sentences for NLTK >= 3.9

  #1023·danishashko opened Apr 1, 2026·

  ·
  1

• Included Gujarati stopwords and saved them in stopwords-gu.txt

  #1018·Oam11 opened Aug 28, 2025·

  ·

• Fix homepage url restriction

  #1013·ljluestc opened Jun 22, 2025·

  ·

• Also require lxml-html-clean>=0.4.2.

  #1012·yilei opened Jun 21, 2025·

  ·
  1

• Update download_corpora.py - add 'punkt_tab'

  #1006·Ronkiro opened Sep 20, 2024·

  ·

• Allow newspaper work on news websites like carbon-pulse

  #975·Cabu opened Oct 3, 2023·

  ·

• fix(sec): upgrade nltk to 3.6.6

  #957·chncaption opened Nov 15, 2022·

  ·

• fix(sec): upgrade requests to 2.20

  #956·chncaption opened Nov 15, 2022·

  ·

• fix itemprop containing articleBody

  #953·AndyTheFactory opened Oct 4, 2022·

  ·

• bengali support added

  #951·ffaisal93 opened Sep 23, 2022·

  ·

• Added ability to scrape javascript intensive apps

  #941·Sosshi opened Jun 12, 2022·

  ·
  1

• Close opened category cache files when done

  #938·WillGITCode opened Apr 9, 2022·

  ·

• Change general exceptions in Configuration

  #934·nnick14 opened Feb 14, 2022·

  ·

• Remove non-working demo

  #909·robincunningham2 opened Sep 15, 2021·

  ·

• set daemon attribute directly instead of calling setDaemon function to clear deprecation warning in python3.10

  #897·Narendra-Neerukonda opened Jun 19, 2021·

  ·
  1

• fix cleaning the wrong top node

  #896·idoshamun opened Jun 17, 2021·

  ·

• Add parallellization and caching to image download

  #882·dhgelling opened Apr 30, 2021·

  ·

• Added Marathi Language Extension

  #875·tanmay-punekar opened Mar 6, 2021·

  ·

• Fix concatenating sentence parts separated with newlines

  #873·dhgelling opened Feb 12, 2021·

  ·

• Skip unparsable urls

  #872·frankier opened Feb 11, 2021·

  ·

• Add Latvian language support

  #867·kaspars-gailitis opened Jan 3, 2021·

  ·

• Adding Bengali Language Support

  #866·lookatmeimdanny opened Dec 24, 2020·

  ·

• Add article to node search tags

  #865·8W9aG opened Dec 17, 2020·

  ·

• Extract clean_top_node from clean_doc. Add unit tests to ensure clean…

  #863·monstrfolk opened Dec 13, 2020·

  ·

• Update in PUBLISH_DATE_TAGS for date extraction

  #861·yoonoh930 opened Dec 7, 2020·

  ·