Skip to content

PyThaiNLP 1.7 #117

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 154 commits into from
Sep 22, 2018
Merged

PyThaiNLP 1.7 #117

merged 154 commits into from
Sep 22, 2018

Conversation

wannaphong
Copy link
Member

@wannaphong wannaphong commented Sep 22, 2018 •
edited
Loading

PyThaiNLP is a Python library for natural language processing (NLP) of Thai language.

What's new in PyThaiNLP 1.7 ?

  • Deprecate Python 2 support
  • Refactor pythainlp.tokenize.pyicu for readability
  • Add Thai NER model to pythainlp.ner
  • thai2vec v0.2 - larger vocab, benchmarking results on Wongnai dataset
  • Sentiment classifier based on ULMFit and various product review datasets
  • Add ULMFit utility to PyThaiNLP
  • Add Thai romanization model thai2rom
  • Retrain POS-tagging model
  • Improve word tokenize (newmm,mm) and dict_word_tokenize
  • Documentation added

wannaphong and others added 30 commits February 25, 2018 23:51
@wannaphong
update pythainlp 1.6 thai docs
762fd0f
@smeeklai
Improved custom dict tokenization
87c3b2c
@smeeklai
made dict_word_tokenize() to work with new edited newmm.py
6c8fa67
@smeeklai
declared global custom_dict_trie and vocabs to be used with dict_word…
504a0f3 
…_tokenize()
@wannaphong
Merge pull request #80 from PyThaiNLP/pythainlp1.6
ee4b1a1 
PyThaNLP 1.6.0.4
@smeeklai
Merge branch 'dev' of https://github.com/PyThaiNLP/pythainlp into imp…
c93a436 
…roved_custom_dict_tokenization
@smeeklai
temp
ebd26a9
@smeeklai
added create_custom_dict_trie() and modified word_tokenize() to use n…
38ca4bc 
…ew method of using custom dict to tokenize words
@smeeklai
removed duplicated and nested return statement
9113cc4
@smeeklai
chaged word sengment function in syllable_tokenize
cff5a1a
@smeeklai
fixed mistakes in syllable_tokenize() and wordcutpy tokenizer
26246ec
@smeeklai
took nested return out from engine == 'wordcutpy'
65aacef
@smeeklai
took nested return out from engine == 'wordcutpy'
f557544
@smeeklai
fixed deeply nested control flow statements
f70deff
@smeeklai
fixed deeply nested control flow statements
8533827
@smeeklai
improved Coverage
ddbefa9
@smeeklai
improved Coverage
1ec02b6
@smeeklai
improved Coverage
816061c
@smeeklai
moved new tokenizing method to dict_work_tokenize instead
f4f66b8
@smeeklai
removed unused variables
028cb85
@wannaphong
Merge pull request #77 from smeeklai/improved_custom_dict_tokenization
26ec714 
Improved custom dict tokenization
@pontakornth
fixed spelling error
238de46
@wannaphong
Merge pull request #85 from pontakornth/patch-1
b98d023 
fixed spelling error
@wannaphong
add Exception in word_tokenize
2976eb2 
if no have engine in word_tokenize then it show error.
@wannaphong
Merge branch 'dev' of https://github.com/wannaphongcom/pythainlp into…
900a0cd 
… dev
@wannaphong @korakot
rewrite pythainlp.tokenize.pyicu #87 & fix test
8d0081a 
เดติดโค้ด pyicu จากคุณ @korakot

Co-Authored-By: Korakot Chaovavanich <[email protected]>
@wannaphong
train new postag #89
3bc791d
@wannaphong
fix unexpected keyword artagger
74d6781
@wannaphong
add ud_thai-pud #89
112870b
@wannaphong @korakot
fix tcc rule
729d322 
del เccอะ

Co-Authored-By: Korakot Chaovavanich <[email protected]>
wannaphong and others added 23 commits September 6, 2018 21:56
This was referenced Sep 22, 2018
Closed
Closed
Closed
@coveralls
Copy link

Coverage Status

Coverage decreased (-3.03%) to 59.537% when pulling 22ef79a on dev into 007e644 on master.

@wannaphong wannaphong added this to the 1.7 milestone Sep 22, 2018
@wannaphong wannaphong merged commit 7abc2ef into master Sep 22, 2018
@bact bact mentioned this pull request Nov 4, 2018
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
1.7
Development

Successfully merging this pull request may close these issues.
8 participants
@wannaphong @coveralls @smeeklai @pontakornth @earthpyy @cstorm125 @petetanru @bact