Tissevert/LearnedBot
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Turn indexed words lowercase to gain flexibility (to be restored when we have a real indexation mechanism)

Browse source
This commit is contained in:
Tissevert 2024-03-16 15:48:28 +01:00
parent f2caf77510
commit b9066f0933
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
memory.py
View file

@ -22,7 +22,7 @@ def keepOnlyAlphaChars(word):
def index(text):
words = re.split('\s', text)
normalized_words = [keepOnlyAlphaChars(word) for word in words]
normalized_words = [keepOnlyAlphaChars(word).lower() for word in words]
important_words = set([w for w in normalized_words
if len(w) >= WORD_LENGTH_THRESHOLD])
return important_words