Skip to content

Commit

Permalink
add a temporary Snakefile switch to enable building with morphology
Browse files Browse the repository at this point in the history
  • Loading branch information
Rob Speer committed Dec 12, 2017
1 parent bc436b5 commit b2b9c21
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion Snakefile
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ USE_PRECOMPUTED = not os.environ.get("CONCEPTNET_REBUILD_PRECOMPUTED")
# can be used as precomputed files later? (Requires ConceptNet S3 credentials.)
UPLOAD = False

# If USE_MORPHOLOGY is true, we will build and learn from sub-words derived
# from Morfessor.
USE_MORPHOLOGY = False

# How many pieces to split edge files into. (Works best when it's a power of
# 2 that's 64 or less.)
N_PIECES = 16
Expand Down Expand Up @@ -107,7 +111,8 @@ CORE_DATASET_NAMES += ["emoji/{}".format(lang) for lang in EMOJI_LANGUAGES]


DATASET_NAMES = CORE_DATASET_NAMES + ["dbpedia/dbpedia_en"]
DATASET_NAMES += ["morphology/subwords-{}".format(lang) for lang in COMMON_LANGUAGES]
if USE_MORPHOLOGY:
DATASET_NAMES += ["morphology/subwords-{}".format(lang) for lang in COMMON_LANGUAGES]


rule all:
Expand Down

0 comments on commit b2b9c21

Please sign in to comment.