Skip to content

Missing preprocess_morph_tag for running tokenizer training #4

@amir-zeldes

Description

@amir-zeldes

Hi, I'm trying to run tokenizer training using token_train.py, but I'm running into this error:

Traceback (most recent call last):
  File "token_train.py", line 11, in <module>
    from data import preprocess_morph_tag
ImportError: cannot import name 'preprocess_morph_tag' from 'data'

Is a file missing from the repo? Can you point me to preprocess_morph_tag?

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions