Adapt tokenization_interns1.py to transformers>=5.0.0

#15
by Zhangyc02 - opened

Sign up or log in to comment