Cannot install Transformers version >2.3.0 with pip on MacOS

[Yuanyuan-T]

error: Can not find Rust compiler

see huggingface/transformers#2980

[Yuanyuan-T]

Solution: huggingface/transformers#2831

Managed to solve it and install Transformers 2.5.1 by manually install the last version of tokenizers (0.6.0) instead of 0.5.2 that is required in the transformer package.

pip install tokenizers

Git clone latest version of transformers:

git clone /~https://github.com/huggingface/transformers

Before running the installation edit transformers/setup.py and change requirement of tokenizers to 0.6.0

Line 93: install_requires=[
"numpy",
"tokenizers == 0.6.0",

Then run as usual:

cd transformers
pip install .

I assume that you could also skip the first step and just collect the package as you run the install.
I'm quite new to this, so just wanted to share my take.