This is one of the two approved incoming PSF licenses.

Closes python#23

23: warn for tokenize() r=ltratt a=nanjekyejoannah

The constructor for `tokenize()` has changed in Python 3, to behave like the `tokenize.generate_token(`) function on Python 2.

Co-authored-by: Joannah Nanjekye <[email protected]>

This PR pretty much completely refactors the Rust build system. There are now two main ways Rust code is built:

# both

- The Rust triple is deduced based on the preprocessor run on Misc/platform_triplet.c
- A cpython-build-helper crate is used to pass the proper link arguments for each configuration
- The proper Rust toolchain is downloaded for iOS/Android/WASI for CI on those platforms
- cpython-sys is updated significantly to ensure bindgen properly generates the bindings for each platform

# shared

For shared builds, we build a crate into a cdylib and pass through link arguments from the makefile/configure and the linker executable so that the final link will match what is done for C programs.

# static

For static builds, a cpython-rust-staticlib crate is a built which depends on and re-exports the module initializers for each crate. This ensures there aren't duplicated Rust stdlib/core symbols.

Fixes python#23