Unicode 型別¶

這些是 Python 中用於 Unicode 實作的基本 Unicode 物件型別：

PyTypeObject PyUnicode_Type¶

為 穩定 ABI 的一部分.

This instance of PyTypeObject represents the Python Unicode type. It is exposed to Python code as str.

PyTypeObject PyUnicodeIter_Type¶

為 穩定 ABI 的一部分.

This instance of PyTypeObject represents the Python Unicode iterator type. It is used to iterate over Unicode string objects.

type Py_UCS4¶

type Py_UCS2¶

type Py_UCS1¶

為 穩定 ABI 的一部分.

These types are typedefs for unsigned integer types wide enough to contain characters of 32 bits, 16 bits and 8 bits, respectively. When dealing with single Unicode characters, use Py_UCS4.

在 3.3 版被加入.

type PyASCIIObject¶

type PyCompactUnicodeObject¶

type PyUnicodeObject¶

These subtypes of PyObject represent a Python Unicode object. In almost all cases, they shouldn't be used directly, since all API functions that deal with Unicode objects take and return PyObject pointers.

在 3.3 版被加入.

The structure of a particular object can be determined using the following macros. The macros cannot fail; their behavior is undefined if their argument is not a Python Unicode object.

PyUnicode_IS_COMPACT(o)¶

True if o uses the PyCompactUnicodeObject structure.

在 3.3 版被加入.

PyUnicode_IS_COMPACT_ASCII(o)¶

True if o uses the PyASCIIObject structure.

在 3.3 版被加入.

The following APIs are C macros and static inlined functions for fast checks and access to internal read-only data of Unicode objects:

int PyUnicode_Check(PyObject *obj)¶

Return true if the object obj is a Unicode object or an instance of a Unicode subtype. This function always succeeds.

int PyUnicode_CheckExact(PyObject *obj)¶

Return true if the object obj is a Unicode object, but not an instance of a subtype. This function always succeeds.

Py_ssize_t PyUnicode_GET_LENGTH(PyObject *unicode)¶

Return the length of the Unicode string, in code points. unicode has to be a Unicode object in the "canonical" representation (not checked).

在 3.3 版被加入.

Py_UCS1 *PyUnicode_1BYTE_DATA(PyObject *unicode)¶

Py_UCS2 *PyUnicode_2BYTE_DATA(PyObject *unicode)¶

Py_UCS4 *PyUnicode_4BYTE_DATA(PyObject *unicode)¶

Return a pointer to the canonical representation cast to UCS1, UCS2 or UCS4 integer types for direct character access. No checks are performed if the canonical representation has the correct character size; use PyUnicode_KIND() to select the right function.

在 3.3 版被加入.

PyUnicode_1BYTE_KIND¶

PyUnicode_2BYTE_KIND¶

PyUnicode_4BYTE_KIND¶

Return values of the PyUnicode_KIND() macro.

在 3.3 版被加入.

在 3.12 版的變更: PyUnicode_WCHAR_KIND 已被移除。

int PyUnicode_KIND(PyObject *unicode)¶

Return one of the PyUnicode kind constants (see above) that indicate how many bytes per character this Unicode object uses to store its data. unicode has to be a Unicode object in the "canonical" representation (not checked).

在 3.3 版被加入.

void *PyUnicode_DATA(PyObject *unicode)¶

Return a void pointer to the raw Unicode buffer. unicode has to be a Unicode object in the "canonical" representation (not checked).

在 3.3 版被加入.

void PyUnicode_WRITE(int kind, void *data, Py_ssize_t index, Py_UCS4 value)¶

Write the code point value to the given zero-based index in a string.

The kind value and data pointer must have been obtained from a string using PyUnicode_KIND() and PyUnicode_DATA() respectively. You must hold a reference to that string while calling PyUnicode_WRITE(). All requirements of PyUnicode_WriteChar() also apply.

The function performs no checks for any of its requirements, and is intended for usage in loops.

在 3.3 版被加入.

Py_UCS4 PyUnicode_READ(int kind, void *data, Py_ssize_t index)¶

Read a code point from a canonical representation data (as obtained with PyUnicode_DATA()). No checks are performed.

CPython 實作細節： Accept reading the trailing null character at index PyUnicode_GetLength().

在 3.3 版被加入.

Py_UCS4 PyUnicode_READ_CHAR(PyObject *unicode, Py_ssize_t index)¶

Read a character from a Unicode object unicode, which must be in the "canonical" representation. This is less efficient than PyUnicode_READ() if you do multiple consecutive reads.

CPython 實作細節： Accept reading the trailing null character at index PyUnicode_GetLength().

在 3.3 版被加入.

Py_UCS4 PyUnicode_MAX_CHAR_VALUE(PyObject *unicode)¶

Return the maximum code point that is suitable for creating another string based on unicode, which must be in the "canonical" representation. This is always an approximation but more efficient than iterating over the string.

在 3.3 版被加入.

int PyUnicode_IsIdentifier(PyObject *unicode)¶

為 穩定 ABI 的一部分.

Return 1 if the string is a valid identifier according to the language definition, section Names (identifiers and keywords). Return 0 otherwise.

在 3.9 版的變更: The function does not call Py_FatalError() anymore if the string is not ready.

unsigned int PyUnicode_IS_ASCII(PyObject *unicode)¶

Return true if the string only contains ASCII characters. Equivalent to str.isascii().

在 3.2 版被加入.

Py_hash_t PyUnstable_Unicode_GET_CACHED_HASH(PyObject *str)¶

這是 不穩定 API，它可能在小版本發布中沒有任何警告地被變更。

If the hash of str, as returned by PyObject_Hash(), has been cached and is immediately available, return it. Otherwise, return -1 without setting an exception.

If str is not a string (that is, if PyUnicode_Check(obj) is false), the behavior is undefined.

This function never fails with an exception.

Note that there are no guarantees on when an object's hash is cached, and the (non-)existence of a cached hash does not imply that the string has any other properties.

Unicode Character Properties¶

Unicode provides many different character properties. The most often needed ones are available through these macros which are mapped to C functions depending on the Python configuration.

int Py_UNICODE_ISSPACE(Py_UCS4 ch)¶

根據 ch 是否為空白字元來回傳 1 或 0。

int Py_UNICODE_ISLOWER(Py_UCS4 ch)¶

根據 ch 是否為小寫字元來回傳 1 或 0。

int Py_UNICODE_ISUPPER(Py_UCS4 ch)¶

根據 ch 是否為大寫字元來回傳 1 或 0。

int Py_UNICODE_ISTITLE(Py_UCS4 ch)¶

根據 ch 是否為首字大寫字元來回傳 1 或 0。

int Py_UNICODE_ISLINEBREAK(Py_UCS4 ch)¶

根據 ch 是否為換行字元來回傳 1 或 0。

int Py_UNICODE_ISDECIMAL(Py_UCS4 ch)¶

根據 ch 是否為十進位字元來回傳 1 或 0。

int Py_UNICODE_ISDIGIT(Py_UCS4 ch)¶

根據 ch 是否為數字 (digit) 字元來回傳 1 或 0。

int Py_UNICODE_ISNUMERIC(Py_UCS4 ch)¶

根據 ch 是否為數值 (numeric) 字元來回傳 1 或 0。

int Py_UNICODE_ISALPHA(Py_UCS4 ch)¶

根據 ch 是否為字母字元來回傳 1 或 0。

int Py_UNICODE_ISALNUM(Py_UCS4 ch)¶

根據 ch 是否為字母數字 (alphanumeric) 字元來回傳 1 或 0。

int Py_UNICODE_ISPRINTABLE(Py_UCS4 ch)¶

根據 ch 是否為可列印字元（如 str.isprintable() 所定義）來回傳 1 或 0。

這些 API 可用於快速直接字元轉換：

Py_UCS4 Py_UNICODE_TOLOWER(Py_UCS4 ch)¶

回傳轉換為小寫的 ch 字元。

Py_UCS4 Py_UNICODE_TOUPPER(Py_UCS4 ch)¶

回傳轉換為大寫的 ch 字元。

Py_UCS4 Py_UNICODE_TOTITLE(Py_UCS4 ch)¶

回傳轉換為首字大寫的 ch 字元。

int Py_UNICODE_TODECIMAL(Py_UCS4 ch)¶

回傳轉換為十進位正整數的 ch 字元，若無法轉換則回傳 -1。此函式不會引發例外。

int Py_UNICODE_TODIGIT(Py_UCS4 ch)¶

回傳轉換為單一數字整數的 ch 字元，若無法轉換則回傳 -1。此函式不會引發例外。

double Py_UNICODE_TONUMERIC(Py_UCS4 ch)¶

回傳轉換為雙精度浮點數 (double) 的 ch 字元，若無法轉換則回傳 -1.0。此函式不會引發例外。

這些 API 可用於處理代理字元：

int Py_UNICODE_IS_SURROGATE(Py_UCS4 ch)¶

檢查 ch 是否為代理字元 (surrogate, 0xD800 <= ch <= 0xDFFF)。

int Py_UNICODE_IS_HIGH_SURROGATE(Py_UCS4 ch)¶

檢查 ch 是否為高代理字元 (high surrogate, 0xD800 <= ch <= 0xDBFF)。

int Py_UNICODE_IS_LOW_SURROGATE(Py_UCS4 ch)¶

檢查 ch 是否為低代理字元 (low surrogate, 0xDC00 <= ch <= 0xDFFF)。

Py_UCS4 Py_UNICODE_HIGH_SURROGATE(Py_UCS4 ch)¶

Return the high UTF-16 surrogate (0xD800 to 0xDBFF) for a Unicode code point in the range [0x10000; 0x10FFFF].

Py_UCS4 Py_UNICODE_LOW_SURROGATE(Py_UCS4 ch)¶

Return the low UTF-16 surrogate (0xDC00 to 0xDFFF) for a Unicode code point in the range [0x10000; 0x10FFFF].

Py_UCS4 Py_UNICODE_JOIN_SURROGATES(Py_UCS4 high, Py_UCS4 low)¶

Join two surrogate code points and return a single Py_UCS4 value. high and low are respectively the leading and trailing surrogates in a surrogate pair. high must be in the range [0xD800; 0xDBFF] and low must be in the range [0xDC00; 0xDFFF].

Creating and accessing Unicode strings¶

To create Unicode objects and access their basic sequence properties, use these APIs:

PyObject *PyUnicode_New(Py_ssize_t size, Py_UCS4 maxchar)¶

回傳值：新的參照。

Create a new Unicode object. maxchar should be the true maximum code point to be placed in the string. As an approximation, it can be rounded up to the nearest value in the sequence 127, 255, 65535, 1114111.

On error, set an exception and return NULL.

After creation, the string can be filled by PyUnicode_WriteChar(), PyUnicode_CopyCharacters(), PyUnicode_Fill(), PyUnicode_WRITE() or similar. Since strings are supposed to be immutable, take care to not “use” the result while it is being modified. In particular, before it's filled with its final contents, a string:

• must not be hashed,

• must not be converted to UTF-8, or another non-"canonical" representation,

• must not have its reference count changed,

• must not be shared with code that might do one of the above.

This list is not exhaustive. Avoiding these uses is your responsibility; Python does not always check these requirements.

To avoid accidentally exposing a partially-written string object, prefer using the PyUnicodeWriter API, or one of the PyUnicode_From* functions below.

在 3.3 版被加入.

PyObject *PyUnicode_FromKindAndData(int kind, const void *buffer, Py_ssize_t size)¶

回傳值：新的參照。

Create a new Unicode object with the given kind (possible values are PyUnicode_1BYTE_KIND etc., as returned by PyUnicode_KIND()). The buffer must point to an array of size units of 1, 2 or 4 bytes per character, as given by the kind.

If necessary, the input buffer is copied and transformed into the canonical representation. For example, if the buffer is a UCS4 string (PyUnicode_4BYTE_KIND) and it consists only of codepoints in the UCS1 range, it will be transformed into UCS1 (PyUnicode_1BYTE_KIND).

All characters must be in range [U+0000; U+10ffff]. If kind is PyUnicode_4BYTE_KIND and the string contains invalid characters, the behavior is undefined.

在 3.3 版被加入.

PyObject *PyUnicode_FromStringAndSize(const char *str, Py_ssize_t size)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object from the char buffer str. The bytes will be interpreted as being UTF-8 encoded. The buffer is copied into the new object. The return value might be a shared object, i.e. modification of the data is not allowed.

此函式在以下情況下會引發 SystemError：

• size < 0，

• str 為 NULL 且 size > 0

在 3.12 版的變更: str == NULL 且 size > 0 不再被允許。

PyObject *PyUnicode_FromString(const char *str)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object from a UTF-8 encoded null-terminated char buffer str.

PyObject *PyUnicode_FromFormat(const char *format, ...)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Take a C printf()-style format string and a variable number of arguments, calculate the size of the resulting Python Unicode string and return a string with the values formatted into it. The variable arguments must be C types and must correspond exactly to the format characters in the format ASCII-encoded string.

A conversion specifier contains two or more characters and has the following components, which must occur in this order:

1. The '%' character, which marks the start of the specifier.

2. Conversion flags (optional), which affect the result of some conversion types.

3. Minimum field width (optional). If specified as an '*' (asterisk), the actual width is given in the next argument, which must be of type int, and the object to convert comes after the minimum field width and optional precision.

4. Precision (optional), given as a '.' (dot) followed by the precision. If specified as '*' (an asterisk), the actual precision is given in the next argument, which must be of type int, and the value to convert comes after the precision.

5. Length modifier (optional).

6. Conversion type.

The conversion flag characters are:

旗標	含義
0	The conversion will be zero padded for numeric values.
-	The converted value is left adjusted (overrides the 0 flag if both are given).

The length modifiers for following integer conversions (d, i, o, u, x, or X) specify the type of the argument (int by default):

Modifier	Types
l	long 或 unsigned long
ll	long long 或 unsigned long long
j	intmax_t 或 uintmax_t
z	size_t 或 ssize_t
t	ptrdiff_t

The length modifier l for following conversions s or V specify that the type of the argument is const wchar_t*.

The conversion specifiers are:

Conversion Specifier	Type	Comment
%	n/a	字面 % 字元。
d, i	Specified by the length modifier	一個有符號 C 整數的十進位表示法。
u	Specified by the length modifier	一個無符號 C 整數的十進位表示法。
o	Specified by the length modifier	一個無符號 C 整數的八進位表示法。
x	Specified by the length modifier	一個無符號 C 整數的十六進位表示法（小寫）。
X	Specified by the length modifier	一個無符號 C 整數的十六進位表示法（大寫）。
c	int	一個單一字元。
s	const char* 或 const wchar_t*	一個以 null 結尾的 C 字元陣列。
p	const void*	The hex representation of a C pointer. Mostly equivalent to printf("%p") except that it is guaranteed to start with the literal 0x regardless of what the platform's printf yields.
A	PyObject*	呼叫 ascii() 的結果。
U	PyObject*	一個 Unicode 物件。
V	PyObject*、const char* 或 const wchar_t*	A Unicode object (which may be NULL) and a null-terminated C character array as a second parameter (which will be used, if the first parameter is NULL).
S	PyObject*	呼叫 PyObject_Str() 的結果。
R	PyObject*	呼叫 PyObject_Repr() 的結果。
T	PyObject*	Get the fully qualified name of an object type; call PyType_GetFullyQualifiedName().
#T	PyObject*	Similar to T format, but use a colon (:) as separator between the module name and the qualified name.
N	PyTypeObject*	Get the fully qualified name of a type; call PyType_GetFullyQualifiedName().
#N	PyTypeObject*	Similar to N format, but use a colon (:) as separator between the module name and the qualified name.

備註

The width formatter unit is number of characters rather than bytes. The precision formatter unit is number of bytes or wchar_t items (if the length modifier l is used) for "%s" and "%V" (if the PyObject* argument is NULL), and a number of characters for "%A", "%U", "%S", "%R" and "%V" (if the PyObject* argument is not NULL).

備註

Unlike to C printf() the 0 flag has effect even when a precision is given for integer conversions (d, i, u, o, x, or X).

在 3.2 版的變更: 新增對 "%lld" 和 "%llu" 的支援。

在 3.3 版的變更: 新增對 "%li"、"%lli" 和 "%zi" 的支援。

在 3.4 版的變更: 新增對 "%s"、"%A"、"%U"、"%V"、"%S"、"%R" 的寬度和精確度格式化支援。

在 3.12 版的變更: Support for conversion specifiers o and X. Support for length modifiers j and t. Length modifiers are now applied to all integer conversions. Length modifier l is now applied to conversion specifiers s and V. Support for variable width and precision *. Support for flag -.

An unrecognized format character now sets a SystemError. In previous versions it caused all the rest of the format string to be copied as-is to the result string, and any extra arguments discarded.

在 3.13 版的變更: 新增對 %T、%#T、%N 和 %#N 格式的支援。

PyObject *PyUnicode_FromFormatV(const char *format, va_list vargs)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Identical to PyUnicode_FromFormat() except that it takes exactly two arguments.

PyObject *PyUnicode_FromObject(PyObject *obj)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Copy an instance of a Unicode subtype to a new true Unicode object if necessary. If obj is already a true Unicode object (not a subtype), return a new strong reference to the object.

Objects other than Unicode or its subtypes will cause a TypeError.

PyObject *PyUnicode_FromOrdinal(int ordinal)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode Object from the given Unicode code point ordinal.

The ordinal must be in range(0x110000). A ValueError is raised in the case it is not.

PyObject *PyUnicode_FromEncodedObject(PyObject *obj, const char *encoding, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Decode an encoded object obj to a Unicode object.

bytes, bytearray and other bytes-like objects are decoded according to the given encoding and using the error handling defined by errors. Both can be NULL to have the interface use the default values (see 內建編解碼器 for details).

All other objects, including Unicode objects, cause a TypeError to be set.

The API returns NULL if there was an error. The caller is responsible for decref'ing the returned objects.

void PyUnicode_Append(PyObject **p_left, PyObject *right)¶

為 穩定 ABI 的一部分.

Append the string right to the end of p_left. p_left must point to a strong reference to a Unicode object; PyUnicode_Append() releases ("steals") this reference.

於錯誤發生時，將 *p_left 設為 NULL 並設定例外。

On success, set *p_left to a new strong reference to the result.

void PyUnicode_AppendAndDel(PyObject **p_left, PyObject *right)¶

為 穩定 ABI 的一部分.

The function is similar to PyUnicode_Append(), with the only difference being that it decrements the reference count of right by one.

PyObject *PyUnicode_BuildEncodingMap(PyObject *string)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Return a mapping suitable for decoding a custom single-byte encoding. Given a Unicode string string of up to 256 characters representing an encoding table, returns either a compact internal mapping object or a dictionary mapping character ordinals to byte values. Raises a TypeError and return NULL on invalid input.

在 3.2 版被加入.

const char *PyUnicode_GetDefaultEncoding(void)¶

為 穩定 ABI 的一部分.

Return the name of the default string encoding, "utf-8". See sys.getdefaultencoding().

The returned string does not need to be freed, and is valid until interpreter shutdown.

Py_ssize_t PyUnicode_GetLength(PyObject *unicode)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Return the length of the Unicode object, in code points.

發生錯誤時，設定例外並回傳 -1。

CPython 實作細節： The length does not count the trailing null character.

在 3.3 版被加入.

Py_ssize_t PyUnicode_CopyCharacters(PyObject *to, Py_ssize_t to_start, PyObject *from, Py_ssize_t from_start, Py_ssize_t how_many)¶

Copy characters from one Unicode object into another. This function performs character conversion when necessary and falls back to memcpy() if possible. Returns -1 and sets an exception on error, otherwise returns the number of copied characters.

The string must not have been “used” yet. See PyUnicode_New() for details.

在 3.3 版被加入.

int PyUnicode_Resize(PyObject **unicode, Py_ssize_t length);¶

為 穩定 ABI 的一部分.

Resize a Unicode object *unicode to the new length in code points.

Try to resize the string in place (which is usually faster than allocating a new string and copying characters), or create a new string.

*unicode is modified to point to the new (resized) object and 0 is returned on success. Otherwise, -1 is returned and an exception is set, and *unicode is left untouched.

The function doesn't check string content, the result may not be a string in canonical representation.

Py_ssize_t PyUnicode_Fill(PyObject *unicode, Py_ssize_t start, Py_ssize_t length, Py_UCS4 fill_char)¶

Fill a string with a character: write fill_char into unicode[start:start+length].

Fail if fill_char is bigger than the string maximum character, or if the string has more than 1 reference.

The string must not have been “used” yet. See PyUnicode_New() for details.

回傳已寫入的字元數，發生錯誤時引發例外並回傳 -1。

在 3.3 版被加入.

int PyUnicode_WriteChar(PyObject *unicode, Py_ssize_t index, Py_UCS4 character)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Write a character to the string unicode at the zero-based index. Return 0 on success, -1 on error with an exception set.

This function checks that unicode is a Unicode object, that the index is not out of bounds, and that the object's reference count is one. See PyUnicode_WRITE() for a version that skips these checks, making them your responsibility.

The string must not have been “used” yet. See PyUnicode_New() for details.

在 3.3 版被加入.

Py_UCS4 PyUnicode_ReadChar(PyObject *unicode, Py_ssize_t index)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Read a character from a string. This function checks that unicode is a Unicode object and the index is not out of bounds, in contrast to PyUnicode_READ_CHAR(), which performs no error checking.

成功時回傳字元，發生錯誤時設定例外並回傳 -1。

CPython 實作細節： Do not accept reading the trailing null character at index PyUnicode_GetLength().

在 3.3 版被加入.

PyObject *PyUnicode_Substring(PyObject *unicode, Py_ssize_t start, Py_ssize_t end)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 自 3.7 版本開始.

Return a substring of unicode, from character index start (included) to character index end (excluded). Negative indices are not supported. On error, set an exception and return NULL.

在 3.3 版被加入.

Py_UCS4 *PyUnicode_AsUCS4(PyObject *unicode, Py_UCS4 *buffer, Py_ssize_t buflen, int copy_null)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Copy the string unicode into a UCS4 buffer, including a null character, if copy_null is set. Returns NULL and sets an exception on error (in particular, a SystemError if buflen is smaller than the length of unicode). buffer is returned on success.

在 3.3 版被加入.

Py_UCS4 *PyUnicode_AsUCS4Copy(PyObject *unicode)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Copy the string unicode into a new UCS4 buffer that is allocated using PyMem_Malloc(). If this fails, NULL is returned with a MemoryError set. The returned buffer always has an extra null code point appended.

在 3.3 版被加入.

Locale Encoding¶

The current locale encoding can be used to decode text from the operating system.

PyObject *PyUnicode_DecodeLocaleAndSize(const char *str, Py_ssize_t length, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 自 3.7 版本開始.

Decode a string from UTF-8 on Android and VxWorks, or from the current locale encoding on other platforms. The supported error handlers are "strict" and "surrogateescape" (PEP 383). The decoder uses "strict" error handler if errors is NULL. str must end with a null character but cannot contain embedded null characters.

Use PyUnicode_DecodeFSDefaultAndSize() to decode a string from the filesystem encoding and error handler.

此函式會忽略 Python UTF-8 模式。

也參考

Py_DecodeLocale() 函式。

在 3.3 版被加入.

在 3.7 版的變更: The function now also uses the current locale encoding for the surrogateescape error handler, except on Android. Previously, Py_DecodeLocale() was used for the surrogateescape, and the current locale encoding was used for strict.

PyObject *PyUnicode_DecodeLocale(const char *str, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 自 3.7 版本開始.

類似於 PyUnicode_DecodeLocaleAndSize()，但使用 strlen() 計算字串長度。

在 3.3 版被加入.

PyObject *PyUnicode_EncodeLocale(PyObject *unicode, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 自 3.7 版本開始.

Encode a Unicode object to UTF-8 on Android and VxWorks, or to the current locale encoding on other platforms. The supported error handlers are "strict" and "surrogateescape" (PEP 383). The encoder uses "strict" error handler if errors is NULL. Return a bytes object. unicode cannot contain embedded null characters.

Use PyUnicode_EncodeFSDefault() to encode a string to the filesystem encoding and error handler.

此函式會忽略 Python UTF-8 模式。

也參考

Py_EncodeLocale() 函式。

在 3.3 版被加入.

在 3.7 版的變更: The function now also uses the current locale encoding for the surrogateescape error handler, except on Android. Previously, Py_EncodeLocale() was used for the surrogateescape, and the current locale encoding was used for strict.

檔案系統編碼¶

Functions encoding to and decoding from the filesystem encoding and error handler (PEP 383 and PEP 529).

To encode file names to bytes during argument parsing, the "O&" converter should be used, passing PyUnicode_FSConverter() as the conversion function:

int PyUnicode_FSConverter(PyObject *obj, void *result)¶

為 穩定 ABI 的一部分.

PyArg_Parse* converter: encode str objects -- obtained directly or through the os.PathLike interface -- to bytes using PyUnicode_EncodeFSDefault(); bytes objects are output as-is. result must be an address of a C variable of type PyObject* (or PyBytesObject*). On success, set the variable to a new strong reference to a bytes object which must be released when it is no longer used and return a non-zero value (Py_CLEANUP_SUPPORTED). Embedded null bytes are not allowed in the result. On failure, return 0 with an exception set.

If obj is NULL, the function releases a strong reference stored in the variable referred by result and returns 1.

在 3.1 版被加入.

在 3.6 版的變更: 接受一個 path-like object。

To decode file names to str during argument parsing, the "O&" converter should be used, passing PyUnicode_FSDecoder() as the conversion function:

int PyUnicode_FSDecoder(PyObject *obj, void *result)¶

為 穩定 ABI 的一部分.

PyArg_Parse* converter: decode bytes objects -- obtained either directly or indirectly through the os.PathLike interface -- to str using PyUnicode_DecodeFSDefaultAndSize(); str objects are output as-is. result must be an address of a C variable of type PyObject* (or PyUnicodeObject*). On success, set the variable to a new strong reference to a Unicode object which must be released when it is no longer used and return a non-zero value (Py_CLEANUP_SUPPORTED). Embedded null characters are not allowed in the result. On failure, return 0 with an exception set.

If obj is NULL, release the strong reference to the object referred to by result and return 1.

在 3.2 版被加入.

在 3.6 版的變更: 接受一個 path-like object。

PyObject *PyUnicode_DecodeFSDefaultAndSize(const char *str, Py_ssize_t size)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Decode a string from the filesystem encoding and error handler.

If you need to decode a string from the current locale encoding, use PyUnicode_DecodeLocaleAndSize().

也參考

Py_DecodeLocale() 函式。

在 3.6 版的變更: The filesystem error handler is now used.

PyObject *PyUnicode_DecodeFSDefault(const char *str)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Decode a null-terminated string from the filesystem encoding and error handler.

如果字串長度已知，請使用 PyUnicode_DecodeFSDefaultAndSize()。

在 3.6 版的變更: The filesystem error handler is now used.

PyObject *PyUnicode_EncodeFSDefault(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object to the filesystem encoding and error handler, and return bytes. Note that the resulting bytes object can contain null bytes.

If you need to encode a string to the current locale encoding, use PyUnicode_EncodeLocale().

也參考

Py_EncodeLocale() 函式。

在 3.2 版被加入.

在 3.6 版的變更: The filesystem error handler is now used.

wchar_t 支援¶

對支援 wchar_t 的平台提供支援：

PyObject *PyUnicode_FromWideChar(const wchar_t *wstr, Py_ssize_t size)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object from the wchar_t buffer wstr of the given size. Passing -1 as the size indicates that the function must itself compute the length, using wcslen(). Return NULL on failure.

Py_ssize_t PyUnicode_AsWideChar(PyObject *unicode, wchar_t *wstr, Py_ssize_t size)¶

為 穩定 ABI 的一部分.

Copy the Unicode object contents into the wchar_t buffer wstr. At most size wchar_t characters are copied (excluding a possibly trailing null termination character). Return the number of wchar_t characters copied or -1 in case of an error.

When wstr is NULL, instead return the size that would be required to store all of unicode including a terminating null.

Note that the resulting wchar_t* string may or may not be null-terminated. It is the responsibility of the caller to make sure that the wchar_t* string is null-terminated in case this is required by the application. Also, note that the wchar_t* string might contain null characters, which would cause the string to be truncated when used with most C functions.

wchar_t *PyUnicode_AsWideCharString(PyObject *unicode, Py_ssize_t *size)¶

為 穩定 ABI 的一部分 自 3.7 版本開始.

Convert the Unicode object to a wide character string. The output string always ends with a null character. If size is not NULL, write the number of wide characters (excluding the trailing null termination character) into *size. Note that the resulting wchar_t string might contain null characters, which would cause the string to be truncated when used with most C functions. If size is NULL and the wchar_t* string contains null characters a ValueError is raised.

Returns a buffer allocated by PyMem_New (use PyMem_Free() to free it) on success. On error, returns NULL and *size is undefined. Raises a MemoryError if memory allocation is failed.

在 3.2 版被加入.

在 3.7 版的變更: Raises a ValueError if size is NULL and the wchar_t* string contains null characters.

泛用編解碼器¶

The following macro is provided:

Py_UNICODE_REPLACEMENT_CHARACTER¶

The Unicode code point U+FFFD (replacement character).

This Unicode character is used as the replacement character during decoding if the errors argument is set to "replace".

這些是泛用編解碼器的 API：

PyObject *PyUnicode_Decode(const char *str, Py_ssize_t size, const char *encoding, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the encoded string str. encoding and errors have the same meaning as the parameters of the same name in the str() built-in function. The codec to be used is looked up using the Python codec registry. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_AsEncodedString(PyObject *unicode, const char *encoding, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object and return the result as Python bytes object. encoding and errors have the same meaning as the parameters of the same name in the Unicode encode() method. The codec to be used is looked up using the Python codec registry. Return NULL if an exception was raised by the codec.

UTF-8 編解碼器¶

這些是 UTF-8 編解碼器的 API：

PyObject *PyUnicode_DecodeUTF8(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the UTF-8 encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_DecodeUTF8Stateful(const char *str, Py_ssize_t size, const char *errors, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

If consumed is NULL, behave like PyUnicode_DecodeUTF8(). If consumed is not NULL, trailing incomplete UTF-8 byte sequences will not be treated as an error. Those bytes will not be decoded and the number of bytes that have been decoded will be stored in consumed.

PyObject *PyUnicode_AsUTF8String(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using UTF-8 and return the result as Python bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

The function fails if the string contains surrogate code points (U+D800 - U+DFFF).

const char *PyUnicode_AsUTF8AndSize(PyObject *unicode, Py_ssize_t *size)¶

為 穩定 ABI 的一部分 自 3.10 版本開始.

Return a pointer to the UTF-8 encoding of the Unicode object, and store the size of the encoded representation (in bytes) in size. The size argument can be NULL; in this case no size will be stored. The returned buffer always has an extra null byte appended (not included in size), regardless of whether there are any other null code points.

發生錯誤時，設定例外並將 size 設為 -1（如果不是 NULL），並回傳 NULL。

The function fails if the string contains surrogate code points (U+D800 - U+DFFF).

This caches the UTF-8 representation of the string in the Unicode object, and subsequent calls will return a pointer to the same buffer. The caller is not responsible for deallocating the buffer. The buffer is deallocated and pointers to it become invalid when the Unicode object is garbage collected.

在 3.3 版被加入.

在 3.7 版的變更: 回傳型別現在是 const char * 而不是 char *。

在 3.10 版的變更: This function is a part of the limited API.

const char *PyUnicode_AsUTF8(PyObject *unicode)¶

與 PyUnicode_AsUTF8AndSize() 類似，但不儲存大小。

警告

This function does not have any special behavior for null characters embedded within unicode. As a result, strings containing null characters will remain in the returned string, which some C functions might interpret as the end of the string, leading to truncation. If truncation is an issue, it is recommended to use PyUnicode_AsUTF8AndSize() instead.

在 3.3 版被加入.

在 3.7 版的變更: 回傳型別現在是 const char * 而不是 char *。

UTF-32 編解碼器¶

這些是 UTF-32 編解碼器的 API：

PyObject *PyUnicode_DecodeUTF32(const char *str, Py_ssize_t size, const char *errors, int *byteorder)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Decode size bytes from a UTF-32 encoded buffer string and return the corresponding Unicode object. errors (if non-NULL) defines the error handling. It defaults to "strict".

If byteorder is non-NULL, the decoder starts decoding using the given byte order:

*byteorder == -1: little endian
*byteorder == 0:  native order
*byteorder == 1:  big endian

If *byteorder is zero, and the first four bytes of the input data are a byte order mark (BOM), the decoder switches to this byte order and the BOM is not copied into the resulting Unicode string. If *byteorder is -1 or 1, any byte order mark is copied to the output.

After completion, *byteorder is set to the current byte order at the end of input data.

If byteorder is NULL, the codec starts in native order mode.

如果編解碼器引發例外則回傳 NULL。

PyObject *PyUnicode_DecodeUTF32Stateful(const char *str, Py_ssize_t size, const char *errors, int *byteorder, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

If consumed is NULL, behave like PyUnicode_DecodeUTF32(). If consumed is not NULL, PyUnicode_DecodeUTF32Stateful() will not treat trailing incomplete UTF-32 byte sequences (such as a number of bytes not divisible by four) as an error. Those bytes will not be decoded and the number of bytes that have been decoded will be stored in consumed.

PyObject *PyUnicode_AsUTF32String(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Return a Python byte string using the UTF-32 encoding in native byte order. The string always starts with a BOM mark. Error handling is "strict". Return NULL if an exception was raised by the codec.

UTF-16 編解碼器¶

這些是 UTF-16 編解碼器的 API：

PyObject *PyUnicode_DecodeUTF16(const char *str, Py_ssize_t size, const char *errors, int *byteorder)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Decode size bytes from a UTF-16 encoded buffer string and return the corresponding Unicode object. errors (if non-NULL) defines the error handling. It defaults to "strict".

If byteorder is non-NULL, the decoder starts decoding using the given byte order:

*byteorder == -1: little endian
*byteorder == 0:  native order
*byteorder == 1:  big endian

If *byteorder is zero, and the first two bytes of the input data are a byte order mark (BOM), the decoder switches to this byte order and the BOM is not copied into the resulting Unicode string. If *byteorder is -1 or 1, any byte order mark is copied to the output (where it will result in either a \ufeff or a \ufffe character).

After completion, *byteorder is set to the current byte order at the end of input data.

If byteorder is NULL, the codec starts in native order mode.

如果編解碼器引發例外則回傳 NULL。

PyObject *PyUnicode_DecodeUTF16Stateful(const char *str, Py_ssize_t size, const char *errors, int *byteorder, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

If consumed is NULL, behave like PyUnicode_DecodeUTF16(). If consumed is not NULL, PyUnicode_DecodeUTF16Stateful() will not treat trailing incomplete UTF-16 byte sequences (such as an odd number of bytes or a split surrogate pair) as an error. Those bytes will not be decoded and the number of bytes that have been decoded will be stored in consumed.

PyObject *PyUnicode_AsUTF16String(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Return a Python byte string using the UTF-16 encoding in native byte order. The string always starts with a BOM mark. Error handling is "strict". Return NULL if an exception was raised by the codec.

UTF-7 編解碼器¶

這些是 UTF-7 編解碼器的 API：

PyObject *PyUnicode_DecodeUTF7(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the UTF-7 encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_DecodeUTF7Stateful(const char *str, Py_ssize_t size, const char *errors, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

If consumed is NULL, behave like PyUnicode_DecodeUTF7(). If consumed is not NULL, trailing incomplete UTF-7 base-64 sections will not be treated as an error. Those bytes will not be decoded and the number of bytes that have been decoded will be stored in consumed.

Unicode-Escape Codecs¶

These are the "Unicode Escape" codec APIs:

PyObject *PyUnicode_DecodeUnicodeEscape(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the Unicode-Escape encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_AsUnicodeEscapeString(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using Unicode-Escape and return the result as a bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

Raw-Unicode-Escape Codecs¶

These are the "Raw Unicode Escape" codec APIs:

PyObject *PyUnicode_DecodeRawUnicodeEscape(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the Raw-Unicode-Escape encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_AsRawUnicodeEscapeString(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using Raw-Unicode-Escape and return the result as a bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

Latin-1 編解碼器¶

These are the Latin-1 codec APIs: Latin-1 corresponds to the first 256 Unicode ordinals and only these are accepted by the codecs during encoding.

PyObject *PyUnicode_DecodeLatin1(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the Latin-1 encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_AsLatin1String(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using Latin-1 and return the result as Python bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

ASCII 編解碼器¶

These are the ASCII codec APIs. Only 7-bit ASCII data is accepted. All other codes generate errors.

PyObject *PyUnicode_DecodeASCII(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the ASCII encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_AsASCIIString(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using ASCII and return the result as Python bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

Character Map Codecs¶

This codec is special in that it can be used to implement many different codecs (and this is in fact what was done to obtain most of the standard codecs included in the encodings package). The codec uses mappings to encode and decode characters. The mapping objects provided must support the __getitem__() mapping interface; dictionaries and sequences work well.

這些是對映編解碼器的 API：

PyObject *PyUnicode_DecodeCharmap(const char *str, Py_ssize_t length, PyObject *mapping, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Create a Unicode object by decoding size bytes of the encoded string str using the given mapping object. Return NULL if an exception was raised by the codec.

If mapping is NULL, Latin-1 decoding will be applied. Else mapping must map bytes ordinals (integers in the range from 0 to 255) to Unicode strings, integers (which are then interpreted as Unicode ordinals) or None. Unmapped data bytes -- ones which cause a LookupError, as well as ones which get mapped to None, 0xFFFE or '\ufffe', are treated as undefined mappings and cause an error.

PyObject *PyUnicode_AsCharmapString(PyObject *unicode, PyObject *mapping)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Encode a Unicode object using the given mapping object and return the result as a bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

The mapping object must map Unicode ordinal integers to bytes objects, integers in the range from 0 to 255 or None. Unmapped character ordinals (ones which cause a LookupError) as well as mapped to None are treated as "undefined mapping" and cause an error.

The following codec API is special in that maps Unicode to Unicode.

PyObject *PyUnicode_Translate(PyObject *unicode, PyObject *table, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分.

Translate a string by applying a character mapping table to it and return the resulting Unicode object. Return NULL if an exception was raised by the codec.

The mapping table must map Unicode ordinal integers to Unicode ordinal integers or None (causing deletion of the character).

Mapping tables need only provide the __getitem__() interface; dictionaries and sequences work well. Unmapped character ordinals (ones which cause a LookupError) are left untouched and are copied as-is.

errors has the usual meaning for codecs. It may be NULL which indicates to use the default error handling.

Windows 的 MBCS 編解碼器¶

These are the MBCS codec APIs. They are currently only available on Windows and use the Win32 MBCS converters to implement the conversions. Note that MBCS (or DBCS) is a class of encodings, not just one. The target encoding is defined by the user settings on the machine running the codec.

PyObject *PyUnicode_DecodeMBCS(const char *str, Py_ssize_t size, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 on Windows 自 3.7 版本開始.

Create a Unicode object by decoding size bytes of the MBCS encoded string str. Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_DecodeMBCSStateful(const char *str, Py_ssize_t size, const char *errors, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 on Windows 自 3.7 版本開始.

If consumed is NULL, behave like PyUnicode_DecodeMBCS(). If consumed is not NULL, PyUnicode_DecodeMBCSStateful() will not decode trailing lead byte and the number of bytes that have been decoded will be stored in consumed.

PyObject *PyUnicode_DecodeCodePageStateful(int code_page, const char *str, Py_ssize_t size, const char *errors, Py_ssize_t *consumed)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 on Windows 自 3.7 版本開始.

Similar to PyUnicode_DecodeMBCSStateful(), except uses the code page specified by code_page.

PyObject *PyUnicode_AsMBCSString(PyObject *unicode)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 on Windows 自 3.7 版本開始.

Encode a Unicode object using MBCS and return the result as Python bytes object. Error handling is "strict". Return NULL if an exception was raised by the codec.

PyObject *PyUnicode_EncodeCodePage(int code_page, PyObject *unicode, const char *errors)¶

回傳值：新的參照。 為 穩定 ABI 的一部分 on Windows 自 3.7 版本開始.

Encode the Unicode object using the specified code page and return a Python bytes object. Return NULL if an exception was raised by the codec. Use CP_ACP code page to get the MBCS encoder.

在 3.3 版被加入.