+++++++++++

Python News

+++++++++++

What's New in Python 2.7.13

===========================

*Release date: 2016-12-17*

Core and Builtins

-----------------

- Revert a37cc3d926ec (Issue #5322).

What's New in Python 2.7.13 release candidate 1?

================================================

*Release date: 2016-12-03*

Core and Builtins

-----------------

- Issue #28847: dumbdbm no longer writes the index file in when it is not

changed and supports reading read-only files.

- Issue #11145: Fixed miscellaneous issues with C-style formatting of types

with custom __oct__ and __hex__.

- Issue #24469: Fixed memory leak caused by int subclasses without overridden

tp_free (e.g. C-inherited Cython classes).

- Issue #19398: Extra slash no longer added to sys.path components in case of

empty compile-time PYTHONPATH components.

- Issue #21720: Improve exception message when the type of fromlist is unicode.

fromlist parameter of __import__() only accepts str in Python 2 and this

will help to identify the problem especially when the unicode_literals

future import is used.

- Issue #26906: Resolving special methods of uninitialized type now causes

implicit initialization of the type instead of a fail.

- Issue #18287: PyType_Ready() now checks that tp_name is not NULL.

Original patch by Niklas Koep.

- Issue #24098: Fixed possible crash when AST is changed in process of

compiling it.

- Issue #28350: String constants with null character no longer interned.

- Issue #27942: String constants now interned recursively in tuples and frozensets.

- Issue #15578: Correctly incref the parent module while importing.

- Issue #26307: The profile-opt build now applies PGO to the built-in modules.

- Issue #26020: set literal evaluation order did not match documented behaviour.

- Issue #27870: A left shift of zero by a large integer no longer attempts

to allocate large amounts of memory.

- Issue #25604: Fix a minor bug in integer true division; this bug could

potentially have caused off-by-one-ulp results on platforms with

unreliable ldexp implementations.

- Issue #27473: Fixed possible integer overflow in str, unicode and bytearray

concatenations and repetitions. Based on patch by Xiang Zhang.

- Issue #27507: Add integer overflow check in bytearray.extend(). Patch by

Xiang Zhang.

- Issue #27581: Don't rely on wrapping for overflow check in

PySequence_Tuple(). Patch by Xiang Zhang.

- Issue #23908: os functions, open() and the io.FileIO constructor now reject

unicode paths with embedded null character on Windows instead of silently

truncating them.

- Issue #27514: Make having too many statically nested blocks a SyntaxError

instead of SystemError.

Library

-------

- Issue #25659: In ctypes, prevent a crash calling the from_buffer() and

from_buffer_copy() methods on abstract classes like Array.

- Issue #28563: Fixed possible DoS and arbitrary code execution when handle

plural form selections in the gettext module. The expression parser now

supports exact syntax supported by GNU gettext.

- Issue #28387: Fixed possible crash in _io.TextIOWrapper deallocator when

the garbage collector is invoked in other thread. Based on patch by

Sebastian Cufre.

- Issue #28449: tarfile.open() with mode "r" or "r:" now tries to open a tar

file with compression before trying to open it without compression. Otherwise

it had 50% chance failed with ignore_zeros=True.

- Issue #25464: Fixed HList.header_exists() in Tix module by adding

a workaround to Tix library bug.

- Issue #28488: shutil.make_archive() no longer adds entry "./" to ZIP archive.

- Issue #28480: Fix error building _sqlite3 module when multithreading is

disabled.

- Issue #24452: Make webbrowser support Chrome on Mac OS X.

- Issue #26293: Fixed writing ZIP files that starts not from the start of the

file. Offsets in ZIP file now are relative to the start of the archive in

conforming to the specification.

- Fix possible integer overflows and crashes in the mmap module with unusual

usage patterns.

- Issue #27897: Fixed possible crash in sqlite3.Connection.create_collation()

if pass invalid string-like object as a name. Original patch by Xiang Zhang.

- Issue #1703178: Fix the ability to pass the --link-objects option to the

distutils build_ext command.

- Issue #28253: Fixed calendar functions for extreme months: 0001-01

and 9999-12.

Methods itermonthdays() and itermonthdays2() are reimplemented so

that they don't call itermonthdates() which can cause datetime.date

under/overflow.

- Issue #27963: Fixed possible null pointer dereference in

ctypes.set_conversion_mode(). Patch by Xiang Zhang.

- Issue #28284: Strengthen resistance of ``_json.encode_basestring_ascii()`` to

integer overflow.

- Issue #27611: Fixed support of default root window in the Tix module.

- Issue #24363: When parsing HTTP header fields, if an invalid line is

encountered, skip it and continue parsing. Previously, no more header

fields were parsed, which could lead to fields for HTTP framing like

Content-Length and Transfer-Encoding being overlooked.

- Issue #27599: Fixed buffer overrun in binascii.b2a_qp() and binascii.a2b_qp().

- Issue #25969: Update the lib2to3 grammar to handle the unpacking

generalizations added in 3.5.

- Issue #24594: Validates persist parameter when opening MSI database

- Issue #27570: Avoid zero-length memcpy() etc calls with null source

pointers in the "ctypes" and "array" modules.

- Issue #22450: urllib now includes an "Accept: */*" header among the

default headers. This makes the results of REST API requests more

consistent and predictable especially when proxy servers are involved.

- lib2to3.pgen3.driver.load_grammar() now creates a stable cache file

between runs given the same Grammar.txt input regardless of the hash

randomization setting.

- Issue #27691: Fix ssl module's parsing of GEN_RID subject alternative name

fields in X.509 certs.

- Issue #27850: Remove 3DES from ssl module's default cipher list to counter

measure sweet32 attack (CVE-2016-2183).

- Issue #27766: Add ChaCha20 Poly1305 to ssl module's default ciper list.

(Required OpenSSL 1.1.0 or LibreSSL).

- Issue #26470: Port ssl and hashlib module to OpenSSL 1.1.0.

- Issue #27944: Fix some memory-corruption bugs in the log reading code of the

_hotshot module.

- Issue #27934: Use ``float.__repr__`` instead of plain ``repr`` when JSON-

encoding an instance of a float subclass. Thanks Eddie James.

- Issue #27861: Fixed a crash in sqlite3.Connection.cursor() when a factory

creates not a cursor. Patch by Xiang Zhang.

- Issue #19884: Avoid spurious output on OS X with Gnu Readline.

- Issue #10513: Fix a regression in Connection.commit(). Statements should

not be reset after a commit.

- Issue #2466: posixpath.ismount now correctly recognizes mount points which

the user does not have permission to access.

- Issue #27783: Fix possible usage of uninitialized memory in operator.methodcaller.

- Issue #27774: Fix possible Py_DECREF on unowned object in _sre.

- Issue #27760: Fix possible integer overflow in binascii.b2a_qp.

- In the curses module, raise an error if window.getstr() or window.instr() is

passed a negative value.

- Issue #27758: Fix possible integer overflow in the _csv module for large record

lengths.

- Issue #23369: Fixed possible integer overflow in

_json.encode_basestring_ascii.

- Issue #27568: Prevent HTTPoxy attack (CVE-2016-1000110). Ignore the

HTTP_PROXY variable when REQUEST_METHOD environment is set, which indicates

that the script is in CGI mode.

- Issue #27130: In the "zlib" module, fix handling of large buffers

(typically 2 or 4 GiB). Previously, inputs were limited to 2 GiB, and

compression and decompression operations did not properly handle results of

2 or 4 GiB.

- Issue #23804: Fix SSL zero-length recv() calls to not block and not raise

an error about unclean EOF.

- Issue #27466: Change time format returned by http.cookie.time2netscape,

confirming the netscape cookie format and making it consistent with

documentation.

- Issue #22115: Fixed tracing Tkinter variables: trace_vdelete() with wrong

mode no longer break tracing, trace_vinfo() now always returns a list of

pairs of strings.

- Issue #27079: Fixed curses.ascii functions isblank(), iscntrl() and ispunct().

- Issue #22636: Avoid shell injection problems with

ctypes.util.find_library().

- Issue #27330: Fixed possible leaks in the ctypes module.

- Issue #27238: Got rid of bare excepts in the turtle module. Original patch

by Jelle Zijlstra.

- Issue #26386: Fixed ttk.TreeView selection operations with item id's

containing spaces.

- Issue #25455: Fixed a crash in repr of cElementTree.Element with recursive tag.

- Issue #21201: Improves readability of multiprocessing error message. Thanks

to Wojciech Walczak for patch.

IDLE

----

- Issue #27854: Make Help => IDLE Help work again on Windows.

Include idlelib/help.html in 2.7 Windows installer.

- Issue #25507: Add back import needed for 2.x encoding warning box.

Add pointer to 'Encoding declaration' in Language Reference.

- Issue #15308: Add 'interrupt execution' (^C) to Shell menu.

Patch by Roger Serwy, updated by Bayard Randel.

- Issue #27922: Stop IDLE tests from 'flashing' gui widgets on the screen.

- Issue #17642: add larger font sizes for classroom projection.

- Add version to title of IDLE help window.

- Issue #25564: In section on IDLE -- console differences, mention that

using exec means that __builtins__ is defined for each statement.

- Issue #27714: text_textview and test_autocomplete now pass when re-run

in the same process. This occurs when test_idle fails when run with the

-w option but without -jn. Fix warning from test_config.

- Issue #27452: add line counter and crc to IDLE configHandler test dump.

- Issue #27365: Allow non-ascii chars in IDLE NEWS.txt, for contributor names.

- Issue #27245: IDLE: Cleanly delete custom themes and key bindings.

Previously, when IDLE was started from a console or by import, a cascade

of warnings was emitted. Patch by Serhiy Storchaka.

Documentation

-------------

- Issue #28513: Documented command-line interface of zipfile.

- Issue #16484: Change the default PYTHONDOCS URL to "https:", and fix the

resulting links to use lowercase. Patch by Sean Rodman, test by Kaushik

Nadikuditi.

Tests

-----

- Issue #28666: Now test.test_support.rmtree is able to remove unwritable or

unreadable directories.

- Issue #23839: Various caches now are cleared before running every test file.

- Issue #27369: In test_pyexpat, avoid testing an error message detail that

changed in Expat 2.2.0.

Build

-----

- Issue #10656: Fix out-of-tree building on AIX. Patch by Tristan Carel and

Michael Haubenwallner.

- Issue #26359: Rename --with-optimiations to --enable-optimizations.

- Issue #28248: Update Windows build and OS X installers to use OpenSSL 1.0.2j.

- Issue #28258: Fixed build with Estonian locale (distclean target in

Makefile). Patch by Arfrever Frehtes Taifersar Arahesis.

- Issue #26661: setup.py now detects system libffi with multiarch wrapper.

- Issue #15819: The Include directory in the build tree is already searched;

drop unused code trying to add it again.

- Issue #27566: Fix clean target in freeze makefile (patch by Lisa Roach)

- Issue #27983: Cause lack of llvm-profdata tool when using clang as

required for PGO linking to be a configure time error rather than

make time when --with-optimizations is enabled. Also improve our

ability to find the llvm-profdata tool on MacOS and some Linuxes.

- Issue #26359: Add the --with-optimizations configure flag.

- Issue #10910: Avoid C++ compilation errors on FreeBSD and OS X.

Also update FreedBSD version checks for the original ctype UTF-8 workaround.

- Issue #27806: Fix 32-bit builds on macOS Sierra 10.12 broken by removal of

deprecated QuickTime/QuickTime.h header file. Patch by Aleks Bunin.

- Issue #28676: Prevent missing 'getentropy' declaration warning on macOS.

Initial patch by Gareth Rees.

Tools/Demos

-----------

- Issue #27952: Get Tools/scripts/fixcid.py working with the current "re"

module, avoid invalid Python backslash escapes, and fix a bug parsing

escaped C quote signs.

Windows

-------

- Issue #27932: Prevent memory leak in win32_ver().

- Issue #27888: Prevent Windows installer from displaying console windows and

failing when pip cannot be installed/uninstalled.

Mac OS X

--------

- Issue #28440: No longer add /Library/Python/site-packages, the Apple-supplied

system Python site-packages directory, to sys.path for macOS framework builds.

The coupling between the two Python instances often caused confusion and, as

of macOS 10.12, changes to the site-packages layout can cause pip component

installations to fail. This change reverts the effects introduced in 2.7.0

by Issue #4865. If you are using a package with both the Apple system Python

2.7 and a user-installed Python 2.7, you will need to ensure that copies of

the package are installed with both Python instances.

What's New in Python 2.7.12?

============================

*Release date: 2016-06-25*

Build

-----

- Issue #27641: The configure script now inserts comments into the makefile

to prevent the pgen executable from being cross-compiled.

- Issue #26930: Update Windows builds to use OpenSSL 1.0.2h.

IDLE

----

- Issue #27365: Fix about dialog.

What's New in Python 2.7.12 release candidate 1?

================================================

*Release date: 2016-06-12*

Core and Builtins

-----------------

- Issue #20041: Fixed TypeError when frame.f_trace is set to None.

Patch by Xavier de Gaye.

- Issue #25702: A --with-lto configure option has been added that will

enable link time optimizations at build time during a make profile-opt.

Some compilers and toolchains are known to not produce stable code when

using LTO, be sure to test things thoroughly before relying on it.

It can provide a few % speed up over profile-opt alone.

- Issue #26168: Fixed possible refleaks in failing Py_BuildValue() with the "N"

format unit.

- Issue #27039: Fixed bytearray.remove() for values greater than 127. Patch by

Joe Jevnik.

- Issue #4806: Avoid masking the original TypeError exception when using star

(*) unpacking and the exception was raised from a generator. Based on

patch by Hagen Fürstenau.

- Issue #26659: Make the builtin slice type support cycle collection.

- Issue #26718: super.__init__ no longer leaks memory if called multiple times.

NOTE: A direct call of super.__init__ is not endorsed!

- Issue #13410: Fixed a bug in PyUnicode_Format where it failed to properly

ignore errors from a __int__() method.

- Issue #26494: Fixed crash on iterating exhausting iterators.

Affected classes are generic sequence iterators, iterators of bytearray,

list, tuple, set, frozenset, dict, OrderedDict and corresponding views.

- Issue #26581: If coding cookie is specified multiple times on a line in

Python source code file, only the first one is taken to account.

- Issue #22836: Ensure exception reports from PyErr_Display() and

PyErr_WriteUnraisable() are sensible even when formatting them produces

secondary errors. This affects the reports produced by

sys.__excepthook__() and when __del__() raises an exception.

- Issue #22847: Improve method cache efficiency.

- Issue #25843: When compiling code, don't merge constants if they are equal

but have a different types. For example, ``f1, f2 = lambda: 1, lambda: 1.0``

is now correctly compiled to two different functions: ``f1()`` returns ``1``

(``int``) and ``f2()`` returns ``1.0`` (``int``), even if ``1`` and ``1.0``

are equal.

- Issue #22995: [UPDATE] Remove the one of the pickleability tests in

_PyObject_GetState() due to regressions observed in Cython-based projects.

- Issue #25961: Disallowed null characters in the type name.

- Issue #22995: Instances of extension types with a state that aren't

subclasses of list or dict and haven't implemented any pickle-related

methods (__reduce__, __reduce_ex__, __getnewargs__, __getnewargs_ex__,

or __getstate__), can no longer be pickled. Including memoryview.

- Issue #20440: Massive replacing unsafe attribute setting code with special

macro Py_SETREF.

- Issue #25421: __sizeof__ methods of builtin types now use dynamic basic size.

This allows sys.getsize() to work correctly with their subclasses with

__slots__ defined.

- Issue #19543: Added Py3k warning for decoding unicode.

- Issue #24097: Fixed crash in object.__reduce__() if slot name is freed inside

__getattr__.

- Issue #24731: Fixed crash on converting objects with special methods

__str__, __trunc__, and __float__ returning instances of subclasses of

str, long, and float to subclasses of str, long, and float correspondingly.

- Issue #26478: Fix semantic bugs when using binary operators with dictionary

views and tuples.

- Issue #26171: Fix possible integer overflow and heap corruption in

zipimporter.get_data().

Library

-------

- Issue #26556: Update expat to 2.1.1, fixes CVE-2015-1283.

- Fix TLS stripping vulnerability in smptlib, CVE-2016-0772. Reported by Team

Oststrom

- Issue #7356: ctypes.util: Make parsing of ldconfig output independent of the

locale.

- Issue #25738: Stop BaseHTTPServer.BaseHTTPRequestHandler.send_error() from

sending a message body for 205 Reset Content. Also, don't send the

Content-Type header field in responses that don't have a body. Based on

patch by Susumu Koshiba.

- Issue #21313: Fix the "platform" module to tolerate when sys.version

contains truncated build information.

- Issue #27211: Fix possible memory corruption in io.IOBase.readline().

- Issue #27114: Fix SSLContext._load_windows_store_certs fails with

PermissionError

- Issue #14132: Fix urllib.request redirect handling when the target only has

a query string. Fix by Ján Janech.

- Removed the requirements for the ctypes and modulefinder modules to be

compatible with earlier Python versions.

- Issue #22274: In the subprocess module, allow stderr to be redirected to

stdout even when stdout is not redirected. Patch by Akira Li.

- Issue #12045: Avoid duplicate execution of command in ctypes.util._get_soname().

Patch by Sijin Joseph.

- Issue #26960: Backported #16270 from Python 3 to Python 2, to prevent urllib

from hanging when retrieving certain FTP files.

- Issue #25745: Fixed leaking a userptr in curses panel destructor.

- Issue #17765: weakref.ref() no longer silently ignores keyword arguments.

Patch by Georg Brandl.

- Issue #26873: xmlrpclib now raises ResponseError on unsupported type tags

instead of silently return incorrect result.

- Issue #24114: Fix an uninitialized variable in `ctypes.util`.

The bug only occurs on SunOS when the ctypes implementation searches

for the `crle` program. Patch by Xiang Zhang. Tested on SunOS by

Kees Bos.

- Issue #26864: In urllib, change the proxy bypass host checking against

no_proxy to be case-insensitive, and to not match unrelated host names that

happen to have a bypassed hostname as a suffix. Patch by Xiang Zhang.

- Issue #26804: urllib will prefer lower_case proxy environment variables over

UPPER_CASE or Mixed_Case ones. Patch contributed by Hans-Peter Jansen.

- Issue #26837: assertSequenceEqual() now correctly outputs non-stringified

differing items. This affects assertListEqual() and assertTupleEqual().

- Issue #26822: itemgetter, attrgetter and methodcaller objects no longer

silently ignore keyword arguments.

- Issue #26657: Fix directory traversal vulnerability with SimpleHTTPServer

on Windows. This fixes a regression that was introduced in 2.7.7. Based

on patch by Philipp Hagemeister.

- Issue #19377: Add .svg to mimetypes.types_map.

- Issue #13952: Add .csv to mimetypes.types_map. Patch by Geoff Wilson.

- Issue #16329: Add .webm to mimetypes.types_map. Patch by Giampaolo Rodola'.

- Issue #23735: Handle terminal resizing with Readline 6.3+ by installing our

own SIGWINCH handler. Patch by Eric Price.

- Issue #26644: Raise ValueError rather than SystemError when a negative

length is passed to SSLSocket.recv() or read().

- Issue #23804: Fix SSL recv(0) and read(0) methods to return zero bytes

instead of up to 1024.

- Issue #24266: Ctrl+C during Readline history search now cancels the search

mode when compiled with Readline 7.

- Issue #23857: Implement PEP 493, adding a Python-2-only ssl module API and

environment variable to configure the default handling of SSL/TLS certificates

for HTTPS connections.

- Issue #26313: ssl.py _load_windows_store_certs fails if windows cert store

is empty. Patch by Baji.

- Issue #26513: Fixes platform module detection of Windows Server

- Issue #23718: Fixed parsing time in week 0 before Jan 1. Original patch by

Tamás Bence Gedai.

- Issue #26177: Fixed the keys() method for Canvas and Scrollbar widgets.

- Issue #15068: Got rid of excessive buffering in the fileinput module.

The bufsize parameter is no longer used.

- Issue #2202: Fix UnboundLocalError in

AbstractDigestAuthHandler.get_algorithm_impls. Initial patch by Mathieu Dupuy.

- Issue #26475: Fixed debugging output for regular expressions with the (?x)

flag.

- Issue #26385: Remove the file if the internal fdopen() call in

NamedTemporaryFile() fails. Based on patch by Silent Ghost.

- Issue #26309: In the "SocketServer" module, shut down the request (closing

the connected socket) when verify_request() returns false. Based on patch

by Aviv Palivoda.

- Issue #25939: On Windows open the cert store readonly in ssl.enum_certificates.

- Issue #24303: Fix random EEXIST upon multiprocessing semaphores creation with

Linux PID namespaces enabled.

- Issue #25698: Importing module if the stack is too deep no longer replaces

imported module with the empty one.

- Issue #12923: Reset FancyURLopener's redirect counter even if there is an

exception. Based on patches by Brian Brazil and Daniel Rocco.

- Issue #25945: Fixed a crash when unpickle the functools.partial object with

wrong state. Fixed a leak in failed functools.partial constructor.

"args" and "keywords" attributes of functools.partial have now always types

tuple and dict correspondingly.

- Issue #19883: Fixed possible integer overflows in zipimport.

- Issue #26147: xmlrpclib now works with unicode not encodable with used

non-UTF-8 encoding.

- Issue #16620: Fixed AttributeError in msilib.Directory.glob().

- Issue #21847: Fixed xmlrpclib on Unicode-disabled builds.

- Issue #6500: Fixed infinite recursion in urllib2.Request.__getattr__().

- Issue #26083: Workaround a subprocess bug that raises an incorrect

"ValueError: insecure string pickle" exception instead of the actual

exception on some platforms such as Mac OS X when an exception raised

in the forked child process prior to the exec() was large enough that

it overflowed the internal errpipe_read pipe buffer.

- Issue #24103: Fixed possible use after free in ElementTree.iterparse().

- Issue #20954: _args_from_interpreter_flags used by multiprocessing and some

tests no longer behaves incorrectly in the presence of the PYTHONHASHSEED

environment variable.

- Issue #14285: When executing a package with the "python -m package" option,

and package initialization raises ImportError, a proper traceback is now

reported.

- Issue #6478: _strptime's regexp cache now is reset after changing timezone

with time.tzset().

- Issue #25718: Fixed copying object with state with boolean value is false.

- Issue #25742: :func:`locale.setlocale` now accepts a Unicode string for

its second parameter.

- Issue #10131: Fixed deep copying of minidom documents. Based on patch

by Marian Ganisin.

- Issue #25725: Fixed a reference leak in cPickle.loads() when unpickling

invalid data including tuple instructions.

- Issue #25663: In the Readline completer, avoid listing duplicate global

names, and search the global namespace before searching builtins.

- Issue #25688: Fixed file leak in ElementTree.iterparse() raising an error.

- Issue #23914: Fixed SystemError raised by CPickle unpickler on broken data.

- Issue #25924: Avoid unnecessary serialization of getaddrinfo(3) calls on

OS X versions 10.5 or higher. Original patch by A. Jesse Jiryu Davis.

- Issue #26406: Avoid unnecessary serialization of getaddrinfo(3) calls on

current versions of OpenBSD and NetBSD. Patch by A. Jesse Jiryu Davis.

IDLE

----

- Issue #5124: Paste with text selected now replaces the selection on X11.

This matches how paste works on Windows, Mac, most modern Linux apps,

and ttk widgets. Original patch by Serhiy Storchaka.

- Issue #24759: Make clear in idlelib.idle_test.__init__ that the directory

is a private implementation of test.test_idle and tool for maintainers.

- Issue #26673: When tk reports font size as 0, change to size 10.

Such fonts on Linux prevented the configuration dialog from opening.

- Issue #27044: Add ConfigDialog.remove_var_callbacks to stop memory leaks.

- In the 'IDLE-console differences' section of the IDLE doc, clarify

how running with IDLE affects sys.modules and the standard streams.

- Issue #25507: fix incorrect change in IOBinding that prevented printing.

Change also prevented saving shell window with non-ascii characters.

Augment IOBinding htest to include all major IOBinding functions.

- Issue #25905: Revert unwanted conversion of ' to ’ RIGHT SINGLE QUOTATION

MARK in README.txt and open this and NEWS.txt with 'ascii'.

Re-encode CREDITS.txt to utf-8 and open it with 'utf-8'.

- Issue #26417: Prevent spurious errors and incorrect defaults when

installing IDLE 2.7 on OS X: default configuration settings are

no longer installed from OS X specific copies.

Documentation

-------------

- Issue #26736: Used HTTPS for external links in the documentation if possible.

- Issue #6953: Rework the Readline module documentation to group related

functions together, and add more details such as what underlying Readline

functions and variables are accessed.

- Issue #26014: Guide users to the newer packaging documentation as was done

for Python 3.x. In particular, the top-level 2.7 documentation page now

links to the newer installer and distributions pages rather than the

legacy install and Distutils pages; these are still linked to in the

library/distutils doc page.

Tests

-----

- Issue #21916: Added tests for the turtle module. Patch by ingrid,

Gregory Loyse and Jelle Zijlstra.

- Issue #25940: Changed test_ssl to use self-signed.pythontest.net. This

avoids relying on svn.python.org, which recently changed root certificate.

- Issue #25616: Tests for OrderedDict are extracted from test_collections

into separate file test_ordered_dict.

Build

-----

- Issue #22359: Avoid incorrect recursive $(MAKE), and disable the rules for

running pgen when cross-compiling. The pgen output is normally saved with

the source code anyway, and is still regenerated when doing a native build.

Patch by Jonas Wagner and Xavier de Gaye.

- Issue #19450: Update Windows builds to use SQLite 3.8.11.0.

- Issue #27229: Fix the cross-compiling pgen rule for in-tree builds. Patch

by Xavier de Gaye.

- Issue #17603: Avoid error about nonexistant fileblocks.o file by using a

lower-level check for st_blocks in struct stat.

- Issue #26465: Update Windows builds to use OpenSSL 1.0.2g.

- Issue #24421: Compile Modules/_math.c once, before building extensions.

Previously it could fail to compile properly if the math and cmath builds

were concurrent.

- Issue #25824: Fixes sys.winver to not include any architecture suffix.

- Issue #25348: Added ``--pgo`` and ``--pgo-job`` arguments to

``PCbuild\build.bat`` for building with Profile-Guided Optimization. The

old ``PCbuild\build_pgo.bat`` script is now deprecated, and simply calls

``PCbuild\build.bat --pgo %*``.

- Issue #25827: Add support for building with ICC to ``configure``, including

a new ``--with-icc`` flag.

- Issue #25696: Fix installation of Python on UNIX with make -j9.

- Issue #26930: Update OS X 10.5+ 32-bit-only installer to build

and link with OpenSSL 1.0.2h.

- Issue #26268: Update Windows builds to use OpenSSL 1.0.2f.

- Issue #25136: Support Apple Xcode 7's new textual SDK stub libraries.

Tools/Demos

-----------

- Issue #26799: Fix python-gdb.py: don't get C types once when the Python code

is loaded, but get C types on demand. The C types can change if

python-gdb.py is loaded before the Python executable. Patch written by Thomas

Ilsche.

C API

-----

- Issue #26476: Fixed compilation error when use PyErr_BadInternalCall() in C++.

Patch by Jeroen Demeyer.

Misc

----

- Issue #17500, and https://github.com/python/pythondotorg/issues/945: Remove

unused and outdated icons.

What's New in Python 2.7.11?

============================

*Release date: 2015-12-05*

Library

-------

- Issue #25624: ZipFile now always writes a ZIP_STORED header for directory

entries. Patch by Dingyuan Wang.

What's New in Python 2.7.11 release candidate 1?

================================================

*Release date: 2015-11-21*

Core and Builtins

-----------------

- Issue #25678: Avoid buffer overreads when int(), long(), float(), and

compile() are passed buffer objects. These objects are not necessarily

terminated by a null byte, but the functions assumed they were.

- Issue #25388: Fixed tokenizer hang when processing undecodable source code

with a null byte.

- Issue #22995: Default implementation of __reduce__ and __reduce_ex__ now

rejects builtin types with not defined __new__.

- Issue #7267: format(int, 'c') now raises OverflowError when the argument is

not in range(0, 256).

- Issue #24806: Prevent builtin types that are not allowed to be subclassed from

being subclassed through multiple inheritance.

- Issue #24848: Fixed a number of bugs in UTF-7 decoding of misformed data.

- Issue #25003: os.urandom() doesn't use getentropy() on Solaris because

getentropy() is blocking, whereas os.urandom() should not block. getentropy()

is supported since Solaris 11.3.

- Issue #21167: NAN operations are now handled correctly when python is

compiled with ICC even if -fp-model strict is not specified.

- Issue #24467: Fixed possible buffer over-read in bytearray. The bytearray

object now always allocates place for trailing null byte and it's buffer now

is always null-terminated.

- Issue #19543: encode() and decode() methods and constructors of str,

unicode and bytearray classes now emit deprecation warning for known

non-text encodings when Python is ran with the -3 option.

- Issue #24115: Update uses of PyObject_IsTrue(), PyObject_Not(),

PyObject_IsInstance(), PyObject_RichCompareBool() and _PyDict_Contains()

to check for and handle errors correctly.

- Issue #4753: On compilers where it is supported, use "computed gotos" for

bytecode dispatch in the interpreter. This improves interpretation

performance.

- Issue #22939: Fixed integer overflow in iterator object. Original patch by

Clement Rouault.

- Issue #24102: Fixed exception type checking in standard error handlers.

Library

-------

- Issue #10128: backport issue #10845's mitigation of incompatibilities between

the multiprocessing module and directory and zipfile execution.

Multiprocessing on Windows will now automatically skip rerunning __main__ in

spawned processes, rather than failing with AssertionError.

- Issue #25578: Fix (another) memory leak in SSLSocket.getpeercer().

- Issue #25590: In the Readline completer, only call getattr() once per

attribute.

- Issue #25530: Disable the vulnerable SSLv3 protocol by default when creating

ssl.SSLContext.

- Issue #25569: Fix memory leak in SSLSocket.getpeercert().

- Issue #7759: Fixed the mhlib module on filesystems that doesn't support

link counting for directories.

- Issue #892902: Fixed pickling recursive objects.

- Issue #18010: Fix the pydoc GUI's search function to handle exceptions

from importing packages.

- Issue #25515: Always use os.urandom as a source of randomness in uuid.uuid4.

- Issue #21827: Fixed textwrap.dedent() for the case when largest common

whitespace is a substring of smallest leading whitespace.

Based on patch by Robert Li.

- Issue #21709: Fix the logging module to not depend upon __file__ being set

properly to get the filename of its caller from the stack. This allows it

to work if run in a frozen or embedded environment where the module's

.__file__ attribute does not match its code object's .co_filename.

- Issue #25319: When threading.Event is reinitialized, the underlying condition

should use a regular lock rather than a recursive lock.

- Issue #25232: Fix CGIRequestHandler to split the query from the URL at the

first question mark (?) rather than the last. Patch from Xiang Zhang.

- Issue #24657: Prevent CGIRequestHandler from collapsing slashes in the

query part of the URL as if it were a path. Patch from Xiang Zhang.

- Issue #22958: Constructor and update method of weakref.WeakValueDictionary

now accept the self keyword argument.

- Issue #22609: Constructor and the update method of collections.UserDict now

accept the self keyword argument.

- Issue #25203: Failed readline.set_completer_delims() no longer left the

module in inconsistent state.

- Issue #19143: platform module now reads Windows version from kernel32.dll to

avoid compatibility shims.

- Issue #25135: Make deque_clear() safer by emptying the deque before clearing.

This helps avoid possible reentrancy issues.

- Issue #24684: socket.socket.getaddrinfo() now calls

PyUnicode_AsEncodedString() instead of calling the encode() method of the

host, to handle correctly custom unicode string with an encode() method

which doesn't return a byte string. The encoder of the IDNA codec is now

called directly instead of calling the encode() method of the string.

- Issue #24982: shutil.make_archive() with the "zip" format now adds entries

for directories (including empty directories) in ZIP file.

- Issue #17849: Raise a sensible exception if an invalid response is

received for a HTTP tunnel request, as seen with some servers that

do not support tunnelling. Initial patch from Cory Benfield.

- Issue #16180: Exit pdb if file has syntax error, instead of trapping user

in an infinite loop. Patch by Xavier de Gaye.

- Issue #22812: Fix unittest discovery examples.

Patch from Pam McA'Nulty.

- Issue #24634: Importing uuid should not try to load libc on Windows

- Issue #23652: Make it possible to compile the select module against the

libc headers from the Linux Standard Base, which do not include some

EPOLL macros. Initial patch by Matt Frank.

- Issue #15138: Speed up base64.urlsafe_b64{en,de}code considerably.

- Issue #23319: Fix ctypes.BigEndianStructure, swap correctly bytes. Patch

written by Matthieu Gautier.

- Issue #23254: Document how to close the TCPServer listening socket.

Patch from Martin Panter.

- Issue #17527: Add PATCH to wsgiref.validator. Patch from Luca Sbardella.

- Issue #24613: Calling array.fromstring() with self is no longer allowed

to prevent the use-after-free error. Patch by John Leitch.

- Issue #24708: Fix possible integer overflow in strop.replace().

- Issue #24620: Random.setstate() now validates the value of state last element.

- Issue #13938: 2to3 converts StringTypes to a tuple. Patch from Mark Hammond.

- Issue #24611: Fixed compiling the posix module on non-Windows platforms

without mknod() or makedev() (e.g. on Unixware).

- Issue #18684: Fixed reading out of the buffer in the re module.

- Issue #24259: tarfile now raises a ReadError if an archive is truncated

inside a data segment.

- Issue #24514: tarfile now tolerates number fields consisting of only

whitespace.

- Issue #20387: Restore semantic round-trip correctness in tokenize/untokenize

for tab-indented blocks.

- Issue #24456: Fixed possible buffer over-read in adpcm2lin() and lin2adpcm()

functions of the audioop module. Fixed SystemError when the state is not a

tuple. Fixed possible memory leak.

- Issue #24481: Fix possible memory corruption with large profiler info strings

in hotshot.

- Issue #24489: ensure a previously set C errno doesn't disturb cmath.polar().

- Issue #19543: io.TextIOWrapper (and hence io.open()) now uses the internal

codec marking system added to emit deprecation warning for known non-text

encodings at stream construction time when Python is ran with the -3 option.

- Issue #24264: Fixed buffer overflow in the imageop module.

- Issue #5633: Fixed timeit when the statement is a string and the setup is not.

- Issue #24326: Fixed audioop.ratecv() with non-default weightB argument.

Original patch by David Moore.

- Issue #22095: Fixed HTTPConnection.set_tunnel with default port. The port

value in the host header was set to "None". Patch by Demian Brecht.

- Issue #24257: Fixed segmentation fault in sqlite3.Row constructor with faked

cursor type.

- Issue #24286: Dict view were not registered with the MappingView abstract

base classes. This caused key and item views in OrderedDict to not be equal

to their regular dict counterparts.

- Issue #22107: tempfile.gettempdir() and tempfile.mkdtemp() now try again

when a directory with the chosen name already exists on Windows as well as

on Unix. tempfile.mkstemp() now fails early if parent directory is not

valid (not exists or is a file) on Windows.

- Issue #6598: Increased time precision and random number range in

email.utils.make_msgid() to strengthen the uniqueness of the message ID.

- Issue #24091: Fixed various crashes in corner cases in cElementTree.

- Issue #15267: HTTPConnection.request() now is compatibile with old-style

classes (such as TemporaryFile). Original patch by Atsuo Ishimoto.