Update dependency aiohttp to v3.11.11 (!880) · Merge requests · Water Mission Area / Internet of Water / waterdataui

igswsihw-wmadepbot requested to merge renovate/aiohttp-3.x into main Nov 01, 2024

This MR contains the following updates:

Package	Type	Update	Change
aiohttp	dependencies	minor	`3.9.5` -> `3.11.11`

⚠️ Warning

Some dependencies could not be looked up. Check the warning logs for more information.

Release Notes

aio-libs/aiohttp (aiohttp)

Bug fixes

Updated :py:meth:~aiohttp.ClientSession.request to reuse the quote_cookie setting from ClientSession._cookie_jar when processing cookies parameter. -- by :user:Cycloctane.

Related issues and pull requests on GitHub: :issue:10093.
Fixed type of SSLContext for some static type checkers (e.g. pyright).

Related issues and pull requests on GitHub: :issue:10099.
Updated :meth:aiohttp.web.StreamResponse.write annotation to also allow :class:bytearray and :class:memoryview as inputs -- by :user:cdce8p.

Related issues and pull requests on GitHub: :issue:10154.
Fixed a hang where a connection previously used for a streaming download could be returned to the pool in a paused state. -- by :user:javitonino.

Related issues and pull requests on GitHub: :issue:10169.

Features

Enabled ALPN on default SSL contexts. This improves compatibility with some proxies which don't work without this extension. -- by :user:Cycloctane.

Related issues and pull requests on GitHub: :issue:10156.

Miscellaneous internal changes

Fixed an infinite loop that can occur when using aiohttp in combination with async-solipsism_ -- by :user:bmerry.

.. _async-solipsism: https://github.com/bmerry/async-solipsism

Related issues and pull requests on GitHub: :issue:10149.

Bug fixes

Fixed race condition in :class:aiohttp.web.FileResponse that could have resulted in an incorrect response if the file was replaced on the file system during prepare -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10101, :issue:10113.
Replaced deprecated call to :func:mimetypes.guess_type with :func:mimetypes.guess_file_type when using Python 3.13+ -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10102.
Disabled zero copy writes in the StreamWriter -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10125.

Bug fixes

Fixed invalid method logging unexpected being logged at exception level on subsequent connections -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10055, :issue:10076.

Miscellaneous internal changes

Improved performance of parsing headers when using the C parser -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10073.

Miscellaneous internal changes

Improved performance of creating :class:aiohttp.ClientResponse objects when there are no cookies -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10029.
Improved performance of creating :class:aiohttp.ClientResponse objects -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10030.
Improved performances of creating objects during the HTTP request lifecycle -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10037.
Improved performance of constructing :class:aiohttp.web.Response with headers -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10043.
Improved performance of making requests when there are no auto headers to skip -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10049.
Downgraded logging of invalid HTTP method exceptions on the first request to debug level -- by :user:bdraco.

HTTP requests starting with an invalid method are relatively common, especially when connected to the public internet, because browsers or other clients may try to speak SSL to a plain-text server or vice-versa. These exceptions can quickly fill the log with noise when nothing is wrong.

Related issues and pull requests on GitHub: :issue:10055.

Bug fixes

Fixed the HTTP client not considering the connector's force_close value when setting the Connection header -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10003.

Miscellaneous internal changes

Improved performance of serializing HTTP headers -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:10014.

Bug fixes

Restored the force_close method to the ResponseHandler -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9997.

Bug fixes

Fixed the ANY method not appearing in :meth:~aiohttp.web.UrlDispatcher.routes -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9899, :issue:9987.

Bug fixes

Fixed StaticResource not allowing the OPTIONS method after calling set_options_route -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9972, :issue:9975, :issue:9976.

Miscellaneous internal changes

Improved performance of creating web responses when there are no cookies -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9895.

Bug fixes

Removed non-existing __author__ from dir(aiohttp) -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9918.
Restored the FlowControlDataQueue class -- by :user:bdraco.

This class is no longer used internally, and will be permanently removed in the next major version.

Related issues and pull requests on GitHub: :issue:9963.

Miscellaneous internal changes

Improved performance of resolving resources when multiple methods are registered for the same route -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9899.

Bug fixes

Fixed improperly closed WebSocket connections generating an unhandled exception -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9883.

Bug fixes

Updated :py:meth:~aiohttp.ClientSession.request to reuse the quote_cookie setting from ClientSession._cookie_jar when processing cookies parameter. -- by :user:Cycloctane.

Related issues and pull requests on GitHub: :issue:10093.
Fixed type of SSLContext for some static type checkers (e.g. pyright).

Related issues and pull requests on GitHub: :issue:10099.
Updated :meth:aiohttp.web.StreamResponse.write annotation to also allow :class:bytearray and :class:memoryview as inputs -- by :user:cdce8p.

Related issues and pull requests on GitHub: :issue:10154.
Fixed a hang where a connection previously used for a streaming download could be returned to the pool in a paused state. -- by :user:javitonino.

Related issues and pull requests on GitHub: :issue:10169.

Features

Enabled ALPN on default SSL contexts. This improves compatibility with some proxies which don't work without this extension. -- by :user:Cycloctane.

Related issues and pull requests on GitHub: :issue:10156.

Miscellaneous internal changes

Fixed an infinite loop that can occur when using aiohttp in combination with async-solipsism_ -- by :user:bmerry.

.. _async-solipsism: https://github.com/bmerry/async-solipsism

Related issues and pull requests on GitHub: :issue:10149.

Bug fixes

Raise :exc:aiohttp.ServerFingerprintMismatch exception on client-side if request through http proxy with mismatching server fingerprint digest: aiohttp.ClientSession(headers=headers, connector=TCPConnector(ssl=aiohttp.Fingerprint(mismatch_digest), trust_env=True).request(...) -- by :user:gangj.

Related issues and pull requests on GitHub: :issue:6652.
Modified websocket :meth:aiohttp.ClientWebSocketResponse.receive_str, :py:meth:aiohttp.ClientWebSocketResponse.receive_bytes, :py:meth:aiohttp.web.WebSocketResponse.receive_str & :py:meth:aiohttp.web.WebSocketResponse.receive_bytes methods to raise new :py:exc:aiohttp.WSMessageTypeError exception, instead of generic :py:exc:TypeError, when websocket messages of incorrect types are received -- by :user:ara-25.

Related issues and pull requests on GitHub: :issue:6800.
Made TestClient.app a Generic so type checkers will know the correct type (avoiding unneeded client.app is not None checks) -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8977.
Fixed the keep-alive connection pool to be FIFO instead of LIFO -- by :user:bdraco.

Keep-alive connections are more likely to be reused before they disconnect.

Related issues and pull requests on GitHub: :issue:9672.

Features

Added strategy parameter to :meth:aiohttp.web.StreamResponse.enable_compression The value of this parameter is passed to the :func:zlib.compressobj function, allowing people to use a more sufficient compression algorithm for their data served by :mod:aiohttp.web -- by :user:shootkin

Related issues and pull requests on GitHub: :issue:6257.
Added server_hostname parameter to ws_connect.

Related issues and pull requests on GitHub: :issue:7941.
Exported :py:class:~aiohttp.ClientWSTimeout to top-level namespace -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8612.
Added secure/httponly/samesite parameters to .del_cookie() -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8956.
Updated :py:class:~aiohttp.ClientSession's auth logic to include default auth only if the request URL's origin matches _base_url; otherwise, the auth will not be included -- by :user:MaximZemskov

Related issues and pull requests on GitHub: :issue:8966, :issue:9466.
Added proxy and proxy_auth parameters to :py:class:~aiohttp.ClientSession -- by :user:meshya.

Related issues and pull requests on GitHub: :issue:9207.
Added default_to_multipart parameter to FormData.

Related issues and pull requests on GitHub: :issue:9335.
Added :py:meth:~aiohttp.ClientWebSocketResponse.send_frame and :py:meth:~aiohttp.web.WebSocketResponse.send_frame for WebSockets -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9348.
Updated :py:class:~aiohttp.ClientSession to support paths in base_url parameter. base_url paths must end with a / -- by :user:Cycloctane.

Related issues and pull requests on GitHub: :issue:9530.
Improved performance of reading WebSocket messages with a Cython implementation -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9543, :issue:9554, :issue:9556, :issue:9558, :issue:9636, :issue:9649, :issue:9781.
Added writer_limit to the :py:class:~aiohttp.web.WebSocketResponse to be able to adjust the limit before the writer forces the buffer to be drained -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9572.
Added an :attr:~aiohttp.abc.AbstractAccessLogger.enabled property to :class:aiohttp.abc.AbstractAccessLogger to dynamically check if logging is enabled -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9822.

Deprecations (removal in next major release)

Deprecate obsolete timeout: float and receive_timeout: Optional[float] in :py:meth:~aiohttp.ClientSession.ws_connect. Change default websocket receive timeout from None to 10.0.

Related issues and pull requests on GitHub: :issue:3945.

Removals and backward incompatible breaking changes

Dropped support for Python 3.8 -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8797.
Increased minimum yarl version to 1.17.0 -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8909, :issue:9079, :issue:9305, :issue:9574.
Removed the is_ipv6_address and is_ip4_address helpers are they are no longer used -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9344.
Changed ClientRequest.connection_key to be a NamedTuple to improve client performance -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9365.
FlowControlDataQueue has been replaced with the WebSocketDataQueue -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9685.
Changed ClientRequest.request_info to be a NamedTuple to improve client performance -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9692.

Packaging updates and notes for downstreams

Switched to using the :mod:propcache <propcache.api> package for property caching -- by :user:bdraco.

The :mod:propcache <propcache.api> package is derived from the property caching code in :mod:yarl and has been broken out to avoid maintaining it for multiple projects.

Related issues and pull requests on GitHub: :issue:9394.
Separated aiohttp.http_websocket into multiple files to make it easier to maintain -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9542, :issue:9552.

Contributor-facing changes

Changed diagram images generator from blockdiag to GraphViz. Generating documentation now requires the GraphViz executable to be included in $PATH or sphinx build configuration.

Related issues and pull requests on GitHub: :issue:9359.

Miscellaneous internal changes

Added flake8 settings to avoid some forms of implicit concatenation. -- by :user:booniepepper.

Related issues and pull requests on GitHub: :issue:7731.
Enabled keep-alive support on proxies (which was originally disabled several years ago) -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8920.
Changed web entry point to not listen on TCP when only a Unix path is passed -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9033.
Disabled automatic retries of failed requests in :class:aiohttp.test_utils.TestClient's client session (which could potentially hide errors in tests) -- by :user:ShubhAgarwal-dev.

Related issues and pull requests on GitHub: :issue:9141.
Changed web keepalive_timeout default to around an hour in order to reduce race conditions on reverse proxies -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9285.
Reduced memory required for stream objects created during the client request lifecycle -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9407.
Improved performance of the internal DataQueue -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9659.
Improved performance of calling receive for WebSockets for the most common message types -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9679.
Replace internal helper methods method_must_be_empty_body and status_code_must_be_empty_body with simple set lookups -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9722.
Improved performance of :py:class:aiohttp.BaseConnector when there is no limit_per_host -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9756.
Improved performance of sending HTTP requests when there is no body -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9757.
Improved performance of the WebsocketWriter when the protocol is not paused -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9796.
Implemented zero copy writes for StreamWriter -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9839.

Bug fixes

Authentication provided by a redirect now takes precedence over provided auth when making requests with the client -- by :user:PLPeeters.

Related issues and pull requests on GitHub: :issue:9436.
Fixed :py:meth:WebSocketResponse.close() <aiohttp.web.WebSocketResponse.close> to discard non-close messages within its timeout window after sending close -- by :user:lenard-mosys.

Related issues and pull requests on GitHub: :issue:9506.
Fixed a deadlock that could occur while attempting to get a new connection slot after a timeout -- by :user:bdraco.

The connector was not cancellation-safe.

Related issues and pull requests on GitHub: :issue:9670, :issue:9671.
Fixed the WebSocket flow control calculation undercounting with multi-byte data -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9686.
Fixed incorrect parsing of chunk extensions with the pure Python parser -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9851.
Fixed system routes polluting the middleware cache -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9852.

Removals and backward incompatible breaking changes

Improved performance of the connector when a connection can be reused -- by :user:bdraco.

If BaseConnector.connect has been subclassed and replaced with custom logic, the ceil_timeout must be added.

Related issues and pull requests on GitHub: :issue:9600.

Miscellaneous internal changes

Improved performance of the client request lifecycle when there are no cookies -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9470.
Improved performance of sending client requests when the writer can finish synchronously -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9485.
Improved performance of serializing HTTP headers -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9603.
Passing enable_cleanup_closed to :py:class:aiohttp.TCPConnector is now ignored on Python 3.12.7+ and 3.13.1+ since the underlying bug that caused asyncio to leak SSL connections has been fixed upstream -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9726, :issue:9736.

Bug fixes

Fixed error messages from :py:class:~aiohttp.resolver.AsyncResolver being swallowed -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9451, :issue:9455.

Features

Added :exc:aiohttp.ClientConnectorDNSError for differentiating DNS resolution errors from other connector errors -- by :user:mstojcevich.

Related issues and pull requests on GitHub: :issue:8455.

Miscellaneous internal changes

Simplified DNS resolution throttling code to reduce chance of race conditions -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9454.

Bug fixes

Fixed proxy headers being used in the ConnectionKey hash when a proxy was not being used -- by :user:bdraco.

If default headers are used, they are also used for proxy headers. This could have led to creating connections that were not needed when one was already available.

Related issues and pull requests on GitHub: :issue:9368.
Widened the type of the trace_request_ctx parameter of :meth:ClientSession.request() <aiohttp.ClientSession.request> and friends -- by :user:layday.

Related issues and pull requests on GitHub: :issue:9397.

Removals and backward incompatible breaking changes

Fixed failure to try next host after single-host connection timeout -- by :user:brettdh.

The default client :class:aiohttp.ClientTimeout params has changed to include a sock_connect timeout of 30 seconds so that this correct behavior happens by default.

Related issues and pull requests on GitHub: :issue:7342.

Miscellaneous internal changes

Improved performance of resolving hosts with Python 3.12+ -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9342.
Reduced memory required for timer objects created during the client request lifecycle -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9406.

Bug fixes

Fixed cancellation leaking upwards on timeout -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9326.

Bug fixes

Fixed assembling the :class:~yarl.URL for web requests when the host contains a non-default port or IPv6 address -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9309.

Miscellaneous internal changes

Improved performance of determining if a URL is absolute -- by :user:bdraco.

The property :attr:~yarl.URL.absolute is more performant than the method URL.is_absolute() and preferred when newer versions of yarl are used.

Related issues and pull requests on GitHub: :issue:9171.
Replaced code that can now be handled by yarl -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9301.

Bug fixes

Added :exc:aiohttp.ClientConnectionResetError. Client code that previously threw :exc:ConnectionResetError will now throw this -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9137.
Fixed an unclosed transport ResourceWarning on web handlers -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8875.
Fixed resolve_host() 'Task was destroyed but is pending' errors -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8967.
Fixed handling of some file-like objects (e.g. tarfile.extractfile()) which raise AttributeError instead of OSError when fileno fails for streaming payload data -- by :user:ReallyReivax.

Related issues and pull requests on GitHub: :issue:6732.
Fixed web router not matching pre-encoded URLs (requires yarl 1.9.6+) -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8898, :issue:9267.
Fixed an error when trying to add a route for multiple methods with a path containing a regex pattern -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8998.
Fixed Response.text when body is a Payload -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:6485.
Fixed compressed requests failing when no body was provided -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9108.
Fixed client incorrectly reusing a connection when the previous message had not been fully sent -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8992.
Fixed race condition that could cause server to close connection incorrectly at keepalive timeout -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9140.
Fixed Python parser chunked handling with multiple Transfer-Encoding values -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8823.
Fixed error handling after 100-continue so server sends 500 response instead of disconnecting -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8876.
Stopped adding a default Content-Type header when response has no content -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8858.
Added support for URL credentials with empty (zero-length) username, e.g. https://:password@host -- by :user:shuckc

Related issues and pull requests on GitHub: :issue:6494.
Stopped logging exceptions from web.run_app() that would be raised regardless -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:6807.
Implemented binding to IPv6 addresses in the pytest server fixture.

Related issues and pull requests on GitHub: :issue:4650.
Fixed the incorrect use of flags for getnameinfo() in the Resolver --by :user:GitNMLee

Link-Local IPv6 addresses can now be handled by the Resolver correctly.

Related issues and pull requests on GitHub: :issue:9032.
Fixed StreamResponse.prepared to return True after EOF is sent -- by :user:arthurdarcet.

Related issues and pull requests on GitHub: :issue:5343.
Changed make_mocked_request() to use empty payload by default -- by :user:rahulnht.

Related issues and pull requests on GitHub: :issue:7167.
Used more precise type for ClientResponseError.headers, fixing some type errors when using them -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8768.
Changed behavior when returning an invalid response to send a 500 response -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8845.
Fixed response reading from closed session to throw an error immediately instead of timing out -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8878.
Fixed CancelledError from one cleanup context stopping other contexts from completing -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8908.
Fixed changing scheme/host in Response.clone() for absolute URLs -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8990.
Fixed Site.name when host is an empty string -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8929.
Updated Python parser to reject messages after a close message, matching C parser behaviour -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9018.
Fixed creation of SSLContext inside of :py:class:aiohttp.TCPConnector with multiple event loops in different threads -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9029.
Fixed (on Python 3.11+) some edge cases where a task cancellation may get incorrectly suppressed -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9030.
Fixed exception information getting lost on HttpProcessingError -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9052.
Fixed If-None-Match not using weak comparison -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9063.
Fixed badly encoded charset crashing when getting response text instead of falling back to charset detector.

Related issues and pull requests on GitHub: :issue:9160.
Rejected \n in reason values to avoid sending broken HTTP messages -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9167.
Changed :py:meth:ClientResponse.raise_for_status() <aiohttp.ClientResponse.raise_for_status> to only release the connection when invoked outside an async with context -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9239.

Features

Improved type on params to match the underlying type allowed by yarl -- by :user:lpetre.

Related issues and pull requests on GitHub: :issue:8564.
Declared Python 3.13 supported -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8748.

Removals and backward incompatible breaking changes

Improved middleware performance -- by :user:bdraco.

The set_current_app method was removed from UrlMappingMatchInfo because it is no longer used, and it was unlikely external caller would ever use it.

Related issues and pull requests on GitHub: :issue:9200.
Increased minimum yarl version to 1.12.0 -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9267.

Improved documentation

Clarified that GracefulExit needs to be handled in AppRunner and ServerRunner when using handle_signals=True. -- by :user:Daste745

Related issues and pull requests on GitHub: :issue:4414.
Clarified that auth parameter in ClientSession will persist and be included with any request to any origin, even during redirects to different origins. -- by :user:MaximZemskov.

Related issues and pull requests on GitHub: :issue:6764.
Clarified which timeout exceptions happen on which timeouts -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8968.
Updated ClientSession parameters to match current code -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8991.

Packaging updates and notes for downstreams

Fixed test_client_session_timeout_zero to not require internet access -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:9004.

Miscellaneous internal changes

Improved performance of making requests when there are no auto headers to skip -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8847.
Exported aiohttp.TraceRequestHeadersSentParams -- by :user:Hadock-is-ok.

Related issues and pull requests on GitHub: :issue:8947.
Avoided tracing overhead in the http writer when there are no active traces -- by user:bdraco.

Related issues and pull requests on GitHub: :issue:9031.
Improved performance of reify Cython implementation -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9054.
Use :meth:URL.extend_query() <yarl.URL.extend_query> to extend query params (requires yarl 1.11.0+) -- by :user:bdraco.

If yarl is older than 1.11.0, the previous slower hand rolled version will be used.

Related issues and pull requests on GitHub: :issue:9068.
Improved performance of checking if a host is an IP Address -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9095.
Significantly improved performance of middlewares -- by :user:bdraco.

The construction of the middleware wrappers is now cached and is built once per handler instead of on every request.

Related issues and pull requests on GitHub: :issue:9158, :issue:9170.
Improved performance of web requests -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9168, :issue:9169, :issue:9172, :issue:9174, :issue:9175, :issue:9241.
Improved performance of starting web requests when there is no response prepare hook -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9173.
Significantly improved performance of expiring cookies -- by :user:bdraco.

Expiring cookies has been redesigned to use :mod:heapq instead of a linear search, to better scale.

Related issues and pull requests on GitHub: :issue:9203.
Significantly sped up filtering cookies -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9204.

Bug fixes

Fixed :meth:aiohttp.ClientResponse.json() not setting status when :exc:aiohttp.ContentTypeError is raised -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8742.

Miscellaneous internal changes

Improved performance of the WebSocket reader -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8736, :issue:8747.

Bug fixes

Fixed decoding base64 chunk in BodyPartReader -- by :user:hyzyla.

Related issues and pull requests on GitHub: :issue:3867.
Fixed a race closing the server-side WebSocket where the close code would not reach the client -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8680.
Fixed unconsumed exceptions raised by the WebSocket heartbeat -- by :user:bdraco.

If the heartbeat ping raised an exception, it would not be consumed and would be logged as an warning.

Related issues and pull requests on GitHub: :issue:8685.
Fixed an edge case in the Python parser when chunk separators happen to align with network chunks -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8720.

Improved documentation

Added aiohttp-apischema to supported libraries -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8700.

Miscellaneous internal changes

Improved performance of starting request handlers with Python 3.12+ -- by :user:bdraco.

This change is a followup to :issue:8661 to make the same optimization for Python 3.12+ where the request is connected.

Related issues and pull requests on GitHub: :issue:8681.

Bug fixes

Fixed multipart reading when stream buffer splits the boundary over several read() calls -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8653.
Fixed :py:class:aiohttp.TCPConnector doing blocking I/O in the event loop to create the SSLContext -- by :user:bdraco.

The blocking I/O would only happen once per verify mode. However, it could cause the event loop to block for a long time if the SSLContext creation is slow, which is more likely during startup when the disk cache is not yet present.

Related issues and pull requests on GitHub: :issue:8672.

Miscellaneous internal changes

Improved performance of :py:meth:~aiohttp.ClientWebSocketResponse.receive and :py:meth:~aiohttp.web.WebSocketResponse.receive when there is no timeout. -- by :user:bdraco.

The timeout context manager is now avoided when there is no timeout as it accounted for up to 50% of the time spent in the :py:meth:~aiohttp.ClientWebSocketResponse.receive and :py:meth:~aiohttp.web.WebSocketResponse.receive methods.

Related issues and pull requests on GitHub: :issue:8660.
Improved performance of starting request handlers with Python 3.12+ -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8661.
Improved performance of HTTP keep-alive checks -- by :user:bdraco.

Previously, when processing a request for a keep-alive connection, the keep-alive check would happen every second; the check is now rescheduled if it fires too early instead.

Related issues and pull requests on GitHub: :issue:8662.
Improved performance of generating random WebSocket mask -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8667.

Bug fixes

Fixed server checks for circular symbolic links to be compatible with Python 3.13 -- by :user:steverep.

Related issues and pull requests on GitHub: :issue:8565.
Fixed request body not being read when ignoring an Upgrade request -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8597.
Fixed an edge case where shutdown would wait for timeout when the handler was already completed -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8611.
Fixed connecting to npipe://, tcp://, and unix:// urls -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8632.
Fixed WebSocket ping tasks being prematurely garbage collected -- by :user:bdraco.

There was a small risk that WebSocket ping tasks would be prematurely garbage collected because the event loop only holds a weak reference to the task. The garbage collection risk has been fixed by holding a strong reference to the task. Additionally, the task is now scheduled eagerly with Python 3.12+ to increase the chance it can be completed immediately and avoid having to hold any references to the task.

Related issues and pull requests on GitHub: :issue:8641.
Fixed incorrectly following symlinks for compressed file variants -- by :user:steverep.

Related issues and pull requests on GitHub: :issue:8652.

Removals and backward incompatible breaking changes

Removed Request.wait_for_disconnection(), which was mistakenly added briefly in 3.10.0 -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8636.

Contributor-facing changes

Fixed monkey patches for Path.stat() and Path.is_dir() for Python 3.13 compatibility -- by :user:steverep.

Related issues and pull requests on GitHub: :issue:8551.

Miscellaneous internal changes

Improved WebSocket performance when messages are sent or received frequently -- by :user:bdraco.

The WebSocket heartbeat scheduling algorithm was improved to reduce the asyncio scheduling overhead by decreasing the number of asyncio.TimerHandle creations and cancellations.

Related issues and pull requests on GitHub: :issue:8608.
Minor improvements to various type annotations -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8634.

Bug fixes

Authentication provided by a redirect now takes precedence over provided auth when making requests with the client -- by :user:PLPeeters.

Related issues and pull requests on GitHub: :issue:9436.
Fixed :py:meth:WebSocketResponse.close() <aiohttp.web.WebSocketResponse.close> to discard non-close messages within its timeout window after sending close -- by :user:lenard-mosys.

Related issues and pull requests on GitHub: :issue:9506.
Fixed a deadlock that could occur while attempting to get a new connection slot after a timeout -- by :user:bdraco.

The connector was not cancellation-safe.

Related issues and pull requests on GitHub: :issue:9670, :issue:9671.
Fixed the WebSocket flow control calculation undercounting with multi-byte data -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9686.
Fixed incorrect parsing of chunk extensions with the pure Python parser -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9851.
Fixed system routes polluting the middleware cache -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9852.

Removals and backward incompatible breaking changes

Improved performance of the connector when a connection can be reused -- by :user:bdraco.

If BaseConnector.connect has been subclassed and replaced with custom logic, the ceil_timeout must be added.

Related issues and pull requests on GitHub: :issue:9600.

Miscellaneous internal changes

Improved performance of the client request lifecycle when there are no cookies -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9470.
Improved performance of sending client requests when the writer can finish synchronously -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9485.
Improved performance of serializing HTTP headers -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9603.
Passing enable_cleanup_closed to :py:class:aiohttp.TCPConnector is now ignored on Python 3.12.7+ and 3.13.1+ since the underlying bug that caused asyncio to leak SSL connections has been fixed upstream -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:9726, :issue:9736.

Bug fixes

Fixed server response headers for Content-Type and Content-Encoding for static compressed files -- by :user:steverep.

Server will now respond with a Content-Type appropriate for the compressed file (e.g. "application/gzip"), and omit the Content-Encoding header. Users should expect that most clients will no longer decompress such responses by default.

Related issues and pull requests on GitHub: :issue:4462.
Fixed duplicate cookie expiration calls in the CookieJar implementation

Related issues and pull requests on GitHub: :issue:7784.
Adjusted FileResponse to check file existence and access when preparing the response -- by :user:steverep.

The :py:class:~aiohttp.web.FileResponse class was modified to respond with 403 Forbidden or 404 Not Found as appropriate. Previously, it would cause a server error if the path did not exist or could not be accessed. Checks for existence, non-regular files, and permissions were expected to be done in the route handler. For static routes, this now permits a compressed file to exist without its uncompressed variant and still be served. In addition, this changes the response status for files without read permission to 403, and for non-regular files from 404 to 403 for consistency.

Related issues and pull requests on GitHub: :issue:8182.
Fixed AsyncResolver to match ThreadedResolver behavior -- by :user:bdraco.

On system with IPv6 support, the :py:class:~aiohttp.resolver.AsyncResolver would not fallback to providing A records when AAAA records were not available. Additionally, unlike the :py:class:~aiohttp.resolver.ThreadedResolver, the :py:class:~aiohttp.resolver.AsyncResolver did not handle link-local addresses correctly.

This change makes the behavior consistent with the :py:class:~aiohttp.resolver.ThreadedResolver.

Related issues and pull requests on GitHub: :issue:8270.
Fixed ws_connect not respecting receive_timeout`` on WS(S) connection. -- by :user:arcivanov`.

Related issues and pull requests on GitHub: :issue:8444.
Removed blocking I/O in the event loop for static resources and refactored exception handling -- by :user:steverep.

File system calls when handling requests for static routes were moved to a separate thread to potentially improve performance. Exception handling was tightened in order to only return 403 Forbidden or 404 Not Found responses for expected scenarios; 500 Internal Server Error would be returned for any unknown errors.

Related issues and pull requests on GitHub: :issue:8507.

Features

Added a Request.wait_for_disconnection() method, as means of allowing request handlers to be notified of premature client disconnections.

Related issues and pull requests on GitHub: :issue:2492.
Added 5 new exceptions: :py:exc:~aiohttp.InvalidUrlClientError, :py:exc:~aiohttp.RedirectClientError, :py:exc:~aiohttp.NonHttpUrlClientError, :py:exc:~aiohttp.InvalidUrlRedirectClientError, :py:exc:~aiohttp.NonHttpUrlRedirectClientError

:py:exc:~aiohttp.InvalidUrlRedirectClientError, :py:exc:~aiohttp.NonHttpUrlRedirectClientError are raised instead of :py:exc:ValueError or :py:exc:~aiohttp.InvalidURL when the redirect URL is invalid. Classes :py:exc:~aiohttp.InvalidUrlClientError, :py:exc:~aiohttp.RedirectClientError, :py:exc:~aiohttp.NonHttpUrlClientError are base for them.

The :py:exc:~aiohttp.InvalidURL now exposes a description property with the text explanation of the error details.

-- by :user:setla, :user:AraHaan, and :user:bdraco

Related issues and pull requests on GitHub: :issue:2507, :issue:3315, :issue:6722, :issue:8481, :issue:8482.
Added a feature to retry closed connections automatically for idempotent methods. -- by :user:Dreamsorcerer

Related issues and pull requests on GitHub: :issue:7297.

Implemented filter_cookies() with domain-matching and path-matching on the keys, instead of testing every single cookie. This may break existing cookies that have been saved with CookieJar.save(). Cookies can be migrated with this script::

import pickle
with file_path.open("rb") as f:
    cookies = pickle.load(f)

morsels = [(name, m) for c in cookies.values() for name, m in c.items()]
cookies.clear()
for name, m in morsels:
    cookies[(m["domain"], m["path"].rstrip("/"))][name] = m

with file_path.open("wb") as f:
    pickle.dump(cookies, f, pickle.HIGHEST_PROTOCOL)

Related issues and pull requests on GitHub: :issue:7583, :issue:8535.

Separated connection and socket timeout errors, from ServerTimeoutError.

Related issues and pull requests on GitHub: :issue:7801.
Implemented happy eyeballs

Related issues and pull requests on GitHub: :issue:7954.
Added server capability to check for static files with Brotli compression via a .br extension -- by :user:steverep.

Related issues and pull requests on GitHub: :issue:8062.

Removals and backward incompatible breaking changes

The shutdown logic in 3.9 waited on all tasks, which caused issues with some libraries. In 3.10 we've changed this logic to only wait on request handlers. This means that it's important for developers to correctly handle the lifecycle of background tasks using a library such as aiojobs. If an application is using handler_cancellation=True then it is also a good idea to ensure that any :func:asyncio.shield calls are replaced with :func:aiojobs.aiohttp.shield.

Please read the updated documentation on these points:
https://docs.aiohttp.org/en/stable/web_advanced.html#graceful-shutdown
https://docs.aiohttp.org/en/stable/web_advanced.html#web-handler-cancellation

-- by :user:Dreamsorcerer

Related issues and pull requests on GitHub: :issue:8495.

Improved documentation

Added documentation for aiohttp.web.FileResponse.

Related issues and pull requests on GitHub: :issue:3958.
Improved the docs for the ssl params.

Related issues and pull requests on GitHub: :issue:8403.

Contributor-facing changes

Enabled HTTP parser tests originally intended for 3.9.2 release -- by :user:pajod.

Related issues and pull requests on GitHub: :issue:8088.

Miscellaneous internal changes

Improved URL handler resolution time by indexing resources in the UrlDispatcher. For applications with a large number of handlers, this should increase performance significantly. -- by :user:bdraco

Related issues and pull requests on GitHub: :issue:7829.
Added nacl_middleware <https://github.com/CosmicDNA/nacl_middleware>_ to the list of middlewares in the third party section of the documentation.

Related issues and pull requests on GitHub: :issue:8346.
Minor improvements to static typing -- by :user:Dreamsorcerer.

Related issues and pull requests on GitHub: :issue:8364.
Added a 3.11-specific overloads to ClientSession -- by :user:max-muoto.

Related issues and pull requests on GitHub: :issue:8463.
Simplified path checks for UrlDispatcher.add_static() method -- by :user:steverep.

Related issues and pull requests on GitHub: :issue:8491.
Avoided creating a future on every websocket receive -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8498.
Updated identity checks for all WSMsgType type compares -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8501.
When using Python 3.12 or later, the writer is no longer scheduled on the event loop if it can finish synchronously. Avoiding event loop scheduling reduces latency and improves performance. -- by :user:bdraco.

Related issues and pull requests on GitHub: :issue:8510.
Restored :py:class:~aiohttp.resolver.AsyncResolver to be the default resolver. -- by :user:bdraco.

:py:class:~aiohttp.resolver.AsyncResolver was disabled by default because of IPv6 compatibility issues. These issues have been resolved and :py:class:~aiohttp.resolver.AsyncResolver is again now the default resolver.

Related issues and pull requests on GitHub: :issue:8522.

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻️ Rebasing: Whenever MR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this MR and you won't be reminded about this update again.

If you want to rebase/retry this MR, check this box

This MR has been generated by Renovate Bot.

Edited Dec 19, 2024 by igswsihw-wmadepbot

Update dependency aiohttp to v3.11.11

Release Notes

Bug fixes

Features

Miscellaneous internal changes

Bug fixes

Bug fixes

Miscellaneous internal changes

Miscellaneous internal changes

Bug fixes

Miscellaneous internal changes

Bug fixes

Bug fixes

Bug fixes

Miscellaneous internal changes

Bug fixes

Miscellaneous internal changes

Bug fixes

Bug fixes

Features

Miscellaneous internal changes

Bug fixes

Features

Deprecations (removal in next major release)

Removals and backward incompatible breaking changes

Packaging updates and notes for downstreams

Contributor-facing changes

Miscellaneous internal changes

Bug fixes

Removals and backward incompatible breaking changes

Miscellaneous internal changes

Bug fixes

Features

Miscellaneous internal changes

Bug fixes

Removals and backward incompatible breaking changes

Miscellaneous internal changes

Bug fixes

Bug fixes

Miscellaneous internal changes

Bug fixes

Features

Removals and backward incompatible breaking changes

Improved documentation

Packaging updates and notes for downstreams

Miscellaneous internal changes

Bug fixes

Miscellaneous internal changes

Bug fixes

Improved documentation

Miscellaneous internal changes

Bug fixes

Miscellaneous internal changes

Bug fixes

Removals and backward incompatible breaking changes

Contributor-facing changes

Miscellaneous internal changes

Bug fixes

Removals and backward incompatible breaking changes

Miscellaneous internal changes

Bug fixes

Features

Removals and backward incompatible breaking changes

Improved documentation

Contributor-facing changes

Miscellaneous internal changes

Configuration

Merge request reports