-
-
Notifications
You must be signed in to change notification settings - Fork 32.5k
Open
Labels
stdlibPython modules in the Lib dirPython modules in the Lib dirtype-bugAn unexpected behavior, bug, or errorAn unexpected behavior, bug, or error
Description
Bug report
The update to the invalidation counter is not thread-safe and can lose updates in some Python implementations:
Failures seen on:
- Python 3.14t
- Python 3.9
- pypy3.10
- pypy3.11
But not on Python 3.10-3.14 with GIL due to limited GIL switch opportunities.
Lines 54 to 70 in 05e89c3
def register(cls, subclass): | |
"""Register a virtual subclass of an ABC. | |
Returns the subclass, to allow usage as a class decorator. | |
""" | |
if not isinstance(subclass, type): | |
raise TypeError("Can only register classes") | |
if issubclass(subclass, cls): | |
return subclass # Already a subclass | |
# Subtle: test for cycles *after* testing for "already a subclass"; | |
# this means we allow X.register(X) and interpret it as a no-op. | |
if issubclass(cls, subclass): | |
# This would create a cycle, which is bad for the algorithm below | |
raise RuntimeError("Refusing to create an inheritance cycle") | |
cls._abc_registry.add(subclass) | |
ABCMeta._abc_invalidation_counter += 1 # Invalidate negative cache | |
return subclass |
For example, consider the following repro, adapted from test_abc.test_registration_basics
:
import _py_abc as abc # Use Python implementation of ABCs!!
import threading
import os
import sys
sys.setswitchinterval(1e-6)
N = 5
def run(b):
b.wait()
class A(metaclass=abc.ABCMeta):
pass
A.register(int)
if not isinstance(42, A):
print("Oops!")
os._exit(1)
def main():
for _ in range(10000):
threads = []
b = threading.Barrier(N)
for _ in range(N):
t = threading.Thread(target=run, args=(b,))
threads.append(t)
t.start()
for t in threads:
t.join()
if __name__ == "__main__":
main()
Linked PRs
Metadata
Metadata
Assignees
Labels
stdlibPython modules in the Lib dirPython modules in the Lib dirtype-bugAn unexpected behavior, bug, or errorAn unexpected behavior, bug, or error