shutil.rmtree() FileNotFoundError race condition

[websurfer5]

BPO	37260
Nosy	@giampaolo, @tarekziade, @websurfer5, @iritkatriel
PRs	gh-81441: shutil.rmtree() FileNotFoundError race condition #14064

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2019-06-13.01:10:41.338>
labels = ['3.8', '3.7', 'library', '3.9']
title = 'shutil.rmtree() FileNotFoundError race condition'
updated_at = <Date 2021-06-20.14:54:37.725>
user = 'https://github.com/websurfer5'

bugs.python.org fields:

activity = <Date 2021-06-20.14:54:37.725>
actor = 'iritkatriel'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2019-06-13.01:10:41.338>
creator = 'Jeffrey.Kintscher'
dependencies = []
files = []
hgrepos = []
issue_num = 37260
keywords = ['patch']
message_count = 3.0
messages = ['345445', '345719', '396176']
nosy_count = 4.0
nosy_names = ['giampaolo.rodola', 'tarek', 'Jeffrey.Kintscher', 'iritkatriel']
pr_nums = ['14064']
priority = 'normal'
resolution = None
stage = 'patch review'
status = 'open'
superseder = None
type = None
url = 'https://bugs.python.org/issue37260'
versions = ['Python 3.7', 'Python 3.8', 'Python 3.9']

[websurfer5]

shutil.rmtree() is susceptible to a race condition that can needlessly raise OSError:

1. os.scandir() returns the list of entries in a directory
2. while iterating over the list, another thread or process deletes one or more of the entries not yet iterated
3. os.unlink() or stat() raises OSError for the already deleted entry

It should check for and ignore, at a minimum, FileNotFoundError because we were going to delete the entry anyways. For comparison, the 'rm -r' shell command handles this race condition by ignoring entries deleted from under it.

I will submit a PR when I work out some test cases to include.

[websurfer5]

The PR is ready for review.

[iritkatriel]

see also bpo-29699