Only Run Test Discovery for Specific File On Save

[eleanorjboyd]

Currently there is a setting which allows a user to select either run test discovery on save or not: "python.testing.autoTestDiscoverOnSaveEnabled": true. The two values are true and false, with true then every time a file in the editor is saved, test discovery is run and with false it is never run on save.

For large repos, these two options offer limited selection in terms of functionality. Instead we should offer that test discovery only be performed on the specific file that save was executed on. Therefore we will not re-run discovery on the whole repo as often, which can be a time-intensive especially for large repos.

This feature would add a setting, or modify the existing setting to add another option, to allow to user to specify that they only want discovery to be performed on the specific file on save.

[github-actions]

Thanks for the feature request! We are going to give the community 60 days from when this issue was created to provide 7 👍 upvotes on the opening comment to gauge general interest in this idea. If there's enough upvotes then we will consider this feature request in our future planning. If there's unfortunately not enough upvotes then we will close this issue.

[eleanorjboyd]

@shanewazabbas, here is the code that would be needed to get per file discovery on save. I was writing up how to do it and in doing so realized it was more complicated and did some of it myself to test the feasibility. Put this PR together as an example. It definitely needs some refinement to handle other edge cases. Here is the PR if you want to review and ill speak with my team on what a timeline for this could look like. Thanks

https://github.com/eleanorjboyd/vscode-python/pull/23/files

[shanewazabbas]

Awesome Thanks, @eleanorjboyd. I'll take a look tomorrow, was busy with work all day today, so haven't had time.

[eleanorjboyd]

realized we already have a long-running issue for this in our backlog. Closing this issue in favor of #4586. Move to the new thread for further discussion. Thanks

[eleanorjboyd]

@shanewazabbas, I wanted to check in here, did you want to work on this (im forgetting if we discussed this earlier)? I could guide you a bit as I do not have the bandwidth right now to prioritize this issue to do myself. Otherwise I can come back to it in a few months. Thanks!