🛠 Tooling: Investigate performance improvements for end-to-end scripts in CI

[JoshuaKGoldberg]

Bug Report Checklist

• I have tried restarting my IDE and the issue persists.
• I have pulled the latest main branch of the repository.
• I have searched for related issues and found none that matched my issue.

Overview

Right now, this repo has three "end-to-end" scripts that run in CI (one for each of the "setup" scripts):

• Create: typically around 2-2.5 minutes in total
• Initialize: typically around 2-2.5 minutes in total
• Migrate: typically around 4-5 minutes in total

5 minutes in CI is way too long for a terminal app like this! Especially since test coverage merges in coverage results from all those scripts.

Can they be sped up? Is there any caching that can be done, maybe? Or is there a slowdown in a dependency that can be resolved?

Additional Info

I suspect that reducing log spam will help with this issue a lot: #859. Even if the log spam isn't hurting performance, reducing spam will likely make investigating easier.

[JoshuaKGoldberg]

After resolving #1131 and #1221, they seem to be taking 1.5-2 minutes now. Progress!

[JoshuaKGoldberg]

As of #1610 (and before it, even), things are down to 1-1.5 minutes. Progress!

[JoshuaKGoldberg]

I put some logs in migration:

[Tue Dec 03 2024 14:59:50 GMT-0500 (Eastern Standard Time)] Starting command: pnpm build

[Tue Dec 03 2024 15:01:03 GMT-0500 (Eastern Standard Time)] Ending command: pnpm build

[Tue Dec 03 2024 15:01:03 GMT-0500 (Eastern Standard Time)] Starting command: pnpm lint --fix

[Tue Dec 03 2024 15:01:19 GMT-0500 (Eastern Standard Time)] Starting command: pnpm format --write

[Tue Dec 03 2024 15:01:22 GMT-0500 (Eastern Standard Time)] Ending command: pnpm format --write

Interesting that pnpm build is taking so long...

• pnpm build 17.83s user 2.51s system 149% cpu 13.649 total
• pnpm tsc 3.70s user 0.26s system 182% cpu 2.170 total

[JoshuaKGoldberg]

This will likely be superceded by #1782.