Skip to content

devfile-web e2e testing fails on documentation updates #1573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
michael-valdron opened this issue May 31, 2024 · 0 comments · Fixed by devfile/devfile-web#131
Closed

devfile-web e2e testing fails on documentation updates #1573

michael-valdron opened this issue May 31, 2024 · 0 comments · Fixed by devfile/devfile-web#131
Assignees
Labels
area/landing-page Issues with the Landing Page kind/bug Something isn't working severity/blocker Issues that prevent developers from working

Comments

@michael-valdron
Copy link
Member

/kind bug

Which area is this bug related to?

/area landing-page

What versions of software are you using?

Node.js project

Operating System and version: Fedora 39

Node.js version: 18

Yarn version: 1.22.19

Project.json: N/A

Bug Summary

Describe the bug:

The e2e test check fails to pass if a PR is opened with doc page changes, the cause is the links check fails due to the Eclipse domain switch from eclipse.org to eclipse.dev. Though the old domain redirects to the new one, the check is considers this a broken URL.

To Reproduce:

  1. Make a change to a doc page on your local branch
  2. Install dependencies on your local workspace yarn install
  3. Run yarn nx affected --target=e2e --configuration=production --parallel=1

Expected behavior

The e2e testing should pass if all changes given in the PR are valid, e.g. no broken links.

Any logs, error output, screenshots etc? Provide the devfile that sees this bug, if applicable

E2E error

-  /home/runner/work/devfile-web/devfile-web/dist/cypress/apps/landing-page-e2e/scr     (1280x720)
     eenshots/app.cy.ts/Docs -- Version 2.0.0 -- Section Get started -- Page Quick st               
     art with Eclipse Che -- has valid links (failed).png                                           
-  /home/runner/work/devfile-web/devfile-web/dist/cypress/apps/landing-page-e2e/scr     (1280x720)
     eenshots/app.cy.ts/Docs -- Version 2.0.0 -- Section Get started -- Page Developi               
     ng with devfiles -- has valid links (failed).png

Note: Error is misleading, the pages mentioned are correct however it is not image links that are failing to pass, its the eclipse.org links. See my comment for context.

Additional context

Any workaround?

Trivial fix is to update all eclipse.org links:

Suggestion on how to fix the bug

I would say the workaround (trivial fix) is good enough to resolve this, however if we intend this to fail test case only if the links are broken, an investigation into how to consider redirect status as a valid test expectation is recommended.

@openshift-ci openshift-ci bot added kind/bug Something isn't working area/landing-page Issues with the Landing Page labels May 31, 2024
@michael-valdron michael-valdron moved this to Refinement in Devfile Project May 31, 2024
@michael-valdron michael-valdron added the severity/blocker Issues that prevent developers from working label May 31, 2024
@Jdubrick Jdubrick moved this from Refinement to Backlog in Devfile Project Jul 3, 2024
@Jdubrick Jdubrick self-assigned this Jul 23, 2024
@Jdubrick Jdubrick moved this from Backlog to To Do 📝 in Devfile Project Jul 23, 2024
@Jdubrick Jdubrick moved this from To Do 📝 to In Review 👀 in Devfile Project Jul 23, 2024
@github-project-automation github-project-automation bot moved this from In Review 👀 to Done ✅ in Devfile Project Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/landing-page Issues with the Landing Page kind/bug Something isn't working severity/blocker Issues that prevent developers from working
Projects
Status: Done ✅
Development

Successfully merging a pull request may close this issue.

2 participants