Skip to content

Enable random order of the integration tests #640

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
php-coder opened this issue Sep 24, 2017 · 3 comments
Open

Enable random order of the integration tests #640

php-coder opened this issue Sep 24, 2017 · 3 comments
Assignees
Milestone

Comments

@php-coder
Copy link
Owner

http://robotframework.org/MavenPlugin/run-mojo.html#randomize

@php-coder php-coder added this to the 0.4 milestone Sep 24, 2017
@php-coder php-coder self-assigned this Sep 24, 2017
@php-coder
Copy link
Owner Author

php-coder commented Sep 24, 2017

When I enabled randomization of suite, all tests passed.

@php-coder
Copy link
Owner Author

php-coder commented Sep 24, 2017

With randomization mode all the following tests are failing:

  • Create participant with blank required fields (the message: The text of element 'id=name.errors' should have been 'Value must not be empty', but it was 'Value is greater than allowable maximum of 50 characters')
  • Create category with name in English (the message: The text of element 'id=msg-success' should have been 'Category has been added. Now you could proceed with creating series.', but it was 'Категория добавлена. Теперь вы можете создать серию.')

@php-coder
Copy link
Owner Author

Enabling random order for the tests that test for submitting a form with only required fields is tricky. In this case it's possible that the field is non-empty and contains a value from other test.

php-coder added a commit that referenced this issue Sep 24, 2017
@php-coder php-coder modified the milestones: 0.4, 0.5 Oct 2, 2017
@php-coder php-coder modified the milestones: 0.5, next Apr 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant