Skip to content

Isolate the "create editor with keyboard" freetext editor integration tests #19711

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

timvandermeij
Copy link
Contributor

@timvandermeij timvandermeij commented Mar 23, 2025

This commit reduces the number of freetext editor integration test suite failures, in full isolation, from 6 to 5 by fixing the following issues in the "create editor with keyboard" block:

  • The second test relied on the first test to enable freetext editing mode and put focus on the page (annotation layer). For isolation we now do that explicitly in the second test.
  • The second test relied on the first test for the editor numbering. For isolation we change the editor numbering to the one after initial document load.

Moreover, the test names have been updated to clarify with scenario is being tested, which came up during comparison of the changes against commit ea5eafa to make sure that we are still testing the originally intended scenarios (confirmed by disabling the relevant code from the commit per scenario and noticing the corresponding test failing).

Fixes a part of #19065.

Note that this should also reduce the number of test failures in case of intermittent failures. If the first test failed previously, the second test would automatically fail too, whereas now the second test can pass because it's run independently of the first test. This should avoid the double failures as seen in e.g. http://54.241.84.105:8877/be83f9ee48219b6/output.txt.

… tests

This commit reduces the number of freetext editor integration test suite
failures, in full isolation, from 6 to 5 by fixing the following issues
in the "create editor with keyboard" block:

- The second test relied on the first test to enable freetext editing
  mode and put focus on the page (annotation layer). For isolation we
  now do that explicitly in the second test.
- The second test relied on the first test for the editor numbering. For
  isolation we change the editor numbering to the one after initial
  document load.

Moreover, the test names have been updated to clarify with scenario is
being tested, which came up during comparison of the changes against
commit ea5eafa to make sure that we are still testing the originally
intended scenarios (confirmed by disabling the relevant code from the
commit per scenario and noticing the corresponding test failing).
@timvandermeij
Copy link
Contributor Author

/botio integrationtest

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/27b506dc7e847ea/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.193.163.58:8877/1d4dc03748646c0/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/27b506dc7e847ea/output.txt

Total script time: 11.95 mins

  • Integration Tests: Passed

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Success

Full output at http://54.193.163.58:8877/1d4dc03748646c0/output.txt

Total script time: 27.99 mins

  • Integration Tests: Passed

Copy link
Collaborator

@Snuffleupagus Snuffleupagus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

r=me, thank you.

@timvandermeij timvandermeij merged commit 19b4ada into mozilla:master Mar 23, 2025
7 checks passed
@timvandermeij timvandermeij deleted the integration-tests-freetext-isolate-part-2 branch March 23, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants