-
Notifications
You must be signed in to change notification settings - Fork 1
Add UAT script for gross error checks when changing the CMP #214
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,114 @@ | ||
| # Introduction | ||
|
|
||
| This document contains common User Acceptance Test (UAT) scripts that can be | ||
| used to verify the functionality of the CMP user interface and data model. These | ||
| scripts do not directly test the underlying data storage layer. They are | ||
| intended as a manual gross error check when making general changes. Specific | ||
| scripts should be used for specific functional changes. | ||
|
|
||
| In this document “Global” refers to OneKey scope, and “Local” to the specific | ||
| web site only. | ||
|
|
||
| # Scripts | ||
|
|
||
| The following scripts always start with a desktop or laptop English language web | ||
| browser in private browsing mode with no cookies present from any web site and | ||
| entering the URL `https://www.pafdemopublisher.com/`. | ||
|
|
||
| ## Personalized Marketing Global - Full Test | ||
|
|
||
| Checks the common OneKey global scope scenarios. | ||
|
|
||
| - Select the OneKey logo in the top left-hand corner and verify that the | ||
| “Learn more” card is displayed. | ||
| - Select the “Back” button to return to the settings card. | ||
| - Select the option “turn on personalized marketing”. | ||
| - Check that the “Your browsing ID” value is displayed immediately. Record the | ||
| value shown to the right. | ||
| - Select “Save” button. | ||
| - Refresh the web browser (typically using Ctrl + F5 keyboard shortcut). | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Note: not working today, fixed in #220 |
||
| - Check that the snackbar appears at the bottom of the page. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Actually, no. The snackbard should only show when the refresh from global changes the local values (for example, I changed my settings on website B and return to website A), not all the time (typically not after a refresh). |
||
| - Check that the snackbar disappears after approximately 5 seconds. | ||
| - Refresh the web browser. | ||
| - Select the “Review your preferences” link from the snackbar before it | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Since the snackbar should not be displayed (see my previous comment), this should be part of another test scenario, or it should go with the "marketing preferences" link on the page |
||
| disappears. | ||
| - Verify that “turn on personalized marketing” is selected. | ||
| - Verify that the “Your browsing ID” matches the value shown earlier. | ||
| - Select the “Your browsing ID” text and verify that the value changes and the | ||
| “Save” button becomes enabled. Record the new value shown. | ||
| - Select the “Save” button. | ||
| - When the snackbar reappears select “Review your preference”. | ||
| - Verify that the new value for “Your browsing ID” is displayed. | ||
|
|
||
| ### Variations | ||
|
|
||
| - Replace “personalized” with “standard”. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Maybe suggest to run the tests with or without 3PC supported |
||
|
|
||
|  | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. It would be more clear if this gif was in the previous paragraph since it describes the full scenario (with personalized marketing) |
||
|
|
||
| ## Refuse All | ||
|
|
||
| Checks that the refuse all option works. | ||
|
|
||
| - Select the “Refuse All” button. | ||
| - Refresh the web browser. | ||
| - Verify that no OneKey snackbar is displayed. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I think a more relevant check would be to click "marketing preferences" and verify that no option is selected. |
||
|
|
||
| ## Personalized Marketing Local – Customized | ||
|
|
||
| Checks the customized this site only data is retained and displayed correctly. | ||
|
|
||
| - Select the option “turn on personalized marketing”. | ||
| - Select “customize your experience”. | ||
| - Verify that the heading of the card displays “Personalized marketing”. | ||
| - Verify the two toggles at the bottom of the card are set to on and can’t be | ||
| turned off. | ||
| - Change the “Measure content performance” toggle to off. | ||
| - Verify that the heading of the card displays “Standard marketing”. | ||
| - Change the “Measure content performance” toggle to on. | ||
| - Verify that the heading of the card displays “Personalized marketing”. | ||
| - Select the “Back” button. | ||
| - Verify that the “Ask for preferences on each site I visit” toggle is off. | ||
| - Select “customize your experience”. | ||
| - Change the “Measure ad performance” toggle to off. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Suggestion: make the "ad" bold, to avoid confusion with "content" (I made the confusion first) |
||
| - Verify the heading of the card displays “Site specific marketing”. | ||
| - Select the “Back” button. | ||
| - Verify that the “Ask for preferences on each site I visit” toggle is on and | ||
| cannot be changed to off. | ||
| - Select the “Save” button. | ||
| - Verify that the snackbar does not appear. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. not relevant: should be displayed |
||
| - Scroll to the bottom of the web page and select “Marketing preferences”. | ||
| - Verify that the “Ask for preferences on each site I visit” toggle is on and | ||
| cannot be changed to off. | ||
| - Select “customize your experience”. | ||
| - Verify that only the “Measure ad performance” toggle is set to off. | ||
|
|
||
| ### Variations | ||
|
|
||
| - Replace “personalized” with “standard”. | ||
| - Use combinations of other customized toggle options. | ||
| - Cancel the dialogue to verify that changes are not saved. | ||
|
|
||
|  | ||
|
|
||
| ## Snackbar Global Personalized to Standard Change | ||
|
|
||
| Checks that the user can change from personalized to standard marketing without | ||
| the ID being reset. | ||
|
|
||
| - Select the option “turn on personalized marketing”. | ||
| - Check that the “Your browsing ID” value is displayed immediately. Record the | ||
| value shown to the right. | ||
| - Select “Save” button. | ||
| - Refresh the web browser. | ||
| - Select the “Review your preferences” link from the snackbar before it | ||
| disappears. | ||
| - Select the option “turn on standard marketing”. | ||
| - Select “Save” button. | ||
| - Refresh the web browser. | ||
| - Select the “Review your preferences” link from the snackbar before it | ||
| disappears. | ||
| - Check that “turn on standard marketing” is now the selected option. | ||
| - Check that the “Your browsing ID” value is the same that displayed earlier. | ||
|
|
||
|  | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Suggestion: check that the "save" button is disabled before, and enabled after