Request routing is inconsistent when running A/B tests
ID: 931246
Backlog
Published on 11/8/2023
•
Last update on 11/8/2023
Summary
Store navigation HTTP requests do not honor the workspace selection cookie during the session. In fact, during a single session, a user can receive responses from all workspaces being tested.
Simulation
- Create an A/B test in your store using the VTEX IO CLI
- Open the "Application" tab in Chrome DevTools (or equivalent in your browser)
- Navigate through the store and clear your
VtexWorkspace
cookie after every click - You should see values change eventually, even though the session cookie did not change
- Navigate through the store and clear your
- Open the "Network" tab in Chrome DevTools (or equivalent in your browser)
- Navigate through the store and observe the HTTP requests that are made
- You should see that the
workspace
query string is set to different values throughout the session
Workaround
There is no workaround available. A/B testing is not recommended and their results should not be considered correct until this Known Issue is fixed.