Skip to content
This repository has been archived by the owner on Nov 3, 2022. It is now read-only.

Latest commit

 

History

History
61 lines (43 loc) · 2.28 KB

troubleshooting.md

File metadata and controls

61 lines (43 loc) · 2.28 KB
Raw

Troubleshooting

Failing Jenkins builds

We have detailed guidance to help with debugging the reason for a Jenkins failure inside the docs folder.

Additionally, if you are making a change to an E2E tested application which requires a change one of these tests, we have detailed guidance on how to achieve that.

Dealing with a flaky test

As this is a testing library, whose value correlates to the level of trust in it, it is important to keep these tests as trustworthy as possible. A flaky test can erode this trust.

Once you are confident a test is flakey, you can stop it failing the build while you investigate a potential fix. Use the flaky: true flag for this e.g.

scenario "Change note on a Countryside Stewardship Grant", flaky: true do
  ...
end

Use RetryHelpers to cope with pages that are slow to update, and page-specific assertions to ensure the assertions that follow are checking the page you expect.

Manually running containers

  • Run programs within containers using docker-compose: docker-compose run publishing-e2e-tests bundle exec rspec
  • Get shell access to a given container: docker-compose run specialist-frontend bash
  • Kill the containers and move on with your life: docker-compose down

Gotchas

Docker disk space

Docker limits the amount of disk space it uses. This sometimes results in rather opaque errors when you try and run tasks - generally related to errors installing Mongo or Postres. One example is Moped::Errors::ConnectionFailure: Could not connect to a primary node for replica set.

The most reliable way to fix this is to find and remove unnecessary Docker containers and images.

docker rmi $(docker images -f dangling=true -q)
docker volume rm $(docker volume ls -q -f dangling=true)

Docker for Mac will start comsuming vast amounts of CPU when it isn't given enough RAM. If you find the apps aren't booting within the 60 second timeout then I'd recommend increasing the memory limit by at least 1GB.