Table of contents

This is for internal use by the PaaS team. Public-facing documentation is located at docs.cloud.service.gov.uk.

Working practices

These are guidelines, not rules

We’ve found these working practices highly effective, but they’re a living document open to discussion and change. They won’t necessarily work for everyone without some adjustment. If something doesn’t seem to be working for you, it’s OK to challenge that and ask for things to improve.

For our wider cultural practices, see the GDS It’s OK poster. For instance it’s okay to ask for help, it’s okay to have quiet days, and many other things.

Development process

Illustration of changes being promoted to prod

  • The Product Manager makes decisions on what work (features, bugs) is prioritised
  • The team make the necessary changes in their own development environments and branches
  • The changes are reviewed by an engineer
  • The reviewer merges the changes into the master branch of the repository
  • The latest revision of the code is automatically tested on staging using the Cloud Foundry smoke and acceptance tests to ensure that basic user functions still work.
  • The changes are deployed to the production environment.

The diagram below shows how this process is implemented using git tags. It does not show some planned improvements, such as using git commit signatures to ensure that commits have been reviewed before deploying them.

Sequence of events promoting a release

Full size version

Pairing

We pair on all stories to ensure that people don’t get stuck on the same types of work and that there is a good distribution of knowledge across the team. We aim to rotate pairs regularly by:

  • changing pairs when you’ve been on a story for more than 2 days

  • joining someone on an existing story that doesn’t have a pair instead of picking up new work

We don’t insist on a particular method of pairing. We’re keen to have two people making decisions and aware of the story, but there are lots of ways those two people can work together. Sometimes a pair shares one computer; other times a pair splits stories into pieces they can work on individually. Discuss what works for both of you.

Commit messages

Commit messages are very useful as documentation, so please take time to detail what you are changing and more importantly why. The GDS git style guide explains this in more detail.

If something is worth detailing in a pull request description then it is also worth detailing in a commit message. Commit messages will live with the repository forever and can be discovered using git pickaxe, whereas over time a project may move from GitHub or Pivotal Tracker. You can often copy/paste well written commit messages to form the pull request description.

Creating and forking repos

Nearly all of our code repos are public on GitHub.com because we are coding in the open. There is an exception to this, where a public repo could risk leaking sensitive information. When creating or forking a new repo you will need to do the following. If you’re a contractor then you’ll need to ask a permanent member of the team to do this for you:

  1. Prefix the name with paas- so that it’s easier to find. This includes forks of third-party repos which will need to be renamed after forking, for example cf-release would become paas-cf-release.
  2. Add the Pivotal Tracker service integration/hook. You will need to take the API key from the “Profile” page of your own account.
  3. Add the following teams:
    1. [team] Government PaaS readonly: the dashboard user which has org:read privileges to find all of our repos.
    2. [team] Government PaaS - People: all members of the team that are contractors and aren’t members of the owners team. These should be given write access.

We should never pull request against the master branch of a forked repo. Doing so makes it very hard to reconcile our changes against the upstream repo at a later date. We should aim to submit all changes upstream. It may be appropriate to run against a branch of our fork for a limited period of time. We have decided to use a branch called gds_master for this, although some older repositories may use something else. Feel free to change these as you encounter them, to improve consistency.

Pull requests

We peer review all code to ensure that it works as expected and is clear for the team to understand. All work, no matter how small, should use git branches and GitHub pull requests. Anna’s blog post explains how to raise a good pull request.

When you create a pull request please:

  • use this template for the description so that it is easier for the reviewer to understand and test your changes

  • prefix the subject with the story ID from Pivotal Tracker (format: [#12345678] My pull request) so that we have a record of all the changes for a given story

  • put the pull request URL into the Pivotal Tracker story so that people can find it and understand the progress of a story before it is merged

There is a dashboard near our desks that displays open pull requests using Fourth Wall. Reviewing outstanding pull requests should be a priority over picking up new work. As the author of a pull request you may still need to chase this and you need to watch your email for comments on your pull request. Pull requests should be reviewed by somebody that hasn’t already worked on the story. When reviewing a pull request please “assign” yourself on GitHub, so that someone else doesn’t duplicate effort.

Merging Pull requests

Once review is complete, and all status checks have passed (Travis etc), a pull request can be merged.

PRs to the paas-cf and paas-bootstrap repositories should be merged using a GPG signed commit. This means that merges can’t be done in the Github UI - they have to be done locally, using the merge_pr make task in each repository.

We only use signed revisions of paas-cf and paas-bootstrap from our concourse pipelines. This is enforced by the gpg functionality in Concourse Git resource. We may require signing merges in other repositories in future.

Managing allowed signers

For every repository we are forcing commit signing on there will be a file called ’.gpg-id’ in the root directory. It should contain the public key IDs of every key which is allowed to sign commits. There will also be a helper script for generating the necessary vars file for Concourse. For example:

cd paas-cf
make update_merge_keys

Run the helper script and commit the changes every time you change the contents of ’.gpg-id’.

Initial setup for signing commits

Ensure you have gpg setup on your machine (see our GPG guide for details).

By default, git will look for a secret key in your local keyring that exactly matches your configured committer name and email address (such as Testy McTest <test@example.com>). If this is not sufficient, you can configure the signing key that git will use:

## To apply to all git repos:
git config --global user.signingkey <key_id>

## ... or to apply to the current repo only:
git config user.signingkey <key_id>

Add your public key to your Github account (https://github.com/settings/keys) so that Github can verify commits that you sign as described here.

Merging a branch into master

We have implemented a helper script to handle merging and signing PRs for you. In repos where this is available (for example, paas-cf) PRs can be merged and signed by running:

make merge_pr PR=<n>

Where n is the PR number.

Manually merging and signing a PR

PRs can also be be manually merged and signed.

First check that your working directory is clean, then do the following:

git checkout master
git pull --ff-only origin master
git merge --no-ff -S -m "Merge pull request #<n> from alphagov/repo-name\n\n<pr_title>" origin/<branch_name>
git push origin master

Stories

Pivotal Tracker and Rubbernecker

We use Pivotal Tracker to track stories and Rubbernecker for an overview of stories currently being worked. Stories without a name assigned to them are available for you to work on. You should remove your name when moving a story to the next step (e.g. “doing” to “review”).

Story kick-off

Kick-offs are an opportunity to clarify the scope of a story and raise any technical suggestions or concerns before work starts. They should include a check if the story being kicked off will likely conflict with any of the stories already in progress and therefore likely cause conflicts.

If the story is a spike, it should be made clear what the questions we want to answer are, and what specific outputs we need to cover in the summary at the end of the spike. Spikes must be reviewed after 2 days.

When a pair starts a new story they should arrange a kick-off with the Feature Lead or Tech Lead and anyone else from the team that is interested. Slack is a good way to let people know.

Story summary

When you’ve finished a story please take a few minutes to summarise your work in a comment on the Pivotal story. Summarising the story will help other people in the team review it, either against the acceptance criteria or for future reference, which can otherwise be difficult if comments are sparse or inconsistent.

Spike summary

The summary is particularly important if the story was a spike. If applicable it must indicate follow up work that is required. Listing options uncovered during the spike is good. Indicate which option is preferable. Where possible follow up stories should be noted. Doing this allows the Product Manager prioritise the follow up work.

Review

Review is the step in our process where the pull requests relating to a story are code-reviewed, and merged. This is typically done by somone who hasn’t worked on the story, however if a story has been paired on throughout, the pair can merge their own PRs, and push the story straight through to approval.

For a story that hasn’t been paired on throughout, the review and merging must be done by someone who hasn’t worked on it. This is to ensure that all code has been read by at least 2 people before being released to prod.

Approval

The Approval step in the process is where we verify that the story is fully complete according to our definition of done (below).

Approval should be done by the Feature Lead or Tech Lead, as they have overall responsibility for the progress of the relevant epic.

Our definition of done

  • the work on a story is completed
  • it met the need that motivated the story
  • any changes merged to master
  • the work is deployed to production
  • any acceptance criteria have been met
  • new stories are written for any follow-up work or technical debt

If it changes behaviour or makes new features available to users:

  • we have updated the developer documentation
  • we have notified our users (before we make the change if necessary)

Technical Documentation Changes

Technical Documentation changes follow the same overall process as code changes, but with several documentation-specific amends. This section summarises the tech docs change process.

Pre kick-off

  • Required: technical writer

Before the formal story kick-off, the technical writer reviews the story and drafts changes if possible.

Kick-off

  • Required: technical writer, technical lead
  • Optional: product representative, developer

At this step, decide on what changes to the tech docs are required to complete this story. You must also agree on who needs to review and approve this story. Make sure that you decide whether the story needs product as well as technical review. If no specific technical reviewers are named, any developer can serve as the technical reviewer. You should also analyse if any other further changes or stories will result from this story.

Doing

  • Required: technical writer, developer

Draft the content changes in markdown, ensuring that it is technically correct and in line with the GDS style guide. You must preview changes in tech doc format so that the new or amended content is smoothly integrated into the exsting documentation structure. Evaluate if story needs to change, and if so, whether this can be included in the scope of the original story or should be part of a new story. Once you have agreed that the content is ready for further review, raise a pull request to the paas-tech-docs repo.

Note that if the change requires product review, you must push the tech doc changes to Cloud Foundry for review. Refer to the Deploy a static site for instructions on how to do this.

Reviewing

  • Required: technical writer, developer, technical writer 2i
  • Optional: product representative, tech lead

Three reviews should happen at the same time:

  • The developer reviews the content in both GitHub and in the tech doc preview, checking if it addresses the issues in the story.
  • The tech writer conducting the 2i review checks the style and content.
  • The product rep or tech lead reviews content if required; the product rep will look at the temporary Cloud Foundry version of the tech docs.

Implement any changes as required, and then get sign-off from reviewers. The reviewers then merge the changes once they have been signed off.

Approving

  • Required: tech writer, approver

The approver checks if the change deployed correctly, and whether it addresses the story. If it does so, they approve the story.