Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#376 - Add logging standards from MBTP #377

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

LDP0wer
Copy link

@LDP0wer LDP0wer commented Jan 24, 2024

A PR to create a new set of Standards for application logging, based on those that exist in MBTP already.

Content change

I can confirm:

  • Content does not include any code or configuration changes (excluding frontmatter information)
  • Content meets the content standards
    e.g. Writing a principle and Writing a standard
  • Content is suitable to open source, i.e.:
    • Content does not relate to unreleased gov policy
    • Content does not refer to anti-fraud mechanisms
    • Content does not include sensitive business logic
  • Last updated date for content is correct

@LDP0wer LDP0wer requested a review from a team as a code owner January 24, 2024 18:10
@jeff-horton-ho-sas jeff-horton-ho-sas added content Observability Relates to observability guild content labels Mar 14, 2024
Comment on lines +41 to +46
Information | Description
------------| -----------
Date / Time | Each log message must include date and time (millisecond accuracy) (UTC). The time source for all service logs must be consistent so that messages can be viewed & sorted easily.
Service | Each log message must be attributed to an service (i.e. hostname).
Log level | Each log message must have an appropriate log level (INFO, WARN, ERROR, etc.)
Log Message | Each log message must have a log message. Log messages must follow a consistent log messaging format for all log types to allow for easy processing and translation of logs to other formats.
Copy link
Contributor

@edhamiltonHO edhamiltonHO Apr 26, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have found tables can cause flow issues. Could consider using summary lists as in the docs-as-code pattern


Examples of combined PII include:
* Passport number, Issuing Country, Expiry Dates
* BRP/C number, Date of Birth
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* BRP/C number, Date of Birth
* Biometric residence permit or card (BRP/C) number, Date of Birth

* Passport number, Issuing Country, Expiry Dates
* BRP/C number, Date of Birth

With the examples above, the information by themselves do not mean very much. After all, a BRP/C number is just a "random" sequence of characters; but in combination with the date of birth it can be used to uniquely identify an individual.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
With the examples above, the information by themselves do not mean very much. After all, a BRP/C number is just a "random" sequence of characters; but in combination with the date of birth it can be used to uniquely identify an individual.
With the examples above, the information by themselves do not mean very much. After all, a BRP/C number is a random sequence of characters; but in combination with the date of birth it can be used to uniquely identify an individual.

href: /patterns/securing-application-logging/
---

Logging tools are one of the primary tools to debug application problems and identifying the root cause of incidents. However, logs need to be formatted in a standard way so that they are not only useful for the application's original developers, but also those supporting the application later in its life-cycle.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Logging tools are one of the primary tools to debug application problems and identifying the root cause of incidents. However, logs need to be formatted in a standard way so that they are not only useful for the application's original developers, but also those supporting the application later in its life-cycle.
Logging tools are one of the primary tools to debug application problems and identifying the root cause of incidents. Logs need to be formatted in a standard way so that they are useful for the both application's developers and those supporting the application later in its life-cycle.

Comment on lines +22 to +24
However, logs are sometimes relied on too heavily for problem detection, when this role would be better suited to purpose chosen monitoring tooling.

Therefore these standards provide guidance on both the proper format of application logs, as well as their proper usage.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
However, logs are sometimes relied on too heavily for problem detection, when this role would be better suited to purpose chosen monitoring tooling.
Therefore these standards provide guidance on both the proper format of application logs, as well as their proper usage.
Logs are not a replacement for dedicated monitoring tooling. They should be used as part of a broader observabilty toolset. This standard provides guidance on a standard format for application logs, and suitable uses.


However, logs are sometimes relied on too heavily for problem detection, when this role would be better suited to purpose chosen monitoring tooling.

Therefore these standards provide guidance on both the proper format of application logs, as well as their proper usage.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Therefore these standards provide guidance on both the proper format of application logs, as well as their proper usage.
This standard provides guidance on the proper format and usage of logs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
content Observability Relates to observability guild content
Projects
None yet
Development

Successfully merging this pull request may close these issues.

There are currently no Standards for Application logging with a logging aggregation tool
3 participants