Mbed OS is an open source project and we really appreciate your contributions to the tools. We are committed to fostering a welcoming community, please see our Code of Conduct, which can be found here:
There are several ways to contribute:
- Raise an issue found via GitHub Issues.
- Open an pull request to:
- Provide a fix.
- Add an enhancement feature.
- Correct, update or add documentation.
- Answering community questions on the Mbed Forum.
Please keep contributions small and independent. We would much rather have multiple pull requests for each thing done rather than have them all in the same one. This will help us review, give feedback and merge in the changes. The normal process to make a change is as follows:
- Fork the repository.
- Make your change and write unit tests, please try to match the existing documentation and coding style.
- Add a news file describing the changes and add it in the
/news
directory, see the section News Files below. - Write a good commit message.
- Push to your fork.
- Submit a pull request.
We will review the proposed change as soon as we can and, if needed, give feedback. Please bear in mind that the tools for Mbed OS are complex and cover a large number of use cases. This means we may ask for changes not only to ensure that the proposed change meets our quality criteria, but also to make sure the that the change is generally useful and doesn't impact other uses cases or harm maintainability.
If you are new to developing on Python projects, you may find our development tutorial valuable. We cover how to get a Python development environment set up, how to use tox, and other tips.
News files serve a different purpose to commit messages, which are generally written to inform developers of the project. News files will form part of the release notes so should be written to target the consumer of the package or tool.
- A news file should be added for each merge request to the directory
/news
. - The text of the file should be a single line describing the change and/or impact to the user.
- The filename of the news file should take the form
<number>.<extension>
, e.g,20191231.feature
where:- The number is either the issue number or, if no issue exists, the date in
the form
YYYYMMDD
. - The extension should indicate the type of change as described in the following table:
- The number is either the issue number or, if no issue exists, the date in
the form
Change Type | Extension | Version Impact |
---|---|---|
Backwards compatibility breakages or significant changes denoting a shift direction. | .major |
Major increment |
New features and enhancements (non breaking). | .feature |
Minor increment |
Bug fixes or corrections (non breaking). | .bugfix |
Patch increment |
Documentation impacting the consumer of the package (not repo documentation, such as this file, for this use .misc ). |
.doc |
N/A |
Deprecation of functionality or interfaces (not actual removal, for this use .major ). |
.removal |
None |
Changes to the repository that do not impact functionality e.g. build scripts change. | .misc |
None |
We use pre-commit to install and run commit hooks, mirroring the code checks we run in our CI environment.
The pre-commit
tool allows developers to easily install git hook scripts
which will run on every git commit
. The .pre-commit-config.yaml
in our
repository sets up commit hooks to run pytest, black, mypy and flake8. Those
checks must pass in our CI before a PR is merged. Using commit hooks ensures
you can't commit code which violates our style and maintainability
requirements.
To install the commit hooks for the repository (assuming you have activated your development environment as described in the development guide), run:
$ pre-commit install
Our code checks will now run automatically every time you try to git commit
to the repository.
If you prefer not to install the hook scripts, you can use
$ pre-commit run
to check your staged changes.
We aim to compose and review patchsets, not individual patches. When merging a pull request, we preserve the commit history. Ensure your commit history is clean and understandable.
We recommend the following commit structure in the following order:
- Whitespace only changes
- Style changes (although we use
black
to auto format the code so these should be rare) - Refactoring (no functional change)
- Meaningful behavioural changes
We also recommend adding a prefix to your commit message to highlight the area of relevance. Write prefixes in lowercase, followed by a colon, followed by a space, and then finally the commit title. Some example prefixes include the following:
project:
config:
tests:
docs:
cli:
travis:
ci:
Follow Chris Beams' article on how to write a Git commit message to ensure you're writing good commit messages.
commit 23efe7ba1009a0b0db890df3b940157c732085b7
Author: Vikas Katariya <[email protected]>
Date: Thu Nov 26 11:36:02 2020 +0000
deploy: Use default branch from remote repository
Make sure we checkout the default branch from the remote repository, if
there is no git hash present in the .lib file.
We also need to fetch the git repository before performing a checkout
when using the `deploy` command. This makes sure we have the latest
changes in the upstream repo.
Fixes #122
Mbed previously required a signed contributor agreement in order to accept contributions. Mbed no longer requires such an agreement. Mbed projects (unless otherwise noted in the specific project) now accept contributions under Apache-2.0 directly. For more details, refer to the Mbed OS contributing guide
Thank you for contributing to mbed-tools
.
For development and testing purposes, it is essential to use a virtual environment. tox is a commonly used development tool that helps manage virtual environments.
mbed-tools
is compatible with Python 3.6 or later.
If you are on a Linux distribution, or macOS, you will find that Python comes pre-installed on your system. Do not use the pre-installed versions of Python for development.
Below are links to guides for correctly setting up a development ready version of Python 3 on common platforms:
On Windows we have also found the Python Launcher for Windows to be a reasonable alternative.
After you have set up your Python 3 installation, install tox (the --user
flag is important never use sudo
to install Python packages!)
On macOS, with the defacto macOS package manager, Homebrew:
brew install tox
On other platforms, use your native package manager's tox package or your Python environment's Python package manager, pip, like so:
python3 -m pip install --user tox
Check that tox is in the binary path
tox --version
If not, find the user base binary directory
python -m site --user-base
#~ /Users/<username>/Library/Python/3.9
Append bin
to the directory returned and add this to your path by updating
~/.profile
. For example you might add the following:
export PATH=~/Library/Python/3.9/bin/:$PATH
Clone the mbed-tools
GitHub repository.
git clone [email protected]:ARMmbed/mbed-tools.git
Set up the development environment using tox (tox will create a development environment at mbed-tools/.venv):
cd mbed-tools/
tox -e dev
source .venv/bin/activate
After you have activated your development environment, run tox -e linting,py39
to run unit tests and static code analysis checks:
tox -e linting,py39
This will run black
, flake8
, mypy
and pytest
. If you would like to run
these tools individually, see below:
Run unit tests:
pytest
Run code formatter (it will format files in place):
black .
Run static analysis (note that no output means all is well):
flake8
Perform static type check:
mypy src/mbed_tools
Type hints should be used in the code wherever possible. Since the documentation shows the function signatures with the type hints there is no need to include additional type information in the docstrings.
Code Climate is integrated with our GitHub flow. Raising a pull request that fails any of the configured rules will prevent your pull request from being merged.
If you prefer to view the Code Climate report on your machine, prior to sending a pull request, you can use the cli provided by Code Climate.
Plugins for various tools are also available:
Inclusion of docstrings is needed in all areas of the code for Flake8 checks in the CI to pass.
We use google-style docstrings.
To set up google-style docstring prompts in Pycharm:
- in the menu navigate to Preferences > Tools > Python Integrated Tools
- in the dropdown for docstring format select 'Google'
For longer explanations, you can also include markdown. Markdown can also be
kept in separate files in the docs/user_docs
folder and included in a
docstring in the relevant place using the reST
include
as follows:
.. include:: ../docs/user_docs/documentation.md
You can do a preview build of the documentation locally by running:
generate-docs
This will generate the docs and output them to local_docs
. This should only
be a preview. Since documentation is automatically generated by the CI you
shouldn't commit any docs html files manually. The docs will be generated and
checked in as part of the release process.
If you want to preview the docs generated by the CI you can view them in the Azure pipeline artifacts directory for the build.
Documentation only gets committed back to this repo to the docs
directory
during a release and this is what gets published to Github pages. Don't modify
any of the files in this directory by hand.
Production releases of mbed-tools are created automatically every night by our continuous delivery system (implemented in Azure Pipelines). There should be no human intervention required to deploy mbed-tools to pypi.
If you wish to create a production release of mbed-tools without waiting for the continuous deployment system to create one, you can perform the following steps:
- Check out the
master
branch; ensure it is clean and up to date. - Run
tox -e preprelease
, this will update the necessary files, create a commit and tag it with the new release version number. - Push the commit to
master
. - Push the tag.
The CI will detect a new tag has been created and run the "Build and Deploy" pipeline, which then pushes the release to pyPI.
NOTE: The release process relies on a shell script
ci_scripts/prep-release
, so will not work on Windows systems.