PTU5KAS/kas
Felix Moessbauer f2560588bc auto create repo refs when setting KAS_REPO_REF_DIR
This patch reworks the logic when setting KAS_REPO_REF_DIR.
When this variable is set, a two-staged clone is used:
First, a bare-clone (or similar) is created in the ref-dir, according to
the naming scheme. This clone is executed in a way that is both
reentrant as well as race-free across multiple instances of KAS working
on the same dir. Internally we clone into a tmpdir below the refdir and
rename on success to guarantee the atomicity of the operation on POSIX
compliant filesystems.

Second, the clone in the KAS_WORK_DIR is executed against the local
copy. After that, the origin url is redirected to the upstream url.
By that, the KAS_REPO_REF_DIR directory can be cached across builds
which significantly speedsup clone times against large repos.
In case the requested refspec is already in the cache (very likely in CI
builds), no direct access to the upstream repo is required. This logic
is crucial for CI systems in China, where e.g. access to github is
blocked from time to time.

The clone-from-local logic is currently only implemented for the git plugin
as HG misses the caching logic. Repo implementations that do not support this
logic can simply opt-out for the first stage by returning 'true'.

The existing user-facing logic of KAS_REPO_REF_DIR is not affected.
However, internally we no longer clone via --reference as this still
requires access to the remote repo, even if the requested commit is
already in the local copy.

Signed-off-by: Felix Moessbauer <felix.moessbauer@siemens.com>
Signed-off-by: Jan Kiszka <jan.kiszka@siemens.com>
2023-01-05 18:11:06 +01:00
..
plugins dump plugin: add option to capture current env 2022-12-13 14:40:04 +01:00
__init__.py __init__: Better support introspection 2018-12-07 09:56:09 +01:00
__main__.py Drop unnecessary shebang lines 2021-08-30 21:56:49 +02:00
__version__.py add conditional environment variables 2022-11-10 19:03:48 +01:00
config.py config: Symplify .config.yaml file handling 2022-08-03 13:00:55 +02:00
configschema.py yml: Move json schema from python dict to standalone json file 2021-10-05 10:28:24 +02:00
context.py forward build-concurrency related env vars 2022-10-19 11:02:17 +02:00
includehandler.py includehandler: Simplify code 2021-10-01 11:16:28 +02:00
kas.py plugins: Invoke setup_parser_common_args explicitly from setup_parser 2021-10-09 15:00:05 +02:00
libcmds.py libcmds: Remove protected accesses to Config 2022-07-12 09:21:07 +02:00
libkas.py libkas: Fix typo 2022-11-11 13:36:12 +01:00
repos.py auto create repo refs when setting KAS_REPO_REF_DIR 2023-01-05 18:11:06 +01:00
schema-kas.json add conditional environment variables 2022-11-10 19:03:48 +01:00