cleanup: clean up and simplify the build system

Mainly: Nothing is built in the generic/ subdirectory any more now:
global stuff is built in global/
local stuff is built in local/
libraries are no longer renamed with _local or _global prefixes.

This is another step heading towards proper modularization - and
installing each module on its own, for both local and global
tools.

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: remove unused e2api code

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: remove e2-buildid(1) manual page

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: remove unused code

Signed-off-by: Gordon Hecker <gh@emlix.com>

modify status output alignment for better readability

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: remove unused code

Signed-off-by: Gordon Hecker <gh@emlix.com>

Changelog: proper modularization

Signed-off-by: Gordon Hecker <gh@emlix.com>

hash: turn into proper module

Signed-off-by: Gordon Hecker <gh@emlix.com>

url: turn into proper module

Signed-off-by: Gordon Hecker <gh@emlix.com>

tools: new module, move tool related code from transport to new tools module

Signed-off-by: Gordon Hecker <gh@emlix.com>

transport: cleanup: turn into proper lua module

Signed-off-by: Gordon Hecker <gh@emlix.com>

Changelog: bugfixes

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: fix an incorrect return value that lead to a backtrace when calculating fileid for non-existent files

Signed-off-by: Gordon Hecker <gh@emlix.com>

global interface: cleanup: The server side ./version file and the .e2/version file used to hold the global interface version, describing the way data is stored on server side. If the way data is stored is changed the version must be changed, too. That must take effect for all old versions of the project, so redundantly storing the global interface version in .e2/version must not be done.

This commit cleans up the situation:
remove and deprecate .e2/version
introduce .e2/global_version that is created on project check-out and
initialized with the value stored in ./version on the server side.

Local tools check the global interface version against a list of
supported versions stored in the build time configuration. That way they
will, in future, be able to complain if a particular version is not
supported.

Global tools create projects with the newest global interface version
supported.

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: ls-project code cleanup

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: fix error handling when cyclic dependencies are detected in the configuration.

Signed-off-by: Gordon Hecker <gh@emlix.com>

Changelog: cache

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: remove the feature of having a per-project cache

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: enable caching for the 'projects' server in the default configuration. The cache settings are ignored for SCM access. The builtin 'proj-storage' server inherits the cache flags from 'projects'.

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: fix global tools to comply with the new implementation of e2lib.setup_cache(). The global tools use the configured cache instead of a temporary one now. The cache is disabled on-the-fly now where caching is not appropriate.

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: allow disabling the cache on-the-fly for fetch_file() and push_file() by passing cache=false in the flags Required to allow the global tools to use the cache in the configured location. See next commit.

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: cleanup: move server and cache related code from e2tool module to e2lib and cache modules

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: implement servers() to return a sorted list of configured servers

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: implement valid_server() to verify that a server is configured

Signed-off-by: Gordon Hecker <gh@emlix.com>

cache: new_cache_entry(): support server aliases

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: switch cache function calls to object oriented style

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: turn cache into proper Lua module

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: fix policy module to correctly call ce_by_server()

Signed-off-by: Gordon Hecker <gh@emlix.com>

cleanup: remove unused code

Signed-off-by: Gordon Hecker <gh@emlix.com>

e2-su-2.2: fix compiler warnings about unused variables

Signed-off-by: Gordon Hecker <gh@emlix.com>

collect_project: handle .tar.bz2 and .tar chroot files

Signed-off-by: Gordon Hecker <gh@emlix.com>

collect_project: Use e2-su-2.2 _2_3 suffix commands in collect_project

This does not influence reproducibility but may allow us to get rid of the
old _2_2 suffix commands at some time in the future.

Signed-off-by: Gordon Hecker <gh@emlix.com>

Changelog: env

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: environment is available for all results, even if empty

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: implement get_dict()

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: use environment module

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: environment module

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: store result specific env in result structures

Signed-off-by: Gordon Hecker <gh@emlix.com>

env: rewrite env config reader code

Signed-off-by: Gordon Hecker <gh@emlix.com>

Changelog: plugin interface

Signed-off-by: Gordon Hecker <gh@emlix.com>

plugin support: move build process description from policy module to e2build, allow plugins to register their own build functions

Signed-off-by: Gordon Hecker <gh@emlix.com>

plugin support: allow plugins to extend the scm interface, allow plugins to extend the scm implementations

Signed-off-by: Gordon Hecker <gh@emlix.com>

plugin support: plugin interface

Signed-off-by: Gordon Hecker <gh@emlix.com>

plugin support: load local plugins

Signed-off-by: Gordon Hecker <gh@emlix.com>

luadoc: correct a typo

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: rename variable to fit coding policies

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: error checking in e2lib.write_file()

Signed-off-by: Gordon Hecker <gh@emlix.com>

create next changelog entry

Signed-off-by: Gordon Hecker <gh@emlix.com>

release e2factory-2.3.3

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: example installation failed when running without root permissions.
Set correct permissions.

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: correct warning calls

Signed-off-by: Gordon Hecker <gh@emlix.com>

create next changelog entry

Signed-off-by: Gordon Hecker <gh@emlix.com>

release e2factory-2.3.3rc1

Signed-off-by: Gordon Hecker <gh@emlix.com>

local tools: finish command line handling before setting up the
project structure

Signed-off-by: Gordon Hecker <gh@emlix.com>

git: verify that the project tag is pushed to the remote repository

Signed-off-by: Gordon Hecker <gh@emlix.com>

git: verify that the project repository is on the tag matching the ReleaseId is clean, i.e. no unknown files around, no differences against HEAD

Signed-off-by: Gordon Hecker <gh@emlix.com>

git source: verify that tags in git repositories are pushed to the remote repository

Signed-off-by: Gordon Hecker <gh@emlix.com>

git: implement generic functions for git repository state verification

Signed-off-by: Gordon Hecker <gh@emlix.com>

verify that the correct version of e2-build is used when --check is passed to e2-build

Signed-off-by: Gordon Hecker <gh@emlix.com>

verify hash of remote files

Signed-off-by: Gordon Hecker <gh@emlix.com>

e2-build: introduce --check-remote and --check enable both by default when --release is given

Signed-off-by: Gordon Hecker <gh@emlix.com>

e2option: export opts in the global e2option table

Signed-off-by: Gordon Hecker <gh@emlix.com>

tar: do not rely on -j and -z flags, use --bzip2 and --gzip instead

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: broken error handling due to duplicate use of local variable

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: fix error checking in files.sourceid()

Signed-off-by: Gordon Hecker <gh@emlix.com>

include Changelog in the documentation tarball

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: fix error handling in e2lib.mktempfile() and e2lib.mktempdir()

Signed-off-by: Gordon Hecker <gh@emlix.com>

fileid: introduce a hash cache that depends on timestamps

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: error checking

Signed-off-by: Gordon Hecker <gh@emlix.com>

use e2tool.fileid() to get fileid for build scripts
use e2tool.fileid() to get fileid for init scripts

Signed-off-by: Gordon Hecker <gh@emlix.com>

build: rotate build logfiles

Signed-off-by: Gordon Hecker <gh@emlix.com>

e2lib: use e2util.stat instead of calling test -f

Signed-off-by: Gordon Hecker <gh@emlix.com>

sha1: use sha1 module instead of sha1sum tool
testcase for the sha1 module is included in test_sha1.lua

Signed-off-by: Gordon Hecker <gh@emlix.com>

sha1: rename sha1 module to hash

Signed-off-by: Gordon Hecker <gh@emlix.com>

sha1sum: close pipe

Signed-off-by: Gordon Hecker <gh@emlix.com>

create next changelog entry

Signed-off-by: Gordon Hecker <gh@emlix.com>

release e2factory-2.3.2

Signed-off-by: Gordon Hecker <gh@emlix.com>

update INSTALL documentation with a pointer to examples/README

Signed-off-by: Gordon Hecker <gh@emlix.com>

documentation: checksum configuration for source files

Signed-off-by: Gordon Hecker <gh@emlix.com>

example: do not pass empty environment variables to example setup

Signed-off-by: Gordon Hecker <gh@emlix.com>

create next changelog entry

Signed-off-by: Gordon Hecker <gh@emlix.com>

release e2factory-2.3.2rc1

Signed-off-by: Gordon Hecker <gh@emlix.com>

example: include example project into source tree

Signed-off-by: Gordon Hecker <gh@emlix.com>

templates: change chroot configuration to the new format

Signed-off-by: Gordon Hecker <gh@emlix.com>

build system: remove directories if possible in uninstall target

Signed-off-by: Gordon Hecker <gh@emlix.com>

documentation: document release_id and name variables in project
configuration

Signed-off-by: Gordon Hecker <gh@emlix.com>

bugfix: include the project name into project id

Signed-off-by: Gordon Hecker <gh@emlix.com>

build system: Compile the lock module into the generic modules instead
of installing on its own.
This is still required due to the build system using different lua
compilers in local an global builds.

Signed-off-by: Gordon Hecker <gh@emlix.com>

lock: source code documentation

Signed-off-by: Gordon Hecker <gh@emlix.com>

syntax: introduce the new syntax version: 2_3_2
limit the syntax compatibility to 2_3_2 only

compatibility to older versions is not maintained as we want to enforce
configuring checksums for any file reference.

Signed-off-by: Gordon Hecker <gh@emlix.com>

documentation: add a chapter to the documentation describing how to
migrate to the new configuration format

Signed-off-by: Gordon Hecker <gh@emlix.com>

collect_project: include result name in informational warning displaying
the list of results to be packaged

Signed-off-by: Gordon Hecker <gh@emlix.com>

source config: checksum_file is no longer used and marked deprecated

Signed-off-by: Gordon Hecker <gh@emlix.com>

files sources: remove unused function: files.get_revision_id()

Signed-off-by: Gordon Hecker <gh@emlix.com>

buildid: refactor file id calculation

Signed-off-by: Gordon Hecker <gh@emlix.com>

changelog: checksum configuration

Signed-off-by: Gordon Hecker <gh@emlix.com>

changelog: configuration file changes

Signed-off-by: Gordon Hecker <gh@emlix.com>

licence config: Switch to new file format, similar to source file
configuration, require sha1 checksums to be configured for files located
on servers other than "."

Signed-off-by: Gordon Hecker <gh@emlix.com>

chroot: actually verify checksum for chroot tarballs

Signed-off-by: Gordon Hecker <gh@emlix.com>

collect_project: generate code to check checksums for chroot tarballs when
building out of the collect_project result

Signed-off-by: Gordon Hecker <gh@emlix.com>