cache: turn enable-writeback into a global commandline option

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: writeback() doesn't need to be visible

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2option: remove unused optionlist

Signed-off-by: Tobias Ulmer <tu@emlix.com>

environment: quote environment vars to allow expansion

shquote() breaks backwards compat

Signed-off-by: Tobias Ulmer <tu@emlix.com>

update copyright year

Signed-off-by: Tobias Ulmer <tu@emlix.com>

update developer documentation

Signed-off-by: Tobias Ulmer <tu@emlix.com>

project: remove unused info table

Signed-off-by: Tobias Ulmer <tu@emlix.com>

projenv: add license

Signed-off-by: Tobias Ulmer <tu@emlix.com>

assrt: show functions in developer doc

Signed-off-by: Tobias Ulmer <tu@emlix.com>

assrt: add license blurp

Signed-off-by: Tobias Ulmer <tu@emlix.com>

document 3rd party code in assrt.lua

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: remove comment

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: update developer documentation

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: update developer documentation

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2build: update developer documentation

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: remove unused todot()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

projenv: report the real error, not misleading follow up

Signed-off-by: Tobias Ulmer <tu@emlix.com>

manpage: document 'env' a little better

Signed-off-by: Tobias Ulmer <tu@emlix.com>

projenv: warn when a key lookup returns nil

Signed-off-by: Tobias Ulmer <tu@emlix.com>

sl: remove _sorted suffix

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: fix sourceid calculation in rare licences configuration

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: for sources, display overall licenses and per file licences

Signed-off-by: Tobias Ulmer <tu@emlix.com>

sl: merging duplicates is the default now

Signed-off-by: Tobias Ulmer <tu@emlix.com>

sl: remove merge option and make it the default

Signed-off-by: Tobias Ulmer <tu@emlix.com>

sl: remove the now unused 'unique' feature

Signed-off-by: Tobias Ulmer <tu@emlix.com>

source: auto merge licence names

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: chroot and source list should merge entries

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: turn on mergeing in file licence lists

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: get_licences() already returns a copy

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-build: warn about left out deploy results in release mode

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2option: repair userdefaultoptions() processing

Signed-off-by: Tobias Ulmer <tu@emlix.com>

ls-project: don't just register, handle cmd line options

Signed-off-by: Tobias Ulmer <tu@emlix.com>

ls-project: remove description of marginally useful global options

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-ls-project: fix and add two options

--chroot shows all chroot groups
--env shows the result environment

Signed-off-by: Tobias Ulmer <tu@emlix.com>

project: move config verify into project module

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: check return value of verify_result_envs()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: rename to sources_list()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: rename to chroot_list()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: move build_settings() implementation into result_class

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: move build_mode implementation into result_class

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: move buildconfig implementation into result_class

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: buildconfig() -> build_config() for consistency

Signed-off-by: Tobias Ulmer <tu@emlix.com>

update e2factory license and author information for consistency

No license change.

Signed-off-by: Tobias Ulmer <tu@emlix.com>

remove outdated document

Signed-off-by: Tobias Ulmer <tu@emlix.com>

gitignore: ignore e2config, it shouldn't be checked in

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: remove dead code

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib: split up stat() into lstat() and remove inconsistencies

This allows symlinks (not encouraged!) to work more consistently.

It also fixes a bug where we cached the symlink information instead of
the real file.

Prior to this change stat(foo, true) worked like posix stat(), while
stat(foo) or stat(foo, false) worked like lstat. This change undoes the
confusion, both functions work like their posix namesakes.

Signed-off-by: Tobias Ulmer <tu@emlix.com>

err: extent cat() to take a format string plus arguments

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: error out when at risk of overwriting files in toresult()

Due to flattening the file tree for collect project, each file in a
source needs an unique file name. Changing the code to accommodate for
anything else is quite involved. For now lets just make sure it's not
possible to generate a broken collect_project result and error out.

Signed-off-by: Tobias Ulmer <tu@emlix.com>

files: fix typo

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: reject converting unknown res types

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: rename method to cp_default_result()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

make.vars: add LUA_CFLAGS for building shared objects

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: remove build process and just add a step

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: switch to depends_list() and remove dlist()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: add depends_list()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

err: provide a traceback if assert hits

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: adjust for changed result type detection

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: make the result type detection more flexible

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-ls-project: WIP

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: use add_step_before()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: improve clarity of bc.T

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2build: document

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2build: add methods to add build steps

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: remove last remains of e2tool_ftab

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2build: do not include the '.' directory in result.tar

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: rename root_server to dot

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: rename result_server to results

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: rename default_files to upstream

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: rename default_repo to projects

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: lock the info table, cross fingers

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib.join: verbose assert

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: move server names and local cache setup into one place

Signed-off-by: Tobias Ulmer <tu@emlix.com>

collect_project: convert to new object oriented structure

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-fetch-sources: use new result objects

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-playground: make use of result and e2build

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2-build: make use of result and e2build

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: setup_cache: return false instead of nil

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: new_cache() is an implementation detail

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib: verify_global_config(): always check for existence of servers table

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: move e2lib.setup_cache into cache module

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: restore fileid() behaviour and only verify when check-remote is true

Signed-off-by: Tobias Ulmer <tu@emlix.com>

policy: remove all traces of dep_set()

dep_set() used to point to the location of a dependent result in the out
directory when said result was built in working-copy mode. Since the
introduction of stable "scratch-hash" style BuildID's this has been
unnecessary.

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: unify verify_hash() and fileid() to share the same interface and code basis

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: rework the caching strategy

Introduce new functions to fetch and push files in a consistent way.

To query server flags we now have:

- cache.cache_enabled()
- cache.islocal_enabled()
- cache.writeback_enabled()

All take the optional flags argument, allowing for overrides when
necessary.

The flags table is now checked for unknown flags, throwing a runtime
error. Unused flags have been removed.

Removed the function to cache files explicitly, return the file path if
in cache, and removed some dead code.
If the cache is enabled, calls to any function requesting path or a
copy of the requested file will cache automatically. This behaviour can
now be suppressed with the flags argument.

Introduced a function to check for the existence of a file on the remote
side without downloading:
transport.file_exists()

Added new function
- cache.fetch_file_path()
that returns the requested files path to either the cache, local
file system or a temporary location.

The code base was adjusted to work without any caching if desired,
although this is not a recommended mode of operation due to speed and
temporary storage requirements.

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: remove unused function file_local()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib: make unlink_recursive() work when pathname is not a directory

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib: document unlink_recursive() does not follow symlinks

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: file_path() remove unused flags and clean up

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2lib: add debug logging to callcmd()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: remove now unused check_only flag, add error checking

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2build: remove only use of check_only

In fact flags is entirely ignored by cache.file_path()

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: remove unused flags.refresh

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: add more error checking for flags

Signed-off-by: Tobias Ulmer <tu@emlix.com>

e2tool: tranport is an implementation detail of cache, stop using it

Signed-off-by: Tobias Ulmer <tu@emlix.com>

cache: remove unused flags.chmod feature

Signed-off-by: Tobias Ulmer <tu@emlix.com>

project: move chroot_call_prefix() to better location

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: modify build_mode() and drop the getter/setter style

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: build_process() returns a new build_process_class object

Signed-off-by: Tobias Ulmer <tu@emlix.com>

result: move my_chroot_list() implementation up into the descendent class

Signed-off-by: Tobias Ulmer <tu@emlix.com>