git-annex

git-annex 10.20220222 released with these changes annex.skipunknown now defaults to false, so commands like git annex get foo* will not silently skip over files/dirs that are not checked into git. info: Allow using matching options in more ... [More] situations. File matching options like --include will be rejected in situations where there is no filename to match against. adb: Avoid find failing with "Argument list too long" Fix git-annex forget propagation between repositories. (reversion introduced in version 7.20190122) registerurl, unregisterurl: Improved output when reading from stdin to be more like other batch commands. registerurl, unregisterurl: Added --json and --json-error-messages options. Avoid git status taking a long time after git-annex unlock of many files. Pass --no-textconv when running git diff internally. [Less]

git-annex 10.20220127 released with these changes New v10 repository version (with v9 as a stepping-stone to it). v8 remains the default version for now. In v10, object files are locked using separate lock files. This allows the object files to ... [More] be kept non-writable even in repositories where core.sharedRepository is set. The v10 upgrade will happen automatically, one year after the v9 upgrade, in order to allow time for any old git-annex processes that are not aware of the locking change to finish. Or git-annex upgrade can be used to upgrade to v10 immediately. In v9 upgrade, set filter.annex.process. This makes git add/checkout faster when there are a lot of unlocked annexed files or non-annexed files, but can also make git add of large files to the annex somewhat slower. If this tradeoff does not work for your use case, you can still unset filter.annex.process. export: When a non-annexed symlink is in the tree to be exported, skip it. import: When the previously exported tree contained a non-annexed symlink, preserve it in the imported tree so it does not get deleted. enableremote, renameremote: Better handling of the unusual case where multiple special remotes have been initialized with the same name. Recover from corrupted content being received from a git remote, by deleting the temporary file when it fails to verify. This prevents a retry from failing again. (reversion introduced in version 8.20210903) adb: Added ignorefinderror configuration parameter. Avoid crashing when run in a bare git repo that somehow contains an index file. Reject combinations of --batch (or --batch-keys) with options like --all or --key or with filenames. [Less]

git-annex 8.20211231 released with these changes Improved support for using git-annex in a read-only repository, git-annex branch information from remotes that cannot be merged into the git-annex branch will now not crash it, but will be merged ... [More] in memory. addurl, youtube-dl: When --check-raw prevents downloading an url, still continue with any downloads that come after it, rather than erroring out. Fix locking problems when annex.pidlock is set and concurrency is enabled eg with -J. Improve error message display when autoinit fails due to eg, a permissions problem. export: Avoid unncessarily re-exporting non-annexed files that were already exported. Improve git command queue flushing so that eg, addurl of several large files that take time to download will update the index for each file, rather than deferring the index updates to the end. sync: Better error message when unable to export to a remote because remote.name.annex-tracking-branch is configured to a ref that does not exist. Fix build with ghc 9.0.1 Fix build with old versions of feed library. [Less]

git-annex 8.20211123 released with these changes Bugfix: When -J was enabled, getting files could leak an ever-growing number of git cat-file processes. Support git's new "ort" resolver, which became the default in git 2.34.0, and broke the test ... [More] suite and automatic merge resolution of a conflict between an annexed file and a non-annexed file. importfeed: Display url before starting youtube-dl download. [Less]

git-annex 8.20211117 released with these changes filter-process: New command that can make git add/checkout faster when there are a lot of unlocked annexed files or non-annexed files, but that also makes git add of large annexed files slower. ... [More] Use it by running: git config filter.annex.process 'git-annex filter-process' Fix a typo in the name of youtube-dl (reversion introduced in version 8.20210903) git-lfs: Fix interoperability with gitlab's implementation of the git-lfs protocol, which requests Content-Encoding chunked. importfeed: Fix a crash when used in a non-unicode locale. migrate: New --remove-size option. uninit: Avoid error message when no commits have been made to the repository yet. uninit: Avoid error message when there is no git-annex branch. metadata --batch: Avoid crashing when a non-annexed file is input, instead output a blank line like other batch commands do. metadata --batch --json: Reject input whose "fields" does not consist of arrays of strings. Such invalid input used to be silently ignored. [Less]

git-annex 8.20211028 released with these changes Removed support for accessing git remotes that use versions of git-annex older than 6.20180312. git-annex-shell: Removed several commands that were only needed to support git-annex versions older ... [More] than 6.20180312. Negotiate P2P protocol version with tor remotes, allowing use of protocol version 1. This negotiation is not supported by versions of git-annex older than 6.20180312. Fix bug that caused stale git-annex branch information to read when annex.private or remote.name.annex-private is set. git-annex get when run as the first git-annex command in a new repo did not populate all unlocked files. (Reversion in version 8.20210621) Fix using lookupkey and info inside a subdirectory of the git repository. (Reversion in version 8.20211011) Avoid some sqlite crashes on Windows SubSystem for Linux (WSL). Call annex.freezecontent-command on the annex object file after it has been moved into place in annex/objects/. This allows the hook to freeze the file in ways that prevent moving it, such as removing the Windows delete permission. Thanks, Reiko Asakura. addurl: Support adding the same url to multiple files at the same time when using -J with --batch --with-files. When retrieval from a chunked remote fails, display the error that occurred when downloading the chunk, rather than the error that occurred when trying to download the unchunked content, which is less likely to actually be stored in the remote. Avoid crashing tilde expansion on user who does not exist. test: Put gpg temp home directory in system temp directory, not filesystem being tested. [Less]

git-annex 8.20211028 released with these changes Removed support for accessing git remotes that use versions of git-annex older than 6.20180312. git-annex-shell: Removed several commands that were only needed to support git-annex versions older ... [More] than 6.20180312. Negotiate P2P protocol version with tor remotes, allowing use of protocol version 1. This negotiation is not supported by versions of git-annex older than 6.20180312. Fix bug that caused stale git-annex branch information to read when annex.private or remote.name.annex-private is set. git-annex get when run as the first git-annex command in a new repo did not populate all unlocked files. (Reversion in version 8.20210621) Fix using lookupkey and info inside a subdirectory of the git repository. (Reversion in version 8.20211011) Avoid some sqlite crashes on Windows SubSystem for Linux (WSL). Call annex.freezecontent-command on the annex object file after it has been moved into place in annex/objects/. This allows the hook to freeze the file in ways that prevent moving it, such as removing the Windows delete permission. Thanks, Reiko Asakura. addurl: Support adding the same url to multiple files at the same time when using -J with --batch --with-files. When retrieval from a chunked remote fails, display the error that occurred when downloading the chunk, rather than the error that occurred when trying to download the unchunked content, which is less likely to actually be stored in the remote. Avoid crashing tilde expansion on user who does not exist. test: Put gpg temp home directory in system temp directory, not filesystem being tested. News for 8.20211028: This version of git-annex removes support for communicating with git-annex remotes that have version 6.20180312 or older installed. [Less]

git-annex 8.20211011 released with these changes Added annex.bwlimit and remote.name.annex-bwlimit config to limit the bandwidth of transfers. It works for git remotes and many but not all special remotes. Bug fix: Git configs such as ... [More] annex.verify were incorrectly overriding per-remote git configs such as remote.name.annex-verify. (Reversion in version 4.20130323) borg: Significantly improved memory use when a borg repository contains many archives. borg: Avoid trying to extract xattrs, ACLS, and bsdflags when retrieving from a borg repository. Sped up git-annex smudge --clean by 25%. Resume where it left off when copying a file to/from a local git remote was interrupted. sync --content: Avoid a redundant checksum of a file that was incrementally verified, when used on NTFS and perhaps other filesystems. reinject: Fix crash when reinjecting a file from outside the repository. (Reversion in version 8.20210621) Avoid cursor jitter when updating progress display. [Less]

git-annex 8.20210903 released with these changes Deal with clock skew, both forwards and backwards, when logging information to the git-annex branch. GIT_ANNEX_VECTOR_CLOCK can now be set to a fixed value (eg 1) rather than needing to be ... [More] advanced each time a new change is made. Misuse of GIT_ANNEX_VECTOR_CLOCK will no longer confuse git-annex. add: When adding a dotfile, avoid treating its name as an extension. rsync special remote: Stop displaying rsync progress, and use git-annex's own progress display. Many special remotes now checksum content while it is being retrieved, instead of in a separate pass at the end. This is supported for all special remotes on Linux (except for bittorrent), and for many on other OS's (except for adb, external, gcrypt, hook, and rsync). unused: Skip the refs/annex/last-index ref that git-annex recently started creating. Fix test suite failure on Windows. New --batch-keys option added to these commands: get, drop, move, copy, whereis Added annex.youtube-dl-command config. This can be used to run some forks of youtube-dl. Run cp -a with --no-preserve=xattr, to avoid problems with copied xattrs, including them breaking permissions setting on some NFS servers. add, import: Detect when xattrs or perhaps ACLs prevent removing write permissions from an annexed file, and fail with an informative message. Fix support for readonly git remotes. (Reversion in version 8.20210621) When downloading urls fail, explain which urls failed for which reasons. web: Avoid displaying a warning when downloading one url failed but another url later succeeded. [Less]

git-annex 8.20210803 released with these changes whereused: New command, finds what files use a key, or where a key was used historically. Fix a bug that prevented getting content from a repository that started out as a bare repository, or had ... [More] annex.crippledfilesystem set, and was converted to a non-bare repository. Fix retrieval of content from borg repos accessed over ssh. sync: When --quiet is used, run git commit, push, and pull without their ususual output. merge: When --quiet is used, run git merge without its usual output. sync, merge, post-receive: Avoid merging unrelated histories, which used to be allowed only to support direct mode repositories. (However, sync does still merge unrelated histories when importing trees from special remotes, and the assistant still merges unrelated histories.) sync, merge: Added --allow-unrelated-histories option, which is the same as the git merge option. Fix bug that caused some transfers to incorrectly fail with "content changed while it was being sent", when the content was not changed. Fix bug that could prevent pointer files from being populated, in a repository that was upgraded from v7. fsck: Detect and correct stale or missing inode caches. Fix a rounding bug in display of data sizes. git-annex get when run as the first git-annex command in a new repo did not populate unlocked files. (Reversion in version 8.20210621) [Less]