2006-02-16 10:24:16 +01:00
|
|
|
#!/usr/bin/env perl
|
2006-02-20 19:57:29 +01:00
|
|
|
# Copyright (C) 2006, Eric Wong <normalperson@yhbt.net>
|
|
|
|
# License: GPL v2 or later
|
2006-02-16 10:24:16 +01:00
|
|
|
use warnings;
|
|
|
|
use strict;
|
|
|
|
use vars qw/ $AUTHOR $VERSION
|
2007-01-31 12:06:56 +01:00
|
|
|
$sha1 $sha1_short $_revision
|
|
|
|
$_q $_authors %users/;
|
2006-02-16 10:24:16 +01:00
|
|
|
$AUTHOR = 'Eric Wong <normalperson@yhbt.net>';
|
2006-07-06 09:14:16 +02:00
|
|
|
$VERSION = '@@GIT_VERSION@@';
|
2006-03-30 08:37:18 +02:00
|
|
|
|
2007-10-16 16:36:50 +02:00
|
|
|
# From which subdir have we been invoked?
|
|
|
|
my $cmd_dir_prefix = eval {
|
|
|
|
command_oneline([qw/rev-parse --show-prefix/], STDERR => 0)
|
|
|
|
} || '';
|
|
|
|
|
2007-02-20 10:36:30 +01:00
|
|
|
my $git_dir_user_set = 1 if defined $ENV{GIT_DIR};
|
2007-01-19 02:50:01 +01:00
|
|
|
$ENV{GIT_DIR} ||= '.git';
|
2007-02-03 21:49:48 +01:00
|
|
|
$Git::SVN::default_repo_id = 'svn';
|
2007-01-22 20:44:57 +01:00
|
|
|
$Git::SVN::default_ref_id = $ENV{GIT_SVN_ID} || 'git-svn';
|
2007-02-15 01:04:10 +01:00
|
|
|
$Git::SVN::Ra::_log_window_size = 100;
|
2006-03-30 08:37:18 +02:00
|
|
|
|
2007-01-12 11:35:20 +01:00
|
|
|
$Git::SVN::Log::TZ = $ENV{TZ};
|
2006-02-16 10:24:16 +01:00
|
|
|
$ENV{TZ} = 'UTC';
|
git-svn: add --follow-parent and --no-metadata options to fetch
--follow-parent:
This is especially helpful when we're tracking a directory
that has been moved around within the repository, or if we
started tracking a branch and never tracked the trunk it was
descended from.
This relies on the SVN::* libraries to work. We can't
reliably parse path info from the svn command-line client
without relying on XML, so it's better just to have the SVN::*
libs installed.
This also removes oldvalue verification when calling update-ref
In SVN, branches can be deleted, and then recreated under the
same path as the original one with different ancestry
information, causing parent information to be mismatched /
misordered.
Also force the current ref, if existing, to be a parent,
regardless of whether or not it was specified.
--no-metadata:
This gets rid of the git-svn-id: lines at the end of every commit.
With this, you lose the ability to use the rebuild command. If
you ever lose your .git/svn/git-svn/.rev_db file, you won't be
able to fetch again, either. This is fine for one-shot imports.
Also fix some issues with multi-fetch --follow-parent that were
exposed while testing this. Additionally, repack checking is
simplified greatly.
git-svn log will not work on repositories using this, either.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
Signed-off-by: Junio C Hamano <junkio@cox.net>
2006-06-28 04:39:13 +02:00
|
|
|
$| = 1; # unbuffer STDOUT
|
2006-02-16 10:24:16 +01:00
|
|
|
|
2007-10-16 16:36:52 +02:00
|
|
|
sub fatal (@) { print STDERR "@_\n"; exit 1 }
|
2006-12-16 08:58:07 +01:00
|
|
|
require SVN::Core; # use()-ing this causes segfaults for me... *shrug*
|
|
|
|
require SVN::Ra;
|
|
|
|
require SVN::Delta;
|
|
|
|
if ($SVN::Core::VERSION lt '1.1.0') {
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal "Need SVN::Core 1.1.0 or better (got $SVN::Core::VERSION)";
|
2006-12-16 08:58:07 +01:00
|
|
|
}
|
2007-01-10 10:22:38 +01:00
|
|
|
push @Git::SVN::Ra::ISA, 'SVN::Ra';
|
2006-12-16 08:58:07 +01:00
|
|
|
push @SVN::Git::Editor::ISA, 'SVN::Delta::Editor';
|
|
|
|
push @SVN::Git::Fetcher::ISA, 'SVN::Delta::Editor';
|
2006-02-16 10:24:16 +01:00
|
|
|
use Carp qw/croak/;
|
|
|
|
use IO::File qw//;
|
|
|
|
use File::Basename qw/dirname basename/;
|
|
|
|
use File::Path qw/mkpath/;
|
2007-04-03 10:57:08 +02:00
|
|
|
use Getopt::Long qw/:config gnu_getopt no_ignore_case auto_abbrev/;
|
2006-06-15 22:36:12 +02:00
|
|
|
use IPC::Open3;
|
2007-01-11 11:14:43 +01:00
|
|
|
use Git;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
|
2007-01-11 11:14:43 +01:00
|
|
|
BEGIN {
|
2007-06-15 05:43:59 +02:00
|
|
|
# import functions from Git into our packages, en masse
|
|
|
|
no strict 'refs';
|
2007-01-11 11:14:43 +01:00
|
|
|
foreach (qw/command command_oneline command_noisy command_output_pipe
|
|
|
|
command_input_pipe command_close_pipe/) {
|
2007-06-15 05:43:59 +02:00
|
|
|
for my $package ( qw(SVN::Git::Editor SVN::Git::Fetcher
|
|
|
|
Git::SVN::Migration Git::SVN::Log Git::SVN),
|
|
|
|
__PACKAGE__) {
|
|
|
|
*{"${package}::$_"} = \&{"Git::$_"};
|
|
|
|
}
|
2007-01-11 11:14:43 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2006-12-16 08:58:07 +01:00
|
|
|
my ($SVN);
|
2006-10-12 03:19:55 +02:00
|
|
|
|
2007-01-12 11:35:20 +01:00
|
|
|
$sha1 = qr/[a-f\d]{40}/;
|
|
|
|
$sha1_short = qr/[a-f\d]{4,40}/;
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($_stdin, $_help, $_edit,
|
2007-01-31 12:06:56 +01:00
|
|
|
$_message, $_file,
|
2007-01-16 07:59:26 +01:00
|
|
|
$_template, $_shared,
|
2007-05-03 07:51:35 +02:00
|
|
|
$_version, $_fetch_all, $_no_rebase,
|
2007-03-13 19:40:36 +01:00
|
|
|
$_merge, $_strategy, $_dry_run, $_local,
|
2007-02-16 12:22:40 +01:00
|
|
|
$_prefix, $_no_checkout, $_verbose);
|
2007-02-09 11:45:03 +01:00
|
|
|
$Git::SVN::_follow_parent = 1;
|
2007-01-19 02:50:01 +01:00
|
|
|
my %remote_opts = ( 'username=s' => \$Git::SVN::Prompt::_username,
|
|
|
|
'config-dir=s' => \$Git::SVN::Ra::config_dir,
|
|
|
|
'no-auth-cache' => \$Git::SVN::Prompt::_no_auth_cache );
|
2007-02-09 11:45:03 +01:00
|
|
|
my %fc_opts = ( 'follow-parent|follow!' => \$Git::SVN::_follow_parent,
|
2006-05-24 11:07:32 +02:00
|
|
|
'authors-file|A=s' => \$_authors,
|
2007-01-31 21:28:10 +01:00
|
|
|
'repack:i' => \$Git::SVN::_repack,
|
2007-02-12 00:21:24 +01:00
|
|
|
'noMetadata' => \$Git::SVN::_no_metadata,
|
|
|
|
'useSvmProps' => \$Git::SVN::_use_svm_props,
|
2007-02-17 04:57:29 +01:00
|
|
|
'useSvnsyncProps' => \$Git::SVN::_use_svnsync_props,
|
2007-02-15 01:04:10 +01:00
|
|
|
'log-window-size=i' => \$Git::SVN::Ra::_log_window_size,
|
2007-02-16 10:45:13 +01:00
|
|
|
'no-checkout' => \$_no_checkout,
|
2006-06-28 04:39:14 +02:00
|
|
|
'quiet|q' => \$_q,
|
2007-01-31 21:28:10 +01:00
|
|
|
'repack-flags|repack-args|repack-opts=s' =>
|
|
|
|
\$Git::SVN::_repack_flags,
|
2007-01-19 02:50:01 +01:00
|
|
|
%remote_opts );
|
2006-05-24 04:23:41 +02:00
|
|
|
|
2007-07-14 11:25:28 +02:00
|
|
|
my ($_trunk, $_tags, $_branches, $_stdlayout);
|
2007-02-18 11:34:09 +01:00
|
|
|
my %icv;
|
2007-02-14 21:27:41 +01:00
|
|
|
my %init_opts = ( 'template=s' => \$_template, 'shared:s' => \$_shared,
|
|
|
|
'trunk|T=s' => \$_trunk, 'tags|t=s' => \$_tags,
|
|
|
|
'branches|b=s' => \$_branches, 'prefix=s' => \$_prefix,
|
2007-07-14 11:25:28 +02:00
|
|
|
'stdlayout|s' => \$_stdlayout,
|
git-svn: don't attempt to minimize URLs by default
For tracking branches and tags, git-svn prefers to connect
to the root of the repository or at least the level that
houses branches and tags as well as trunk. However, users
that are accustomed to tracking a single directory have
no use for this feature.
As pointed out by Junio, users may not have permissions to
connect to connect to a higher-level path in the repository.
While the current minimize_url() function detects lack of
permissions to certain paths _after_ successful logins, it
cannot effectively determine if it is trying to access a
login-only portion of a repo when the user expects to
connect to a part where anonymous access is allowed.
For people used to the git-svnimport switches of
--trunk, --tags, --branches, they'll already pass the
repository root (or root+subdirectory), so minimize URL
isn't of too much use to them, either.
For people *not* used to git-svnimport, git-svn also
supports:
git svn init --minimize-url \
--trunk http://repository-root/foo/trunk \
--branches http://repository-root/foo/branches \
--tags http://repository-root/foo/tags
And this is where the new --minimize-url command-line switch
comes in to allow for this behavior to continue working.
2007-05-13 18:58:14 +02:00
|
|
|
'minimize-url|m' => \$Git::SVN::_minimize_url,
|
2007-02-18 11:34:09 +01:00
|
|
|
'no-metadata' => sub { $icv{noMetadata} = 1 },
|
|
|
|
'use-svm-props' => sub { $icv{useSvmProps} = 1 },
|
|
|
|
'use-svnsync-props' => sub { $icv{useSvnsyncProps} = 1 },
|
|
|
|
'rewrite-root=s' => sub { $icv{rewriteRoot} = $_[1] },
|
2007-02-14 21:27:41 +01:00
|
|
|
%remote_opts );
|
2006-06-28 04:39:12 +02:00
|
|
|
my %cmt_opts = ( 'edit|e' => \$_edit,
|
2007-01-29 09:07:49 +01:00
|
|
|
'rmdir' => \$SVN::Git::Editor::_rmdir,
|
|
|
|
'find-copies-harder' => \$SVN::Git::Editor::_find_copies_harder,
|
|
|
|
'l=i' => \$SVN::Git::Editor::_rename_limit,
|
|
|
|
'copy-similarity|C=i'=> \$SVN::Git::Editor::_cp_similarity
|
2006-06-28 04:39:12 +02:00
|
|
|
);
|
2006-06-13 00:53:13 +02:00
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
my %cmd = (
|
2007-01-05 03:09:56 +01:00
|
|
|
fetch => [ \&cmd_fetch, "Download new revisions from SVN",
|
2007-02-14 11:21:19 +01:00
|
|
|
{ 'revision|r=s' => \$_revision,
|
2007-02-16 12:22:40 +01:00
|
|
|
'fetch-all|all' => \$_fetch_all,
|
2007-02-14 11:21:19 +01:00
|
|
|
%fc_opts } ],
|
2007-02-17 03:45:01 +01:00
|
|
|
clone => [ \&cmd_clone, "Initialize and fetch revisions",
|
|
|
|
{ 'revision|r=s' => \$_revision,
|
|
|
|
%fc_opts, %init_opts } ],
|
2007-01-11 21:26:16 +01:00
|
|
|
init => [ \&cmd_init, "Initialize a repo for tracking" .
|
2006-06-01 00:49:56 +02:00
|
|
|
" (requires URL argument)",
|
2006-06-13 00:53:13 +02:00
|
|
|
\%init_opts ],
|
2007-02-14 21:27:41 +01:00
|
|
|
'multi-init' => [ \&cmd_multi_init,
|
|
|
|
"Deprecated alias for ".
|
|
|
|
"'$0 init -T<trunk> -b<branches> -t<tags>'",
|
|
|
|
\%init_opts ],
|
2007-01-14 12:14:28 +01:00
|
|
|
dcommit => [ \&cmd_dcommit,
|
|
|
|
'Commit several diffs to merge with upstream',
|
2006-12-16 08:58:08 +01:00
|
|
|
{ 'merge|m|M' => \$_merge,
|
|
|
|
'strategy|s=s' => \$_strategy,
|
2007-02-16 12:22:40 +01:00
|
|
|
'verbose|v' => \$_verbose,
|
2006-12-16 08:58:08 +01:00
|
|
|
'dry-run|n' => \$_dry_run,
|
2007-02-16 12:22:40 +01:00
|
|
|
'fetch-all|all' => \$_fetch_all,
|
2007-05-03 07:51:35 +02:00
|
|
|
'no-rebase' => \$_no_rebase,
|
2006-12-23 06:59:24 +01:00
|
|
|
%cmt_opts, %fc_opts } ],
|
2007-01-15 08:21:16 +01:00
|
|
|
'set-tree' => [ \&cmd_set_tree,
|
|
|
|
"Set an SVN repository to a git tree-ish",
|
|
|
|
{ 'stdin|' => \$_stdin, %cmt_opts, %fc_opts, } ],
|
2007-10-16 16:36:49 +02:00
|
|
|
'create-ignore' => [ \&cmd_create_ignore,
|
|
|
|
'Create a .gitignore per svn:ignore',
|
|
|
|
{ 'revision|r=i' => \$_revision
|
|
|
|
} ],
|
2007-10-16 16:36:50 +02:00
|
|
|
'propget' => [ \&cmd_propget,
|
|
|
|
'Print the value of a property on a file or directory',
|
|
|
|
{ 'revision|r=i' => \$_revision } ],
|
2007-10-16 16:36:51 +02:00
|
|
|
'proplist' => [ \&cmd_proplist,
|
|
|
|
'List all properties of a file or directory',
|
|
|
|
{ 'revision|r=i' => \$_revision } ],
|
2007-01-12 02:58:39 +01:00
|
|
|
'show-ignore' => [ \&cmd_show_ignore, "Show svn:ignore listings",
|
2007-09-07 02:00:08 +02:00
|
|
|
{ 'revision|r=i' => \$_revision
|
2007-09-05 11:35:29 +02:00
|
|
|
} ],
|
2007-01-14 11:17:00 +01:00
|
|
|
'multi-fetch' => [ \&cmd_multi_fetch,
|
2007-02-14 11:21:19 +01:00
|
|
|
"Deprecated alias for $0 fetch --all",
|
|
|
|
{ 'revision|r=s' => \$_revision, %fc_opts } ],
|
2007-01-19 02:50:01 +01:00
|
|
|
'migrate' => [ sub { },
|
|
|
|
# no-op, we automatically run this anyways,
|
|
|
|
'Migrate configuration/metadata/layout from
|
|
|
|
previous versions of git-svn',
|
2007-02-15 04:34:56 +01:00
|
|
|
{ 'minimize' => \$Git::SVN::Migration::_minimize,
|
|
|
|
%remote_opts } ],
|
2007-01-12 11:35:20 +01:00
|
|
|
'log' => [ \&Git::SVN::Log::cmd_show_log, 'Show commit logs',
|
|
|
|
{ 'limit=i' => \$Git::SVN::Log::limit,
|
2006-06-01 11:35:44 +02:00
|
|
|
'revision|r=s' => \$_revision,
|
2007-01-12 11:35:20 +01:00
|
|
|
'verbose|v' => \$Git::SVN::Log::verbose,
|
|
|
|
'incremental' => \$Git::SVN::Log::incremental,
|
|
|
|
'oneline' => \$Git::SVN::Log::oneline,
|
|
|
|
'show-commit' => \$Git::SVN::Log::show_commit,
|
|
|
|
'non-recursive' => \$Git::SVN::Log::non_recursive,
|
2006-06-01 11:35:44 +02:00
|
|
|
'authors-file|A=s' => \$_authors,
|
2007-01-12 11:35:20 +01:00
|
|
|
'color' => \$Git::SVN::Log::color,
|
2007-09-07 02:00:08 +02:00
|
|
|
'pager=s' => \$Git::SVN::Log::pager
|
2006-06-01 11:35:44 +02:00
|
|
|
} ],
|
2007-04-27 20:57:53 +02:00
|
|
|
'find-rev' => [ \&cmd_find_rev, "Translate between SVN revision numbers and tree-ish",
|
2007-09-07 02:00:08 +02:00
|
|
|
{} ],
|
2007-02-16 12:22:40 +01:00
|
|
|
'rebase' => [ \&cmd_rebase, "Fetch and rebase your working directory",
|
|
|
|
{ 'merge|m|M' => \$_merge,
|
|
|
|
'verbose|v' => \$_verbose,
|
|
|
|
'strategy|s=s' => \$_strategy,
|
2007-03-13 19:40:36 +01:00
|
|
|
'local|l' => \$_local,
|
2007-02-16 12:22:40 +01:00
|
|
|
'fetch-all|all' => \$_fetch_all,
|
|
|
|
%fc_opts } ],
|
2007-01-14 07:35:53 +01:00
|
|
|
'commit-diff' => [ \&cmd_commit_diff,
|
|
|
|
'Commit a diff between two trees',
|
2006-06-28 04:39:12 +02:00
|
|
|
{ 'message|m=s' => \$_message,
|
|
|
|
'file|F=s' => \$_file,
|
2006-11-09 10:19:37 +01:00
|
|
|
'revision|r=s' => \$_revision,
|
2006-06-28 04:39:12 +02:00
|
|
|
%cmt_opts } ],
|
2006-02-16 10:24:16 +01:00
|
|
|
);
|
2006-06-13 00:53:13 +02:00
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
my $cmd;
|
|
|
|
for (my $i = 0; $i < @ARGV; $i++) {
|
|
|
|
if (defined $cmd{$ARGV[$i]}) {
|
|
|
|
$cmd = $ARGV[$i];
|
|
|
|
splice @ARGV, $i, 1;
|
|
|
|
last;
|
|
|
|
}
|
|
|
|
};
|
|
|
|
|
2006-03-03 10:20:09 +01:00
|
|
|
my %opts = %{$cmd{$cmd}->[2]} if (defined $cmd);
|
2006-03-03 10:20:08 +01:00
|
|
|
|
2006-05-24 10:40:37 +02:00
|
|
|
read_repo_config(\%opts);
|
2007-04-17 11:41:43 +02:00
|
|
|
Getopt::Long::Configure('pass_through') if ($cmd && $cmd eq 'log');
|
2007-01-31 12:06:56 +01:00
|
|
|
my $rv = GetOptions(%opts, 'help|H|h' => \$_help, 'version|V' => \$_version,
|
|
|
|
'minimize-connections' => \$Git::SVN::Migration::_minimize,
|
|
|
|
'id|i=s' => \$Git::SVN::default_ref_id,
|
2007-02-17 11:53:07 +01:00
|
|
|
'svn-remote|remote|R=s' => sub {
|
|
|
|
$Git::SVN::no_reuse_existing = 1;
|
|
|
|
$Git::SVN::default_repo_id = $_[1] });
|
2007-04-17 11:41:43 +02:00
|
|
|
exit 1 if (!$rv && $cmd && $cmd ne 'log');
|
2006-03-03 10:20:09 +01:00
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
usage(0) if $_help;
|
2006-02-20 19:57:29 +01:00
|
|
|
version() if $_version;
|
2006-03-03 10:20:08 +01:00
|
|
|
usage(1) unless defined $cmd;
|
|
|
|
load_authors() if $_authors;
|
2007-02-20 10:36:30 +01:00
|
|
|
|
|
|
|
# make sure we're always running
|
|
|
|
unless ($cmd =~ /(?:clone|init|multi-init)$/) {
|
|
|
|
unless (-d $ENV{GIT_DIR}) {
|
|
|
|
if ($git_dir_user_set) {
|
|
|
|
die "GIT_DIR=$ENV{GIT_DIR} explicitly set, ",
|
|
|
|
"but it is not a directory\n";
|
|
|
|
}
|
|
|
|
my $git_dir = delete $ENV{GIT_DIR};
|
|
|
|
chomp(my $cdup = command_oneline(qw/rev-parse --show-cdup/));
|
|
|
|
unless (length $cdup) {
|
|
|
|
die "Already at toplevel, but $git_dir ",
|
|
|
|
"not found '$cdup'\n";
|
|
|
|
}
|
|
|
|
chdir $cdup or die "Unable to chdir up to '$cdup'\n";
|
|
|
|
unless (-d $git_dir) {
|
|
|
|
die "$git_dir still not found after going to ",
|
|
|
|
"'$cdup'\n";
|
|
|
|
}
|
|
|
|
$ENV{GIT_DIR} = $git_dir;
|
|
|
|
}
|
|
|
|
}
|
2007-02-17 03:45:01 +01:00
|
|
|
unless ($cmd =~ /^(?:clone|init|multi-init|commit-diff)$/) {
|
2007-01-19 02:50:01 +01:00
|
|
|
Git::SVN::Migration::migration_check();
|
|
|
|
}
|
2007-01-31 21:28:10 +01:00
|
|
|
Git::SVN::init_vars();
|
2007-01-22 22:52:04 +01:00
|
|
|
eval {
|
|
|
|
Git::SVN::verify_remotes_sanity();
|
|
|
|
$cmd{$cmd}->[0]->(@ARGV);
|
|
|
|
};
|
|
|
|
fatal $@ if $@;
|
2007-02-16 10:45:13 +01:00
|
|
|
post_fetch_checkout();
|
2006-02-16 10:24:16 +01:00
|
|
|
exit 0;
|
|
|
|
|
|
|
|
####################### primary functions ######################
|
|
|
|
sub usage {
|
|
|
|
my $exit = shift || 0;
|
|
|
|
my $fd = $exit ? \*STDERR : \*STDOUT;
|
|
|
|
print $fd <<"";
|
|
|
|
git-svn - bidirectional operations between a single Subversion tree and git
|
|
|
|
Usage: $0 <command> [options] [arguments]\n
|
2006-03-03 10:20:09 +01:00
|
|
|
|
|
|
|
print $fd "Available commands:\n" unless $cmd;
|
2006-02-16 10:24:16 +01:00
|
|
|
|
|
|
|
foreach (sort keys %cmd) {
|
2006-03-03 10:20:09 +01:00
|
|
|
next if $cmd && $cmd ne $_;
|
2007-02-15 04:34:56 +01:00
|
|
|
next if /^multi-/; # don't show deprecated commands
|
2006-10-11 23:53:36 +02:00
|
|
|
print $fd ' ',pack('A17',$_),$cmd{$_}->[1],"\n";
|
2007-11-03 19:53:34 +01:00
|
|
|
foreach (sort keys %{$cmd{$_}->[2]}) {
|
2007-04-03 10:57:08 +02:00
|
|
|
# mixed-case options are for .git/config only
|
|
|
|
next if /[A-Z]/ && /^[a-z]+$/i;
|
2006-03-03 10:20:09 +01:00
|
|
|
# prints out arguments as they should be passed:
|
2006-05-24 10:40:37 +02:00
|
|
|
my $x = s#[:=]s$## ? '<arg>' : s#[:=]i$## ? '<num>' : '';
|
2006-10-11 23:53:36 +02:00
|
|
|
print $fd ' ' x 21, join(', ', map { length $_ > 1 ?
|
2006-03-03 10:20:09 +01:00
|
|
|
"--$_" : "-$_" }
|
|
|
|
split /\|/,$_)," $x\n";
|
|
|
|
}
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
|
|
|
print $fd <<"";
|
2006-03-03 10:20:09 +01:00
|
|
|
\nGIT_SVN_ID may be set in the environment or via the --id/-i switch to an
|
|
|
|
arbitrary identifier if you're tracking multiple SVN branches/repositories in
|
|
|
|
one git repository and want to keep them separate. See git-svn(1) for more
|
|
|
|
information.
|
2006-02-16 10:24:16 +01:00
|
|
|
|
|
|
|
exit $exit;
|
|
|
|
}
|
|
|
|
|
2006-02-20 19:57:29 +01:00
|
|
|
sub version {
|
2006-12-28 10:16:20 +01:00
|
|
|
print "git-svn version $VERSION (svn $SVN::Core::VERSION)\n";
|
2006-02-20 19:57:29 +01:00
|
|
|
exit 0;
|
|
|
|
}
|
|
|
|
|
2007-01-12 00:35:55 +01:00
|
|
|
sub do_git_init_db {
|
|
|
|
unless (-d $ENV{GIT_DIR}) {
|
|
|
|
my @init_db = ('init');
|
|
|
|
push @init_db, "--template=$_template" if defined $_template;
|
2007-02-14 21:27:41 +01:00
|
|
|
if (defined $_shared) {
|
|
|
|
if ($_shared =~ /[a-z]/) {
|
|
|
|
push @init_db, "--shared=$_shared";
|
|
|
|
} else {
|
|
|
|
push @init_db, "--shared";
|
|
|
|
}
|
|
|
|
}
|
2007-01-12 00:35:55 +01:00
|
|
|
command_noisy(@init_db);
|
|
|
|
}
|
2007-02-18 11:34:09 +01:00
|
|
|
my $set;
|
|
|
|
my $pfx = "svn-remote.$Git::SVN::default_repo_id";
|
|
|
|
foreach my $i (keys %icv) {
|
|
|
|
die "'$set' and '$i' cannot both be set\n" if $set;
|
|
|
|
next unless defined $icv{$i};
|
|
|
|
command_noisy('config', "$pfx.$i", $icv{$i});
|
|
|
|
$set = $i;
|
|
|
|
}
|
2007-01-12 00:35:55 +01:00
|
|
|
}
|
|
|
|
|
2007-02-14 21:27:41 +01:00
|
|
|
sub init_subdir {
|
|
|
|
my $repo_path = shift or return;
|
|
|
|
mkpath([$repo_path]) unless -d $repo_path;
|
|
|
|
chdir $repo_path or die "Couldn't chdir to $repo_path: $!\n";
|
2007-02-23 10:26:26 +01:00
|
|
|
$ENV{GIT_DIR} = '.git';
|
2007-02-14 21:27:41 +01:00
|
|
|
}
|
|
|
|
|
2007-02-17 03:45:01 +01:00
|
|
|
sub cmd_clone {
|
|
|
|
my ($url, $path) = @_;
|
|
|
|
if (!defined $path &&
|
2007-07-14 11:25:28 +02:00
|
|
|
(defined $_trunk || defined $_branches || defined $_tags ||
|
|
|
|
defined $_stdlayout) &&
|
2007-02-17 03:45:01 +01:00
|
|
|
$url !~ m#^[a-z\+]+://#) {
|
|
|
|
$path = $url;
|
|
|
|
}
|
|
|
|
$path = basename($url) if !defined $path || !length $path;
|
2007-02-23 10:26:26 +01:00
|
|
|
cmd_init($url, $path);
|
2007-02-17 03:45:01 +01:00
|
|
|
Git::SVN::fetch_all($Git::SVN::default_repo_id);
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:26:16 +01:00
|
|
|
sub cmd_init {
|
2007-07-14 11:25:28 +02:00
|
|
|
if (defined $_stdlayout) {
|
|
|
|
$_trunk = 'trunk' if (!defined $_trunk);
|
|
|
|
$_tags = 'tags' if (!defined $_tags);
|
|
|
|
$_branches = 'branches' if (!defined $_branches);
|
|
|
|
}
|
2007-02-14 21:27:41 +01:00
|
|
|
if (defined $_trunk || defined $_branches || defined $_tags) {
|
|
|
|
return cmd_multi_init(@_);
|
2006-07-01 06:42:53 +02:00
|
|
|
}
|
2007-02-14 21:27:41 +01:00
|
|
|
my $url = shift or die "SVN repository location required ",
|
|
|
|
"as a command-line argument\n";
|
|
|
|
init_subdir(@_);
|
2007-01-12 00:35:55 +01:00
|
|
|
do_git_init_db();
|
2006-07-01 06:42:53 +02:00
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
Git::SVN->init($url);
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
|
|
|
|
2007-01-05 03:09:56 +01:00
|
|
|
sub cmd_fetch {
|
2007-02-14 11:21:19 +01:00
|
|
|
if (grep /^\d+=./, @_) {
|
|
|
|
die "'<rev>=<commit>' fetch arguments are ",
|
|
|
|
"no longer supported.\n";
|
2007-01-23 00:47:41 +01:00
|
|
|
}
|
2007-02-14 11:21:19 +01:00
|
|
|
my ($remote) = @_;
|
|
|
|
if (@_ > 1) {
|
2007-02-16 12:22:40 +01:00
|
|
|
die "Usage: $0 fetch [--all] [svn-remote]\n";
|
2007-02-14 11:21:19 +01:00
|
|
|
}
|
|
|
|
$remote ||= $Git::SVN::default_repo_id;
|
|
|
|
if ($_fetch_all) {
|
|
|
|
cmd_multi_fetch();
|
|
|
|
} else {
|
|
|
|
Git::SVN::fetch_all($remote, Git::SVN::read_all_remotes());
|
2007-01-14 11:17:00 +01:00
|
|
|
}
|
2007-01-05 03:09:56 +01:00
|
|
|
}
|
|
|
|
|
2007-01-15 08:21:16 +01:00
|
|
|
sub cmd_set_tree {
|
2006-02-16 10:24:16 +01:00
|
|
|
my (@commits) = @_;
|
|
|
|
if ($_stdin || !@commits) {
|
|
|
|
print "Reading from stdin...\n";
|
|
|
|
@commits = ();
|
|
|
|
while (<STDIN>) {
|
2006-03-03 10:20:09 +01:00
|
|
|
if (/\b($sha1_short)\b/o) {
|
2006-02-16 10:24:16 +01:00
|
|
|
unshift @commits, $1;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
my @revs;
|
2006-02-20 19:57:26 +01:00
|
|
|
foreach my $c (@commits) {
|
2006-12-15 19:59:54 +01:00
|
|
|
my @tmp = command('rev-parse',$c);
|
2006-02-20 19:57:26 +01:00
|
|
|
if (scalar @tmp == 1) {
|
|
|
|
push @revs, $tmp[0];
|
|
|
|
} elsif (scalar @tmp > 1) {
|
2006-12-15 19:59:54 +01:00
|
|
|
push @revs, reverse(command('rev-list',@tmp));
|
2006-02-20 19:57:26 +01:00
|
|
|
} else {
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal "Failed to rev-parse $c";
|
2006-02-20 19:57:26 +01:00
|
|
|
}
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
2007-01-15 08:21:16 +01:00
|
|
|
my $gs = Git::SVN->new;
|
|
|
|
my ($r_last, $cmt_last) = $gs->last_rev_commit;
|
|
|
|
$gs->fetch;
|
2007-01-25 20:53:13 +01:00
|
|
|
if (defined $gs->{last_rev} && $r_last != $gs->{last_rev}) {
|
2007-01-15 08:21:16 +01:00
|
|
|
fatal "There are new revisions that were fetched ",
|
|
|
|
"and need to be merged (or acknowledged) ",
|
|
|
|
"before committing.\nlast rev: $r_last\n",
|
2007-10-16 16:36:52 +02:00
|
|
|
" current: $gs->{last_rev}";
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
2007-01-15 08:21:16 +01:00
|
|
|
$gs->set_tree($_) foreach @revs;
|
|
|
|
print "Done committing ",scalar @revs," revisions to SVN\n";
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
2006-02-26 11:22:27 +01:00
|
|
|
|
2007-01-14 12:14:28 +01:00
|
|
|
sub cmd_dcommit {
|
|
|
|
my $head = shift;
|
2007-11-11 19:41:41 +01:00
|
|
|
git_cmd_try { command_oneline(qw/diff-index --quiet HEAD/) }
|
|
|
|
'Cannot dcommit with a dirty index. Commit your changes first'
|
|
|
|
. "or stash them with `git stash'.\n";
|
2007-01-14 12:14:28 +01:00
|
|
|
$head ||= 'HEAD';
|
2007-02-13 23:22:11 +01:00
|
|
|
my @refs;
|
2007-04-08 09:59:19 +02:00
|
|
|
my ($url, $rev, $uuid, $gs) = working_head_info($head, \@refs);
|
2007-08-23 07:14:31 +02:00
|
|
|
print "Committing to $url ...\n";
|
2007-04-08 09:59:19 +02:00
|
|
|
unless ($gs) {
|
2007-02-13 23:22:11 +01:00
|
|
|
die "Unable to determine upstream SVN information from ",
|
2007-02-16 12:22:40 +01:00
|
|
|
"$head history\n";
|
2007-02-13 23:22:11 +01:00
|
|
|
}
|
2006-11-09 10:19:37 +01:00
|
|
|
my $last_rev;
|
2007-06-13 11:23:28 +02:00
|
|
|
my ($linear_refs, $parents) = linearize_history($gs, \@refs);
|
2007-09-01 03:16:12 +02:00
|
|
|
if ($_no_rebase && scalar(@$linear_refs) > 1) {
|
|
|
|
warn "Attempting to commit more than one change while ",
|
|
|
|
"--no-rebase is enabled.\n",
|
|
|
|
"If these changes depend on each other, re-running ",
|
|
|
|
"without --no-rebase will be required."
|
|
|
|
}
|
2007-11-05 12:21:47 +01:00
|
|
|
while (1) {
|
|
|
|
my $d = shift @$linear_refs or last;
|
2006-11-09 10:19:37 +01:00
|
|
|
unless (defined $last_rev) {
|
|
|
|
(undef, $last_rev, undef) = cmt_metadata("$d~1");
|
|
|
|
unless (defined $last_rev) {
|
2007-01-14 12:14:28 +01:00
|
|
|
fatal "Unable to extract revision information ",
|
2007-10-16 16:36:52 +02:00
|
|
|
"from commit $d~1";
|
2006-11-09 10:19:37 +01:00
|
|
|
}
|
|
|
|
}
|
2006-08-26 09:01:23 +02:00
|
|
|
if ($_dry_run) {
|
|
|
|
print "diff-tree $d~1 $d\n";
|
|
|
|
} else {
|
2007-09-01 03:16:12 +02:00
|
|
|
my $cmt_rev;
|
2007-01-14 12:14:28 +01:00
|
|
|
my %ed_opts = ( r => $last_rev,
|
2007-01-27 23:33:08 +01:00
|
|
|
log => get_commit_entry($d)->{log},
|
2007-05-12 23:36:20 +02:00
|
|
|
ra => Git::SVN::Ra->new($gs->full_url),
|
2007-01-27 23:33:08 +01:00
|
|
|
tree_a => "$d~1",
|
|
|
|
tree_b => $d,
|
|
|
|
editor_cb => sub {
|
|
|
|
print "Committed r$_[0]\n";
|
2007-09-01 03:16:12 +02:00
|
|
|
$cmt_rev = $_[0];
|
|
|
|
},
|
2007-02-13 23:22:11 +01:00
|
|
|
svn_path => '');
|
2007-01-27 23:33:08 +01:00
|
|
|
if (!SVN::Git::Editor->new(\%ed_opts)->apply_diff) {
|
2007-01-14 12:14:28 +01:00
|
|
|
print "No changes\n$d~1 == $d\n";
|
2007-06-13 11:23:28 +02:00
|
|
|
} elsif ($parents->{$d} && @{$parents->{$d}}) {
|
2007-09-01 03:16:12 +02:00
|
|
|
$gs->{inject_parents_dcommit}->{$cmt_rev} =
|
2007-06-13 11:23:28 +02:00
|
|
|
$parents->{$d};
|
2007-01-14 12:14:28 +01:00
|
|
|
}
|
2007-09-01 03:16:12 +02:00
|
|
|
$_fetch_all ? $gs->fetch_all : $gs->fetch;
|
|
|
|
next if $_no_rebase;
|
|
|
|
|
|
|
|
# we always want to rebase against the current HEAD,
|
|
|
|
# not any head that was passed to us
|
2007-11-05 12:21:47 +01:00
|
|
|
my @diff = command('diff-tree', $d,
|
2007-09-01 03:16:12 +02:00
|
|
|
$gs->refname, '--');
|
|
|
|
my @finish;
|
|
|
|
if (@diff) {
|
|
|
|
@finish = rebase_cmd();
|
2007-11-05 12:21:47 +01:00
|
|
|
print STDERR "W: $d and ", $gs->refname,
|
2007-09-01 03:16:12 +02:00
|
|
|
" differ, using @finish:\n",
|
2007-11-05 12:21:47 +01:00
|
|
|
join("\n", @diff), "\n";
|
2007-09-01 03:16:12 +02:00
|
|
|
} else {
|
|
|
|
print "No changes between current HEAD and ",
|
|
|
|
$gs->refname,
|
|
|
|
"\nResetting to the latest ",
|
|
|
|
$gs->refname, "\n";
|
|
|
|
@finish = qw/reset --mixed/;
|
|
|
|
}
|
|
|
|
command_noisy(@finish, $gs->refname);
|
2007-11-05 12:21:47 +01:00
|
|
|
if (@diff) {
|
|
|
|
@refs = ();
|
|
|
|
my ($url_, $rev_, $uuid_, $gs_) =
|
|
|
|
working_head_info($head, \@refs);
|
|
|
|
my ($linear_refs_, $parents_) =
|
|
|
|
linearize_history($gs_, \@refs);
|
|
|
|
if (scalar(@$linear_refs) !=
|
|
|
|
scalar(@$linear_refs_)) {
|
|
|
|
fatal "# of revisions changed ",
|
|
|
|
"\nbefore:\n",
|
|
|
|
join("\n", @$linear_refs),
|
|
|
|
"\n\nafter:\n",
|
|
|
|
join("\n", @$linear_refs_), "\n",
|
|
|
|
'If you are attempting to commit ',
|
|
|
|
"merges, try running:\n\t",
|
|
|
|
'git rebase --interactive',
|
|
|
|
'--preserve-merges ',
|
|
|
|
$gs->refname,
|
|
|
|
"\nBefore dcommitting";
|
|
|
|
}
|
|
|
|
if ($url_ ne $url) {
|
|
|
|
fatal "URL mismatch after rebase: ",
|
|
|
|
"$url_ != $url";
|
|
|
|
}
|
|
|
|
if ($uuid_ ne $uuid) {
|
|
|
|
fatal "uuid mismatch after rebase: ",
|
|
|
|
"$uuid_ != $uuid";
|
|
|
|
}
|
|
|
|
# remap parents
|
|
|
|
my (%p, @l, $i);
|
|
|
|
for ($i = 0; $i < scalar @$linear_refs; $i++) {
|
|
|
|
my $new = $linear_refs_->[$i] or next;
|
|
|
|
$p{$new} =
|
|
|
|
$parents->{$linear_refs->[$i]};
|
|
|
|
push @l, $new;
|
|
|
|
}
|
|
|
|
$parents = \%p;
|
|
|
|
$linear_refs = \@l;
|
|
|
|
}
|
2007-09-01 03:16:12 +02:00
|
|
|
$last_rev = $cmt_rev;
|
2006-08-26 09:01:23 +02:00
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-04-27 20:57:53 +02:00
|
|
|
sub cmd_find_rev {
|
|
|
|
my $revision_or_hash = shift;
|
|
|
|
my $result;
|
|
|
|
if ($revision_or_hash =~ /^r\d+$/) {
|
2007-04-29 10:35:27 +02:00
|
|
|
my $head = shift;
|
|
|
|
$head ||= 'HEAD';
|
|
|
|
my @refs;
|
|
|
|
my (undef, undef, undef, $gs) = working_head_info($head, \@refs);
|
|
|
|
unless ($gs) {
|
|
|
|
die "Unable to determine upstream SVN information from ",
|
|
|
|
"$head history\n";
|
2007-04-27 20:57:53 +02:00
|
|
|
}
|
2007-04-29 10:35:27 +02:00
|
|
|
my $desired_revision = substr($revision_or_hash, 1);
|
|
|
|
$result = $gs->rev_db_get($desired_revision);
|
2007-04-27 20:57:53 +02:00
|
|
|
} else {
|
|
|
|
my (undef, $rev, undef) = cmt_metadata($revision_or_hash);
|
|
|
|
$result = $rev;
|
|
|
|
}
|
|
|
|
print "$result\n" if $result;
|
|
|
|
}
|
|
|
|
|
2007-02-16 12:22:40 +01:00
|
|
|
sub cmd_rebase {
|
|
|
|
command_noisy(qw/update-index --refresh/);
|
2007-04-08 09:59:19 +02:00
|
|
|
my ($url, $rev, $uuid, $gs) = working_head_info('HEAD');
|
|
|
|
unless ($gs) {
|
2007-02-16 12:22:40 +01:00
|
|
|
die "Unable to determine upstream SVN information from ",
|
|
|
|
"working tree history\n";
|
|
|
|
}
|
|
|
|
if (command(qw/diff-index HEAD --/)) {
|
|
|
|
print STDERR "Cannot rebase with uncommited changes:\n";
|
|
|
|
command_noisy('status');
|
|
|
|
exit 1;
|
|
|
|
}
|
2007-03-13 19:40:36 +01:00
|
|
|
unless ($_local) {
|
|
|
|
$_fetch_all ? $gs->fetch_all : $gs->fetch;
|
|
|
|
}
|
2007-02-16 12:22:40 +01:00
|
|
|
command_noisy(rebase_cmd(), $gs->refname);
|
|
|
|
}
|
|
|
|
|
2007-01-12 02:58:39 +01:00
|
|
|
sub cmd_show_ignore {
|
2007-04-08 09:59:19 +02:00
|
|
|
my ($url, $rev, $uuid, $gs) = working_head_info('HEAD');
|
|
|
|
$gs ||= Git::SVN->new;
|
2007-01-12 02:58:39 +01:00
|
|
|
my $r = (defined $_revision ? $_revision : $gs->ra->get_latest_revnum);
|
2007-10-16 16:36:48 +02:00
|
|
|
$gs->prop_walk($gs->{path}, $r, sub {
|
|
|
|
my ($gs, $path, $props) = @_;
|
|
|
|
print STDOUT "\n# $path\n";
|
|
|
|
my $s = $props->{'svn:ignore'} or return;
|
|
|
|
$s =~ s/[\r\n]+/\n/g;
|
|
|
|
chomp $s;
|
|
|
|
$s =~ s#^#$path#gm;
|
|
|
|
print STDOUT "$s\n";
|
|
|
|
});
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
|
|
|
|
2007-10-16 16:36:49 +02:00
|
|
|
sub cmd_create_ignore {
|
|
|
|
my ($url, $rev, $uuid, $gs) = working_head_info('HEAD');
|
|
|
|
$gs ||= Git::SVN->new;
|
|
|
|
my $r = (defined $_revision ? $_revision : $gs->ra->get_latest_revnum);
|
|
|
|
$gs->prop_walk($gs->{path}, $r, sub {
|
|
|
|
my ($gs, $path, $props) = @_;
|
|
|
|
# $path is of the form /path/to/dir/
|
|
|
|
my $ignore = '.' . $path . '.gitignore';
|
|
|
|
my $s = $props->{'svn:ignore'} or return;
|
|
|
|
open(GITIGNORE, '>', $ignore)
|
2007-10-16 16:36:52 +02:00
|
|
|
or fatal("Failed to open `$ignore' for writing: $!");
|
2007-10-16 16:36:49 +02:00
|
|
|
$s =~ s/[\r\n]+/\n/g;
|
|
|
|
chomp $s;
|
|
|
|
# Prefix all patterns so that the ignore doesn't apply
|
|
|
|
# to sub-directories.
|
|
|
|
$s =~ s#^#/#gm;
|
|
|
|
print GITIGNORE "$s\n";
|
|
|
|
close(GITIGNORE)
|
2007-10-16 16:36:52 +02:00
|
|
|
or fatal("Failed to close `$ignore': $!");
|
2007-10-16 16:36:49 +02:00
|
|
|
command_noisy('add', $ignore);
|
|
|
|
});
|
|
|
|
}
|
|
|
|
|
2007-10-16 16:36:50 +02:00
|
|
|
# get_svnprops(PATH)
|
|
|
|
# ------------------
|
2007-10-16 16:36:51 +02:00
|
|
|
# Helper for cmd_propget and cmd_proplist below.
|
2007-10-16 16:36:50 +02:00
|
|
|
sub get_svnprops {
|
|
|
|
my $path = shift;
|
|
|
|
my ($url, $rev, $uuid, $gs) = working_head_info('HEAD');
|
|
|
|
$gs ||= Git::SVN->new;
|
|
|
|
|
|
|
|
# prefix THE PATH by the sub-directory from which the user
|
|
|
|
# invoked us.
|
|
|
|
$path = $cmd_dir_prefix . $path;
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal("No such file or directory: $path") unless -e $path;
|
2007-10-16 16:36:50 +02:00
|
|
|
my $is_dir = -d $path ? 1 : 0;
|
|
|
|
$path = $gs->{path} . '/' . $path;
|
|
|
|
|
|
|
|
# canonicalize the path (otherwise libsvn will abort or fail to
|
|
|
|
# find the file)
|
|
|
|
# File::Spec->canonpath doesn't collapse x/../y into y (for a
|
|
|
|
# good reason), so let's do this manually.
|
|
|
|
$path =~ s#/+#/#g;
|
|
|
|
$path =~ s#/\.(?:/|$)#/#g;
|
|
|
|
$path =~ s#/[^/]+/\.\.##g;
|
|
|
|
$path =~ s#/$##g;
|
|
|
|
|
|
|
|
my $r = (defined $_revision ? $_revision : $gs->ra->get_latest_revnum);
|
|
|
|
my $props;
|
|
|
|
if ($is_dir) {
|
|
|
|
(undef, undef, $props) = $gs->ra->get_dir($path, $r);
|
|
|
|
}
|
|
|
|
else {
|
|
|
|
(undef, $props) = $gs->ra->get_file($path, $r, undef);
|
|
|
|
}
|
|
|
|
return $props;
|
|
|
|
}
|
|
|
|
|
|
|
|
# cmd_propget (PROP, PATH)
|
|
|
|
# ------------------------
|
|
|
|
# Print the SVN property PROP for PATH.
|
|
|
|
sub cmd_propget {
|
|
|
|
my ($prop, $path) = @_;
|
|
|
|
$path = '.' if not defined $path;
|
|
|
|
usage(1) if not defined $prop;
|
|
|
|
my $props = get_svnprops($path);
|
|
|
|
if (not defined $props->{$prop}) {
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal("`$path' does not have a `$prop' SVN property.");
|
2007-10-16 16:36:50 +02:00
|
|
|
}
|
|
|
|
print $props->{$prop} . "\n";
|
|
|
|
}
|
|
|
|
|
2007-10-16 16:36:51 +02:00
|
|
|
# cmd_proplist (PATH)
|
|
|
|
# -------------------
|
|
|
|
# Print the list of SVN properties for PATH.
|
|
|
|
sub cmd_proplist {
|
|
|
|
my $path = shift;
|
|
|
|
$path = '.' if not defined $path;
|
|
|
|
my $props = get_svnprops($path);
|
|
|
|
print "Properties on '$path':\n";
|
|
|
|
foreach (sort keys %{$props}) {
|
|
|
|
print " $_\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-12 00:35:55 +01:00
|
|
|
sub cmd_multi_init {
|
2006-06-13 00:53:13 +02:00
|
|
|
my $url = shift;
|
2007-01-05 03:02:00 +01:00
|
|
|
unless (defined $_trunk || defined $_branches || defined $_tags) {
|
|
|
|
usage(1);
|
2006-06-13 00:53:13 +02:00
|
|
|
}
|
2007-05-19 12:59:02 +02:00
|
|
|
|
|
|
|
# there are currently some bugs that prevent multi-init/multi-fetch
|
|
|
|
# setups from working well without this.
|
|
|
|
$Git::SVN::_minimize_url = 1;
|
|
|
|
|
2007-01-12 00:35:55 +01:00
|
|
|
$_prefix = '' unless defined $_prefix;
|
2007-02-14 21:27:41 +01:00
|
|
|
if (defined $url) {
|
|
|
|
$url =~ s#/+$##;
|
|
|
|
init_subdir(@_);
|
|
|
|
}
|
2007-02-23 10:26:26 +01:00
|
|
|
do_git_init_db();
|
2007-01-05 03:02:00 +01:00
|
|
|
if (defined $_trunk) {
|
2007-01-19 02:50:01 +01:00
|
|
|
my $trunk_ref = $_prefix . 'trunk';
|
|
|
|
# try both old-style and new-style lookups:
|
|
|
|
my $gs_trunk = eval { Git::SVN->new($trunk_ref) };
|
2007-01-12 00:35:55 +01:00
|
|
|
unless ($gs_trunk) {
|
2007-01-19 02:50:01 +01:00
|
|
|
my ($trunk_url, $trunk_path) =
|
|
|
|
complete_svn_url($url, $_trunk);
|
|
|
|
$gs_trunk = Git::SVN->init($trunk_url, $trunk_path,
|
|
|
|
undef, $trunk_ref);
|
2007-01-05 03:02:00 +01:00
|
|
|
}
|
2006-10-11 20:53:21 +02:00
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
return unless defined $_branches || defined $_tags;
|
2007-01-12 02:09:26 +01:00
|
|
|
my $ra = $url ? Git::SVN::Ra->new($url) : undef;
|
|
|
|
complete_url_ls_init($ra, $_branches, '--branches/-b', $_prefix);
|
|
|
|
complete_url_ls_init($ra, $_tags, '--tags/-t', $_prefix . 'tags/');
|
2006-06-13 00:53:13 +02:00
|
|
|
}
|
|
|
|
|
2007-01-14 11:17:00 +01:00
|
|
|
sub cmd_multi_fetch {
|
2007-01-28 07:28:56 +01:00
|
|
|
my $remotes = Git::SVN::read_all_remotes();
|
|
|
|
foreach my $repo_id (sort keys %$remotes) {
|
2007-02-13 09:38:02 +01:00
|
|
|
if ($remotes->{$repo_id}->{url}) {
|
2007-02-03 22:29:17 +01:00
|
|
|
Git::SVN::fetch_all($repo_id, $remotes);
|
|
|
|
}
|
2006-06-13 00:53:13 +02:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
# this command is special because it requires no metadata
|
|
|
|
sub cmd_commit_diff {
|
|
|
|
my ($ta, $tb, $url) = @_;
|
|
|
|
my $usage = "Usage: $0 commit-diff -r<revision> ".
|
2007-10-16 16:36:52 +02:00
|
|
|
"<tree-ish> <tree-ish> [<URL>]";
|
2007-01-14 07:35:53 +01:00
|
|
|
fatal($usage) if (!defined $ta || !defined $tb);
|
2007-01-26 10:32:45 +01:00
|
|
|
my $svn_path;
|
2007-01-14 07:35:53 +01:00
|
|
|
if (!defined $url) {
|
|
|
|
my $gs = eval { Git::SVN->new };
|
|
|
|
if (!$gs) {
|
|
|
|
fatal("Needed URL or usable git-svn --id in ",
|
|
|
|
"the command-line\n", $usage);
|
|
|
|
}
|
|
|
|
$url = $gs->{url};
|
2007-01-26 10:32:45 +01:00
|
|
|
$svn_path = $gs->{path};
|
2007-01-14 07:35:53 +01:00
|
|
|
}
|
|
|
|
unless (defined $_revision) {
|
|
|
|
fatal("-r|--revision is a required argument\n", $usage);
|
|
|
|
}
|
|
|
|
if (defined $_message && defined $_file) {
|
|
|
|
fatal("Both --message/-m and --file/-F specified ",
|
|
|
|
"for the commit message.\n",
|
2007-10-16 16:36:52 +02:00
|
|
|
"I have no idea what you mean");
|
2007-01-14 07:35:53 +01:00
|
|
|
}
|
|
|
|
if (defined $_file) {
|
|
|
|
$_message = file_to_s($_file);
|
|
|
|
} else {
|
|
|
|
$_message ||= get_commit_entry($tb)->{log};
|
|
|
|
}
|
|
|
|
my $ra ||= Git::SVN::Ra->new($url);
|
2007-01-26 10:32:45 +01:00
|
|
|
$svn_path ||= $ra->{svn_path};
|
2007-01-14 07:35:53 +01:00
|
|
|
my $r = $_revision;
|
|
|
|
if ($r eq 'HEAD') {
|
|
|
|
$r = $ra->get_latest_revnum;
|
|
|
|
} elsif ($r !~ /^\d+$/) {
|
|
|
|
die "revision argument: $r not understood by git-svn\n";
|
|
|
|
}
|
2007-01-27 23:33:08 +01:00
|
|
|
my %ed_opts = ( r => $r,
|
|
|
|
log => $_message,
|
|
|
|
ra => $ra,
|
|
|
|
tree_a => $ta,
|
|
|
|
tree_b => $tb,
|
|
|
|
editor_cb => sub { print "Committed r$_[0]\n" },
|
|
|
|
svn_path => $svn_path );
|
|
|
|
if (!SVN::Git::Editor->new(\%ed_opts)->apply_diff) {
|
2007-01-14 07:35:53 +01:00
|
|
|
print "No changes\n$ta == $tb\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
########################### utility functions #########################
|
|
|
|
|
2007-02-16 12:22:40 +01:00
|
|
|
sub rebase_cmd {
|
|
|
|
my @cmd = qw/rebase/;
|
|
|
|
push @cmd, '-v' if $_verbose;
|
|
|
|
push @cmd, qw/--merge/ if $_merge;
|
|
|
|
push @cmd, "--strategy=$_strategy" if $_strategy;
|
|
|
|
@cmd;
|
|
|
|
}
|
|
|
|
|
2007-02-16 10:45:13 +01:00
|
|
|
sub post_fetch_checkout {
|
|
|
|
return if $_no_checkout;
|
|
|
|
my $gs = $Git::SVN::_head or return;
|
|
|
|
return if verify_ref('refs/heads/master^0');
|
|
|
|
|
|
|
|
my $valid_head = verify_ref('HEAD^0');
|
|
|
|
command_noisy(qw(update-ref refs/heads/master), $gs->refname);
|
|
|
|
return if ($valid_head || !verify_ref('HEAD^0'));
|
|
|
|
|
|
|
|
return if $ENV{GIT_DIR} !~ m#^(?:.*/)?\.git$#;
|
|
|
|
my $index = $ENV{GIT_INDEX_FILE} || "$ENV{GIT_DIR}/index";
|
|
|
|
return if -f $index;
|
|
|
|
|
2007-06-03 16:48:16 +02:00
|
|
|
return if command_oneline(qw/rev-parse --is-inside-work-tree/) eq 'false';
|
2007-02-16 10:45:13 +01:00
|
|
|
return if command_oneline(qw/rev-parse --is-inside-git-dir/) eq 'true';
|
|
|
|
command_noisy(qw/read-tree -m -u -v HEAD HEAD/);
|
|
|
|
print STDERR "Checked out HEAD:\n ",
|
|
|
|
$gs->full_url, " r", $gs->last_rev, "\n";
|
|
|
|
}
|
|
|
|
|
2007-01-05 03:02:00 +01:00
|
|
|
sub complete_svn_url {
|
|
|
|
my ($url, $path) = @_;
|
|
|
|
$path =~ s#/+$##;
|
|
|
|
if ($path !~ m#^[a-z\+]+://#) {
|
|
|
|
if (!defined $url || $url !~ m#^[a-z\+]+://#) {
|
|
|
|
fatal("E: '$path' is not a complete URL ",
|
2007-10-16 16:36:52 +02:00
|
|
|
"and a separate URL is not specified");
|
2007-01-05 03:02:00 +01:00
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
return ($url, $path);
|
2007-01-05 03:02:00 +01:00
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
return ($path, '');
|
2007-01-05 03:02:00 +01:00
|
|
|
}
|
|
|
|
|
2006-06-13 00:53:13 +02:00
|
|
|
sub complete_url_ls_init {
|
2007-01-19 02:50:01 +01:00
|
|
|
my ($ra, $repo_path, $switch, $pfx) = @_;
|
|
|
|
unless ($repo_path) {
|
2006-06-13 00:53:13 +02:00
|
|
|
print STDERR "W: $switch not specified\n";
|
|
|
|
return;
|
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
$repo_path =~ s#/+$##;
|
|
|
|
if ($repo_path =~ m#^[a-z\+]+://#) {
|
|
|
|
$ra = Git::SVN::Ra->new($repo_path);
|
|
|
|
$repo_path = '';
|
2007-01-12 02:09:26 +01:00
|
|
|
} else {
|
2007-01-19 02:50:01 +01:00
|
|
|
$repo_path =~ s#^/+##;
|
2007-01-12 02:09:26 +01:00
|
|
|
unless ($ra) {
|
2007-01-19 02:50:01 +01:00
|
|
|
fatal("E: '$repo_path' is not a complete URL ",
|
2007-10-16 16:36:52 +02:00
|
|
|
"and a separate URL is not specified");
|
2007-01-12 00:35:55 +01:00
|
|
|
}
|
2007-01-12 02:09:26 +01:00
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
my $url = $ra->{url};
|
2007-02-15 00:10:44 +01:00
|
|
|
my $gs = Git::SVN->init($url, undef, undef, undef, 1);
|
|
|
|
my $k = "svn-remote.$gs->{repo_id}.url";
|
|
|
|
my $orig_url = eval { command_oneline(qw/config --get/, $k) };
|
|
|
|
if ($orig_url && ($orig_url ne $gs->{url})) {
|
|
|
|
die "$k already set: $orig_url\n",
|
|
|
|
"wanted to set to: $gs->{url}\n";
|
2007-02-01 12:59:07 +01:00
|
|
|
}
|
2007-02-15 00:10:44 +01:00
|
|
|
command_oneline('config', $k, $gs->{url}) unless $orig_url;
|
|
|
|
my $remote_path = "$ra->{svn_path}/$repo_path/*";
|
|
|
|
$remote_path =~ s#/+#/#g;
|
|
|
|
$remote_path =~ s#^/##g;
|
|
|
|
my ($n) = ($switch =~ /^--(\w+)/);
|
|
|
|
if (length $pfx && $pfx !~ m#/$#) {
|
|
|
|
die "--prefix='$pfx' must have a trailing slash '/'\n";
|
2006-06-13 00:53:13 +02:00
|
|
|
}
|
2007-02-15 00:10:44 +01:00
|
|
|
command_noisy('config', "svn-remote.$gs->{repo_id}.$n",
|
|
|
|
"$remote_path:refs/remotes/$pfx*");
|
2006-06-13 00:53:13 +02:00
|
|
|
}
|
|
|
|
|
2006-12-15 19:59:54 +01:00
|
|
|
sub verify_ref {
|
|
|
|
my ($ref) = @_;
|
2006-12-28 10:16:21 +01:00
|
|
|
eval { command_oneline([ 'rev-parse', '--verify', $ref ],
|
|
|
|
{ STDERR => 0 }); };
|
2006-12-15 19:59:54 +01:00
|
|
|
}
|
|
|
|
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
sub get_tree_from_treeish {
|
2006-02-20 19:57:28 +01:00
|
|
|
my ($treeish) = @_;
|
2007-01-14 07:35:53 +01:00
|
|
|
# $treeish can be a symbolic ref, too:
|
2006-12-15 19:59:54 +01:00
|
|
|
my $type = command_oneline(qw/cat-file -t/, $treeish);
|
2006-02-20 19:57:28 +01:00
|
|
|
my $expected;
|
|
|
|
while ($type eq 'tag') {
|
2006-12-15 19:59:54 +01:00
|
|
|
($treeish, $type) = command(qw/cat-file tag/, $treeish);
|
2006-02-20 19:57:28 +01:00
|
|
|
}
|
|
|
|
if ($type eq 'commit') {
|
2006-12-15 19:59:54 +01:00
|
|
|
$expected = (grep /^tree /, command(qw/cat-file commit/,
|
|
|
|
$treeish))[0];
|
2007-01-14 07:35:53 +01:00
|
|
|
($expected) = ($expected =~ /^tree ($sha1)$/o);
|
2006-02-20 19:57:28 +01:00
|
|
|
die "Unable to get tree from $treeish\n" unless $expected;
|
|
|
|
} elsif ($type eq 'tree') {
|
|
|
|
$expected = $treeish;
|
|
|
|
} else {
|
|
|
|
die "$treeish is a $type, expected tree, tag or commit\n";
|
|
|
|
}
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
return $expected;
|
|
|
|
}
|
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
sub get_commit_entry {
|
|
|
|
my ($treeish) = shift;
|
|
|
|
my %log_entry = ( log => '', tree => get_tree_from_treeish($treeish) );
|
|
|
|
my $commit_editmsg = "$ENV{GIT_DIR}/COMMIT_EDITMSG";
|
|
|
|
my $commit_msg = "$ENV{GIT_DIR}/COMMIT_MSG";
|
|
|
|
open my $log_fh, '>', $commit_editmsg or croak $!;
|
2006-02-16 10:24:16 +01:00
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
my $type = command_oneline(qw/cat-file -t/, $treeish);
|
2006-07-10 05:20:48 +02:00
|
|
|
if ($type eq 'commit' || $type eq 'tag') {
|
2006-12-15 19:59:54 +01:00
|
|
|
my ($msg_fh, $ctx) = command_output_pipe('cat-file',
|
2007-01-14 07:35:53 +01:00
|
|
|
$type, $treeish);
|
2006-02-16 10:24:16 +01:00
|
|
|
my $in_msg = 0;
|
|
|
|
while (<$msg_fh>) {
|
|
|
|
if (!$in_msg) {
|
|
|
|
$in_msg = 1 if (/^\s*$/);
|
2006-03-03 10:20:08 +01:00
|
|
|
} elsif (/^git-svn-id: /) {
|
2007-01-14 07:35:53 +01:00
|
|
|
# skip this for now, we regenerate the
|
|
|
|
# correct one on re-fetch anyways
|
|
|
|
# TODO: set *:merge properties or like...
|
2006-02-16 10:24:16 +01:00
|
|
|
} else {
|
2007-01-14 07:35:53 +01:00
|
|
|
print $log_fh $_ or croak $!;
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
|
|
|
}
|
2006-12-15 19:59:54 +01:00
|
|
|
command_close_pipe($msg_fh, $ctx);
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
2007-01-14 07:35:53 +01:00
|
|
|
close $log_fh or croak $!;
|
2006-02-16 10:24:16 +01:00
|
|
|
|
|
|
|
if ($_edit || ($type eq 'tree')) {
|
|
|
|
my $editor = $ENV{VISUAL} || $ENV{EDITOR} || 'vi';
|
2007-01-14 07:35:53 +01:00
|
|
|
# TODO: strip out spaces, comments, like git-commit.sh
|
|
|
|
system($editor, $commit_editmsg);
|
2006-02-16 10:24:16 +01:00
|
|
|
}
|
2007-01-14 07:35:53 +01:00
|
|
|
rename $commit_editmsg, $commit_msg or croak $!;
|
|
|
|
open $log_fh, '<', $commit_msg or croak $!;
|
|
|
|
{ local $/; chomp($log_entry{log} = <$log_fh>); }
|
|
|
|
close $log_fh or croak $!;
|
|
|
|
unlink $commit_msg;
|
|
|
|
\%log_entry;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
sub s_to_file {
|
|
|
|
my ($str, $file, $mode) = @_;
|
|
|
|
open my $fd,'>',$file or croak $!;
|
|
|
|
print $fd $str,"\n" or croak $!;
|
|
|
|
close $fd or croak $!;
|
|
|
|
chmod ($mode &~ umask, $file) if (defined $mode);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub file_to_s {
|
|
|
|
my $file = shift;
|
|
|
|
open my $fd,'<',$file or croak "$!: file: $file\n";
|
|
|
|
local $/;
|
|
|
|
my $ret = <$fd>;
|
|
|
|
close $fd or croak $!;
|
|
|
|
$ret =~ s/\s*$//s;
|
|
|
|
return $ret;
|
|
|
|
}
|
|
|
|
|
2006-03-03 10:20:08 +01:00
|
|
|
# '<svn username> = real-name <email address>' mapping based on git-svnimport:
|
|
|
|
sub load_authors {
|
|
|
|
open my $authors, '<', $_authors or die "Can't open $_authors $!\n";
|
2007-01-12 11:35:20 +01:00
|
|
|
my $log = $cmd eq 'log';
|
2006-03-03 10:20:08 +01:00
|
|
|
while (<$authors>) {
|
|
|
|
chomp;
|
2007-07-17 19:02:57 +02:00
|
|
|
next unless /^(.+?|\(no author\))\s*=\s*(.+?)\s*<(.+)>\s*$/;
|
2006-03-03 10:20:08 +01:00
|
|
|
my ($user, $name, $email) = ($1, $2, $3);
|
2007-01-12 11:35:20 +01:00
|
|
|
if ($log) {
|
|
|
|
$Git::SVN::Log::rusers{"$name <$email>"} = $user;
|
|
|
|
} else {
|
|
|
|
$users{$user} = [$name, $email];
|
|
|
|
}
|
2006-06-01 11:35:44 +02:00
|
|
|
}
|
|
|
|
close $authors or croak $!;
|
|
|
|
}
|
|
|
|
|
2007-01-29 01:16:53 +01:00
|
|
|
# convert GetOpt::Long specs for use by git-config
|
2006-05-24 10:40:37 +02:00
|
|
|
sub read_repo_config {
|
2007-01-19 02:50:01 +01:00
|
|
|
return unless -d $ENV{GIT_DIR};
|
2006-05-24 10:40:37 +02:00
|
|
|
my $opts = shift;
|
2007-02-12 00:21:24 +01:00
|
|
|
my @config_only;
|
2006-05-24 10:40:37 +02:00
|
|
|
foreach my $o (keys %$opts) {
|
2007-02-12 00:21:24 +01:00
|
|
|
# if we have mixedCase and a long option-only, then
|
|
|
|
# it's a config-only variable that we don't need for
|
|
|
|
# the command-line.
|
|
|
|
push @config_only, $o if ($o =~ /[A-Z]/ && $o =~ /^[a-z]+$/i);
|
2006-05-24 10:40:37 +02:00
|
|
|
my $v = $opts->{$o};
|
2007-02-12 00:21:24 +01:00
|
|
|
my ($key) = ($o =~ /^([a-zA-Z\-]+)/);
|
2006-05-24 10:40:37 +02:00
|
|
|
$key =~ s/-//g;
|
2007-01-29 01:16:53 +01:00
|
|
|
my $arg = 'git-config';
|
2006-05-24 10:40:37 +02:00
|
|
|
$arg .= ' --int' if ($o =~ /[:=]i$/);
|
|
|
|
$arg .= ' --bool' if ($o !~ /[:=][sfi]$/);
|
|
|
|
if (ref $v eq 'ARRAY') {
|
|
|
|
chomp(my @tmp = `$arg --get-all svn.$key`);
|
|
|
|
@$v = @tmp if @tmp;
|
|
|
|
} else {
|
|
|
|
chomp(my $tmp = `$arg --get svn.$key`);
|
2007-02-11 06:07:12 +01:00
|
|
|
if ($tmp && !($arg =~ / --bool/ && $tmp eq 'false')) {
|
2006-05-24 10:40:37 +02:00
|
|
|
$$v = $tmp;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2007-02-12 00:21:24 +01:00
|
|
|
delete @$opts{@config_only} if @config_only;
|
2006-05-24 10:40:37 +02:00
|
|
|
}
|
|
|
|
|
2006-06-01 11:35:44 +02:00
|
|
|
sub extract_metadata {
|
2006-06-28 04:39:11 +02:00
|
|
|
my $id = shift or return (undef, undef, undef);
|
2007-06-30 10:56:13 +02:00
|
|
|
my ($url, $rev, $uuid) = ($id =~ /^\s*git-svn-id:\s+(.*)\@(\d+)
|
2006-06-01 11:35:44 +02:00
|
|
|
\s([a-f\d\-]+)$/x);
|
2006-11-23 23:54:04 +01:00
|
|
|
if (!defined $rev || !$uuid || !$url) {
|
2006-06-01 11:35:44 +02:00
|
|
|
# some of the original repositories I made had
|
2006-07-10 07:50:18 +02:00
|
|
|
# identifiers like this:
|
2007-06-30 10:56:13 +02:00
|
|
|
($rev, $uuid) = ($id =~/^\s*git-svn-id:\s(\d+)\@([a-f\d\-]+)/);
|
2006-06-01 11:35:44 +02:00
|
|
|
}
|
|
|
|
return ($url, $rev, $uuid);
|
|
|
|
}
|
|
|
|
|
2006-06-28 04:39:11 +02:00
|
|
|
sub cmt_metadata {
|
|
|
|
return extract_metadata((grep(/^git-svn-id: /,
|
2006-12-15 19:59:54 +01:00
|
|
|
command(qw/cat-file commit/, shift)))[-1]);
|
2006-06-28 04:39:11 +02:00
|
|
|
}
|
|
|
|
|
2007-02-16 12:22:40 +01:00
|
|
|
sub working_head_info {
|
|
|
|
my ($head, $refs) = @_;
|
2007-09-07 02:00:08 +02:00
|
|
|
my @args = ('log', '--no-color', '--first-parent');
|
2007-09-05 11:35:29 +02:00
|
|
|
my ($fh, $ctx) = command_output_pipe(@args, $head);
|
2007-06-30 10:56:13 +02:00
|
|
|
my $hash;
|
2007-06-30 10:56:14 +02:00
|
|
|
my %max;
|
2007-06-30 10:56:13 +02:00
|
|
|
while (<$fh>) {
|
|
|
|
if ( m{^commit ($::sha1)$} ) {
|
|
|
|
unshift @$refs, $hash if $hash and $refs;
|
|
|
|
$hash = $1;
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
next unless s{^\s*(git-svn-id:)}{$1};
|
|
|
|
my ($url, $rev, $uuid) = extract_metadata($_);
|
2007-04-08 09:59:19 +02:00
|
|
|
if (defined $url && defined $rev) {
|
2007-06-30 10:56:14 +02:00
|
|
|
next if $max{$url} and $max{$url} < $rev;
|
2007-04-08 09:59:19 +02:00
|
|
|
if (my $gs = Git::SVN->find_by_url($url)) {
|
|
|
|
my $c = $gs->rev_db_get($rev);
|
2007-04-25 20:50:32 +02:00
|
|
|
if ($c && $c eq $hash) {
|
2007-04-08 09:59:19 +02:00
|
|
|
close $fh; # break the pipe
|
|
|
|
return ($url, $rev, $uuid, $gs);
|
2007-06-30 10:56:14 +02:00
|
|
|
} else {
|
|
|
|
$max{$url} ||= $gs->rev_db_max;
|
2007-04-08 09:59:19 +02:00
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2007-02-16 12:22:40 +01:00
|
|
|
}
|
2007-04-08 09:59:19 +02:00
|
|
|
command_close_pipe($fh, $ctx);
|
|
|
|
(undef, undef, undef, undef);
|
2007-02-16 12:22:40 +01:00
|
|
|
}
|
|
|
|
|
2007-06-13 11:23:28 +02:00
|
|
|
sub read_commit_parents {
|
|
|
|
my ($parents, $c) = @_;
|
2007-09-09 01:33:08 +02:00
|
|
|
chomp(my $p = command_oneline(qw/rev-list --parents -1/, $c));
|
|
|
|
$p =~ s/^($c)\s*// or die "rev-list --parents -1 $c failed!\n";
|
|
|
|
@{$parents->{$c}} = split(/ /, $p);
|
2007-06-13 11:23:28 +02:00
|
|
|
}
|
|
|
|
|
|
|
|
sub linearize_history {
|
|
|
|
my ($gs, $refs) = @_;
|
|
|
|
my %parents;
|
|
|
|
foreach my $c (@$refs) {
|
|
|
|
read_commit_parents(\%parents, $c);
|
|
|
|
}
|
|
|
|
|
|
|
|
my @linear_refs;
|
|
|
|
my %skip = ();
|
|
|
|
my $last_svn_commit = $gs->last_commit;
|
|
|
|
foreach my $c (reverse @$refs) {
|
|
|
|
next if $c eq $last_svn_commit;
|
|
|
|
last if $skip{$c};
|
|
|
|
|
|
|
|
unshift @linear_refs, $c;
|
|
|
|
$skip{$c} = 1;
|
|
|
|
|
|
|
|
# we only want the first parent to diff against for linear
|
|
|
|
# history, we save the rest to inject when we finalize the
|
|
|
|
# svn commit
|
|
|
|
my $fp_a = verify_ref("$c~1");
|
|
|
|
my $fp_b = shift @{$parents{$c}} if $parents{$c};
|
|
|
|
if (!$fp_a || !$fp_b) {
|
|
|
|
die "Commit $c\n",
|
|
|
|
"has no parent commit, and therefore ",
|
|
|
|
"nothing to diff against.\n",
|
|
|
|
"You should be working from a repository ",
|
|
|
|
"originally created by git-svn\n";
|
|
|
|
}
|
|
|
|
if ($fp_a ne $fp_b) {
|
|
|
|
die "$c~1 = $fp_a, however parsing commit $c ",
|
|
|
|
"revealed that:\n$c~1 = $fp_b\nBUG!\n";
|
|
|
|
}
|
|
|
|
|
|
|
|
foreach my $p (@{$parents{$c}}) {
|
|
|
|
$skip{$p} = 1;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
(\@linear_refs, \%parents);
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
package Git::SVN;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
2007-01-31 21:28:10 +01:00
|
|
|
use vars qw/$default_repo_id $default_ref_id $_no_metadata $_follow_parent
|
2007-02-17 04:57:29 +01:00
|
|
|
$_repack $_repack_flags $_use_svm_props $_head
|
git-svn: don't attempt to minimize URLs by default
For tracking branches and tags, git-svn prefers to connect
to the root of the repository or at least the level that
houses branches and tags as well as trunk. However, users
that are accustomed to tracking a single directory have
no use for this feature.
As pointed out by Junio, users may not have permissions to
connect to connect to a higher-level path in the repository.
While the current minimize_url() function detects lack of
permissions to certain paths _after_ successful logins, it
cannot effectively determine if it is trying to access a
login-only portion of a repo when the user expects to
connect to a part where anonymous access is allowed.
For people used to the git-svnimport switches of
--trunk, --tags, --branches, they'll already pass the
repository root (or root+subdirectory), so minimize URL
isn't of too much use to them, either.
For people *not* used to git-svnimport, git-svn also
supports:
git svn init --minimize-url \
--trunk http://repository-root/foo/trunk \
--branches http://repository-root/foo/branches \
--tags http://repository-root/foo/tags
And this is where the new --minimize-url command-line switch
comes in to allow for this behavior to continue working.
2007-05-13 18:58:14 +02:00
|
|
|
$_use_svnsync_props $no_reuse_existing $_minimize_url/;
|
2007-01-11 21:14:21 +01:00
|
|
|
use Carp qw/croak/;
|
|
|
|
use File::Path qw/mkpath/;
|
2007-01-31 22:54:23 +01:00
|
|
|
use File::Copy qw/copy/;
|
2007-01-11 21:14:21 +01:00
|
|
|
use IPC::Open3;
|
|
|
|
|
2007-01-31 21:28:10 +01:00
|
|
|
my $_repack_nr;
|
2007-01-11 21:14:21 +01:00
|
|
|
# properties that we do not log:
|
|
|
|
my %SKIP_PROP;
|
|
|
|
BEGIN {
|
|
|
|
%SKIP_PROP = map { $_ => 1 } qw/svn:wc:ra_dav:version-url
|
|
|
|
svn:special svn:executable
|
|
|
|
svn:entry:committed-rev
|
|
|
|
svn:entry:last-author
|
|
|
|
svn:entry:uuid
|
|
|
|
svn:entry:committed-date/;
|
2007-02-11 09:51:33 +01:00
|
|
|
|
|
|
|
# some options are read globally, but can be overridden locally
|
|
|
|
# per [svn-remote "..."] section. Command-line options will *NOT*
|
|
|
|
# override options set in an [svn-remote "..."] section
|
2007-06-15 05:43:59 +02:00
|
|
|
no strict 'refs';
|
|
|
|
for my $option (qw/follow_parent no_metadata use_svm_props
|
|
|
|
use_svnsync_props/) {
|
|
|
|
my $key = $option;
|
2007-02-11 09:51:33 +01:00
|
|
|
$key =~ tr/_//d;
|
2007-06-15 05:43:59 +02:00
|
|
|
my $prop = "-$option";
|
|
|
|
*$option = sub {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{$prop} if exists $self->{$prop};
|
|
|
|
my $k = "svn-remote.$self->{repo_id}.$key";
|
|
|
|
eval { command_oneline(qw/config --get/, $k) };
|
|
|
|
if ($@) {
|
|
|
|
$self->{$prop} = ${"Git::SVN::_$option"};
|
2007-02-11 09:51:33 +01:00
|
|
|
} else {
|
2007-06-15 05:43:59 +02:00
|
|
|
my $v = command_oneline(qw/config --bool/,$k);
|
|
|
|
$self->{$prop} = $v eq 'false' ? 0 : 1;
|
2007-02-11 09:51:33 +01:00
|
|
|
}
|
2007-06-15 05:43:59 +02:00
|
|
|
return $self->{$prop};
|
|
|
|
}
|
2007-02-11 09:51:33 +01:00
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-01-31 22:54:23 +01:00
|
|
|
my %LOCKFILES;
|
|
|
|
END { unlink keys %LOCKFILES if %LOCKFILES }
|
|
|
|
|
2007-02-03 22:29:17 +01:00
|
|
|
sub resolve_local_globs {
|
|
|
|
my ($url, $fetch, $glob_spec) = @_;
|
|
|
|
return unless defined $glob_spec;
|
|
|
|
my $ref = $glob_spec->{ref};
|
|
|
|
my $path = $glob_spec->{path};
|
|
|
|
foreach (command(qw#for-each-ref --format=%(refname) refs/remotes#)) {
|
|
|
|
next unless m#^refs/remotes/$ref->{regex}$#;
|
|
|
|
my $p = $1;
|
2007-07-30 11:08:21 +02:00
|
|
|
my $pathname = desanitize_refname($path->full_path($p));
|
|
|
|
my $refname = desanitize_refname($ref->full_path($p));
|
2007-02-03 22:29:17 +01:00
|
|
|
if (my $existing = $fetch->{$pathname}) {
|
|
|
|
if ($existing ne $refname) {
|
|
|
|
die "Refspec conflict:\n",
|
|
|
|
"existing: refs/remotes/$existing\n",
|
|
|
|
" globbed: refs/remotes/$refname\n";
|
|
|
|
}
|
|
|
|
my $u = (::cmt_metadata("refs/remotes/$refname"))[0];
|
2007-02-09 21:17:57 +01:00
|
|
|
$u =~ s!^\Q$url\E(/|$)!! or die
|
2007-02-03 22:29:17 +01:00
|
|
|
"refs/remotes/$refname: '$url' not found in '$u'\n";
|
|
|
|
if ($pathname ne $u) {
|
|
|
|
warn "W: Refspec glob conflict ",
|
|
|
|
"(ref: refs/remotes/$refname):\n",
|
|
|
|
"expected path: $pathname\n",
|
|
|
|
" real path: $u\n",
|
|
|
|
"Continuing ahead with $u\n";
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
$fetch->{$pathname} = $refname;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-02-14 11:21:19 +01:00
|
|
|
sub parse_revision_argument {
|
|
|
|
my ($base, $head) = @_;
|
|
|
|
if (!defined $::_revision || $::_revision eq 'BASE:HEAD') {
|
|
|
|
return ($base, $head);
|
|
|
|
}
|
|
|
|
return ($1, $2) if ($::_revision =~ /^(\d+):(\d+)$/);
|
|
|
|
return ($::_revision, $::_revision) if ($::_revision =~ /^\d+$/);
|
|
|
|
return ($head, $head) if ($::_revision eq 'HEAD');
|
|
|
|
return ($base, $1) if ($::_revision =~ /^BASE:(\d+)$/);
|
|
|
|
return ($1, $head) if ($::_revision =~ /^(\d+):HEAD$/);
|
|
|
|
die "revision argument: $::_revision not understood by git-svn\n";
|
|
|
|
}
|
|
|
|
|
2007-01-28 07:28:56 +01:00
|
|
|
sub fetch_all {
|
2007-02-03 22:29:17 +01:00
|
|
|
my ($repo_id, $remotes) = @_;
|
2007-02-16 12:22:40 +01:00
|
|
|
if (ref $repo_id) {
|
|
|
|
my $gs = $repo_id;
|
|
|
|
$repo_id = undef;
|
|
|
|
$repo_id = $gs->{repo_id};
|
|
|
|
}
|
|
|
|
$remotes ||= read_all_remotes();
|
2007-02-15 03:38:46 +01:00
|
|
|
my $remote = $remotes->{$repo_id} or
|
|
|
|
die "[svn-remote \"$repo_id\"] unknown\n";
|
2007-02-08 21:53:57 +01:00
|
|
|
my $fetch = $remote->{fetch};
|
2007-02-15 03:38:46 +01:00
|
|
|
my $url = $remote->{url} or die "svn-remote.$repo_id.url not defined\n";
|
2007-02-08 21:53:57 +01:00
|
|
|
my (@gs, @globs);
|
2007-01-28 07:28:56 +01:00
|
|
|
my $ra = Git::SVN::Ra->new($url);
|
2007-02-12 22:25:25 +01:00
|
|
|
my $uuid = $ra->get_uuid;
|
2007-01-28 07:28:56 +01:00
|
|
|
my $head = $ra->get_latest_revnum;
|
2007-02-14 22:32:21 +01:00
|
|
|
my $base = defined $fetch ? $head : 0;
|
2007-02-08 21:53:57 +01:00
|
|
|
|
|
|
|
# read the max revs for wildcard expansion (branches/*, tags/*)
|
|
|
|
foreach my $t (qw/branches tags/) {
|
|
|
|
defined $remote->{$t} or next;
|
|
|
|
push @globs, $remote->{$t};
|
2007-02-11 10:20:26 +01:00
|
|
|
my $max_rev = eval { tmp_config(qw/--int --get/,
|
|
|
|
"svn-remote.$repo_id.${t}-maxRev") };
|
|
|
|
if (defined $max_rev && ($max_rev < $base)) {
|
|
|
|
$base = $max_rev;
|
2007-02-16 13:05:33 +01:00
|
|
|
} elsif (!defined $max_rev) {
|
|
|
|
$base = 0;
|
2007-02-08 21:53:57 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-02-13 09:38:02 +01:00
|
|
|
if ($fetch) {
|
|
|
|
foreach my $p (sort keys %$fetch) {
|
|
|
|
my $gs = Git::SVN->new($fetch->{$p}, $repo_id, $p);
|
|
|
|
my $lr = $gs->rev_db_max;
|
|
|
|
if (defined $lr) {
|
|
|
|
$base = $lr if ($lr < $base);
|
|
|
|
}
|
|
|
|
push @gs, $gs;
|
2007-01-28 07:28:56 +01:00
|
|
|
}
|
|
|
|
}
|
2007-02-14 11:21:19 +01:00
|
|
|
|
|
|
|
($base, $head) = parse_revision_argument($base, $head);
|
2007-02-08 21:53:57 +01:00
|
|
|
$ra->gs_fetch_loop_common($base, $head, \@gs, \@globs);
|
2007-01-28 07:28:56 +01:00
|
|
|
}
|
|
|
|
|
2007-01-21 13:27:09 +01:00
|
|
|
sub read_all_remotes {
|
|
|
|
my $r = {};
|
2007-01-22 20:44:57 +01:00
|
|
|
foreach (grep { s/^svn-remote\.// } command(qw/config -l/)) {
|
2007-01-21 13:27:09 +01:00
|
|
|
if (m!^(.+)\.fetch=\s*(.*)\s*:\s*refs/remotes/(.+)\s*$!) {
|
2007-07-14 21:40:32 +02:00
|
|
|
my ($remote, $local_ref, $remote_ref) = ($1, $2, $3);
|
|
|
|
$local_ref =~ s{^/}{};
|
|
|
|
$r->{$remote}->{fetch}->{$local_ref} = $remote_ref;
|
2007-01-21 13:27:09 +01:00
|
|
|
} elsif (m!^(.+)\.url=\s*(.*)\s*$!) {
|
|
|
|
$r->{$1}->{url} = $2;
|
2007-02-03 22:29:17 +01:00
|
|
|
} elsif (m!^(.+)\.(branches|tags)=
|
|
|
|
(.*):refs/remotes/(.+)\s*$/!x) {
|
|
|
|
my ($p, $g) = ($3, $4);
|
|
|
|
my $rs = $r->{$1}->{$2} = {
|
2007-02-08 21:53:57 +01:00
|
|
|
t => $2,
|
2007-02-11 10:20:26 +01:00
|
|
|
remote => $1,
|
2007-02-03 22:29:17 +01:00
|
|
|
path => Git::SVN::GlobSpec->new($p),
|
|
|
|
ref => Git::SVN::GlobSpec->new($g) };
|
|
|
|
if (length($rs->{ref}->{right}) != 0) {
|
|
|
|
die "The '*' glob character must be the last ",
|
|
|
|
"character of '$g'\n";
|
|
|
|
}
|
2007-01-21 13:27:09 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
$r;
|
|
|
|
}
|
|
|
|
|
2007-01-31 21:28:10 +01:00
|
|
|
sub init_vars {
|
|
|
|
if (defined $_repack) {
|
|
|
|
$_repack = 1000 if ($_repack <= 0);
|
|
|
|
$_repack_nr = $_repack;
|
|
|
|
$_repack_flags ||= '-d';
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-22 22:52:04 +01:00
|
|
|
sub verify_remotes_sanity {
|
2007-01-23 20:35:53 +01:00
|
|
|
return unless -d $ENV{GIT_DIR};
|
2007-01-22 22:52:04 +01:00
|
|
|
my %seen;
|
|
|
|
foreach (command(qw/config -l/)) {
|
|
|
|
if (m!^svn-remote\.(?:.+)\.fetch=.*:refs/remotes/(\S+)\s*$!) {
|
|
|
|
if ($seen{$1}) {
|
|
|
|
die "Remote ref refs/remote/$1 is tracked by",
|
|
|
|
"\n \"$_\"\nand\n \"$seen{$1}\"\n",
|
|
|
|
"Please resolve this ambiguity in ",
|
|
|
|
"your git configuration file before ",
|
|
|
|
"continuing\n";
|
|
|
|
}
|
|
|
|
$seen{$1} = $_;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-21 13:27:09 +01:00
|
|
|
# we allow more chars than remotes2config.sh...
|
2007-01-19 02:50:01 +01:00
|
|
|
sub sanitize_remote_name {
|
|
|
|
my ($name) = @_;
|
2007-01-21 13:27:09 +01:00
|
|
|
$name =~ tr{A-Za-z0-9:,/+-}{.}c;
|
2007-01-19 02:50:01 +01:00
|
|
|
$name;
|
|
|
|
}
|
|
|
|
|
2007-01-24 01:29:23 +01:00
|
|
|
sub find_existing_remote {
|
|
|
|
my ($url, $remotes) = @_;
|
2007-02-17 11:53:07 +01:00
|
|
|
return undef if $no_reuse_existing;
|
2007-01-24 01:29:23 +01:00
|
|
|
my $existing;
|
|
|
|
foreach my $repo_id (keys %$remotes) {
|
|
|
|
my $u = $remotes->{$repo_id}->{url} or next;
|
|
|
|
next if $u ne $url;
|
|
|
|
$existing = $repo_id;
|
|
|
|
last;
|
|
|
|
}
|
|
|
|
$existing;
|
|
|
|
}
|
2007-01-22 22:52:04 +01:00
|
|
|
|
2007-01-24 01:29:23 +01:00
|
|
|
sub init_remote_config {
|
2007-02-01 12:30:31 +01:00
|
|
|
my ($self, $url, $no_write) = @_;
|
2007-01-24 01:29:23 +01:00
|
|
|
$url =~ s!/+$!!; # strip trailing slash
|
|
|
|
my $r = read_all_remotes();
|
|
|
|
my $existing = find_existing_remote($url, $r);
|
|
|
|
if ($existing) {
|
2007-02-08 21:53:57 +01:00
|
|
|
unless ($no_write) {
|
|
|
|
print STDERR "Using existing ",
|
|
|
|
"[svn-remote \"$existing\"]\n";
|
|
|
|
}
|
2007-01-24 01:29:23 +01:00
|
|
|
$self->{repo_id} = $existing;
|
git-svn: don't attempt to minimize URLs by default
For tracking branches and tags, git-svn prefers to connect
to the root of the repository or at least the level that
houses branches and tags as well as trunk. However, users
that are accustomed to tracking a single directory have
no use for this feature.
As pointed out by Junio, users may not have permissions to
connect to connect to a higher-level path in the repository.
While the current minimize_url() function detects lack of
permissions to certain paths _after_ successful logins, it
cannot effectively determine if it is trying to access a
login-only portion of a repo when the user expects to
connect to a part where anonymous access is allowed.
For people used to the git-svnimport switches of
--trunk, --tags, --branches, they'll already pass the
repository root (or root+subdirectory), so minimize URL
isn't of too much use to them, either.
For people *not* used to git-svnimport, git-svn also
supports:
git svn init --minimize-url \
--trunk http://repository-root/foo/trunk \
--branches http://repository-root/foo/branches \
--tags http://repository-root/foo/tags
And this is where the new --minimize-url command-line switch
comes in to allow for this behavior to continue working.
2007-05-13 18:58:14 +02:00
|
|
|
} elsif ($_minimize_url) {
|
2007-01-24 01:29:23 +01:00
|
|
|
my $min_url = Git::SVN::Ra->new($url)->minimize_url;
|
|
|
|
$existing = find_existing_remote($min_url, $r);
|
|
|
|
if ($existing) {
|
2007-02-08 21:53:57 +01:00
|
|
|
unless ($no_write) {
|
|
|
|
print STDERR "Using existing ",
|
|
|
|
"[svn-remote \"$existing\"]\n";
|
|
|
|
}
|
2007-01-24 01:29:23 +01:00
|
|
|
$self->{repo_id} = $existing;
|
|
|
|
}
|
|
|
|
if ($min_url ne $url) {
|
2007-02-08 21:53:57 +01:00
|
|
|
unless ($no_write) {
|
|
|
|
print STDERR "Using higher level of URL: ",
|
|
|
|
"$url => $min_url\n";
|
|
|
|
}
|
2007-01-24 01:29:23 +01:00
|
|
|
my $old_path = $self->{path};
|
|
|
|
$self->{path} = $url;
|
2007-02-09 21:17:57 +01:00
|
|
|
$self->{path} =~ s!^\Q$min_url\E(/|$)!!;
|
2007-01-24 01:29:23 +01:00
|
|
|
if (length $old_path) {
|
|
|
|
$self->{path} .= "/$old_path";
|
|
|
|
}
|
|
|
|
$url = $min_url;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
my $orig_url;
|
|
|
|
if (!$existing) {
|
2007-01-22 22:52:04 +01:00
|
|
|
# verify that we aren't overwriting anything:
|
2007-01-24 01:29:23 +01:00
|
|
|
$orig_url = eval {
|
2007-01-19 02:50:01 +01:00
|
|
|
command_oneline('config', '--get',
|
2007-01-24 01:29:23 +01:00
|
|
|
"svn-remote.$self->{repo_id}.url")
|
2007-01-19 02:50:01 +01:00
|
|
|
};
|
2007-01-22 22:52:04 +01:00
|
|
|
if ($orig_url && ($orig_url ne $url)) {
|
2007-01-24 01:29:23 +01:00
|
|
|
die "svn-remote.$self->{repo_id}.url already set: ",
|
2007-01-22 22:52:04 +01:00
|
|
|
"$orig_url\nwanted to set to: $url\n";
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
2007-01-24 01:29:23 +01:00
|
|
|
my ($xrepo_id, $xpath) = find_ref($self->refname);
|
|
|
|
if (defined $xpath) {
|
|
|
|
die "svn-remote.$xrepo_id.fetch already set to track ",
|
|
|
|
"$xpath:refs/remotes/", $self->refname, "\n";
|
|
|
|
}
|
2007-02-01 12:30:31 +01:00
|
|
|
unless ($no_write) {
|
|
|
|
command_noisy('config',
|
|
|
|
"svn-remote.$self->{repo_id}.url", $url);
|
2007-07-14 21:40:32 +02:00
|
|
|
$self->{path} =~ s{^/}{};
|
2007-02-01 12:30:31 +01:00
|
|
|
command_noisy('config', '--add',
|
|
|
|
"svn-remote.$self->{repo_id}.fetch",
|
|
|
|
"$self->{path}:".$self->refname);
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
$self->{url} = $url;
|
2007-01-24 01:29:23 +01:00
|
|
|
}
|
|
|
|
|
2007-02-13 23:22:11 +01:00
|
|
|
sub find_by_url { # repos_root and, path are optional
|
|
|
|
my ($class, $full_url, $repos_root, $path) = @_;
|
2007-04-25 21:42:58 +02:00
|
|
|
|
2007-02-20 09:43:19 +01:00
|
|
|
return undef unless defined $full_url;
|
2007-04-25 21:42:58 +02:00
|
|
|
remove_username($full_url);
|
|
|
|
remove_username($repos_root) if defined $repos_root;
|
2007-02-13 23:22:11 +01:00
|
|
|
my $remotes = read_all_remotes();
|
|
|
|
if (defined $full_url && defined $repos_root && !defined $path) {
|
|
|
|
$path = $full_url;
|
|
|
|
$path =~ s#^\Q$repos_root\E(?:/|$)##;
|
|
|
|
}
|
|
|
|
foreach my $repo_id (keys %$remotes) {
|
|
|
|
my $u = $remotes->{$repo_id}->{url} or next;
|
2007-04-25 21:42:58 +02:00
|
|
|
remove_username($u);
|
2007-02-13 23:22:11 +01:00
|
|
|
next if defined $repos_root && $repos_root ne $u;
|
|
|
|
|
|
|
|
my $fetch = $remotes->{$repo_id}->{fetch} || {};
|
|
|
|
foreach (qw/branches tags/) {
|
|
|
|
resolve_local_globs($u, $fetch,
|
|
|
|
$remotes->{$repo_id}->{$_});
|
|
|
|
}
|
|
|
|
my $p = $path;
|
|
|
|
unless (defined $p) {
|
|
|
|
$p = $full_url;
|
|
|
|
$p =~ s#^\Q$u\E(?:/|$)## or next;
|
|
|
|
}
|
|
|
|
foreach my $f (keys %$fetch) {
|
|
|
|
next if $f ne $p;
|
|
|
|
return Git::SVN->new($fetch->{$f}, $repo_id, $f);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
2007-01-24 01:29:23 +01:00
|
|
|
sub init {
|
2007-02-01 12:30:31 +01:00
|
|
|
my ($class, $url, $path, $repo_id, $ref_id, $no_write) = @_;
|
2007-01-24 01:29:23 +01:00
|
|
|
my $self = _new($class, $repo_id, $ref_id, $path);
|
|
|
|
if (defined $url) {
|
2007-02-01 12:30:31 +01:00
|
|
|
$self->init_remote_config($url, $no_write);
|
2007-01-24 01:29:23 +01:00
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
$self;
|
|
|
|
}
|
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
sub find_ref {
|
|
|
|
my ($ref_id) = @_;
|
|
|
|
foreach (command(qw/config -l/)) {
|
|
|
|
next unless m!^svn-remote\.(.+)\.fetch=
|
|
|
|
\s*(.*)\s*:\s*refs/remotes/(.+)\s*$!x;
|
|
|
|
my ($repo_id, $path, $ref) = ($1, $2, $3);
|
|
|
|
if ($ref eq $ref_id) {
|
|
|
|
$path = '' if ($path =~ m#^\./?#);
|
|
|
|
return ($repo_id, $path);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
(undef, undef, undef);
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub new {
|
2007-01-19 02:50:01 +01:00
|
|
|
my ($class, $ref_id, $repo_id, $path) = @_;
|
|
|
|
if (defined $ref_id && !defined $repo_id && !defined $path) {
|
|
|
|
($repo_id, $path) = find_ref($ref_id);
|
|
|
|
if (!defined $repo_id) {
|
|
|
|
die "Could not find a \"svn-remote.*.fetch\" key ",
|
|
|
|
"in the repository configuration matching: ",
|
|
|
|
"refs/remotes/$ref_id\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
my $self = _new($class, $repo_id, $ref_id, $path);
|
2007-01-22 20:44:57 +01:00
|
|
|
if (!defined $self->{path} || !length $self->{path}) {
|
|
|
|
my $fetch = command_oneline('config', '--get',
|
|
|
|
"svn-remote.$repo_id.fetch",
|
|
|
|
":refs/remotes/$ref_id\$") or
|
|
|
|
die "Failed to read \"svn-remote.$repo_id.fetch\" ",
|
|
|
|
"\":refs/remotes/$ref_id\$\" in config\n";
|
|
|
|
($self->{path}, undef) = split(/\s*:\s*/, $fetch);
|
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
$self->{url} = command_oneline('config', '--get',
|
|
|
|
"svn-remote.$repo_id.url") or
|
|
|
|
die "Failed to read \"svn-remote.$repo_id.url\" in config\n";
|
2007-02-16 13:05:33 +01:00
|
|
|
$self->rebuild;
|
2007-01-11 21:14:21 +01:00
|
|
|
$self;
|
|
|
|
}
|
|
|
|
|
2007-07-30 11:08:21 +02:00
|
|
|
sub refname {
|
|
|
|
my ($refname) = "refs/remotes/$_[0]->{ref_id}" ;
|
|
|
|
|
|
|
|
# It cannot end with a slash /, we'll throw up on this because
|
|
|
|
# SVN can't have directories with a slash in their name, either:
|
|
|
|
if ($refname =~ m{/$}) {
|
|
|
|
die "ref: '$refname' ends with a trailing slash, this is ",
|
|
|
|
"not permitted by git nor Subversion\n";
|
|
|
|
}
|
|
|
|
|
|
|
|
# It cannot have ASCII control character space, tilde ~, caret ^,
|
|
|
|
# colon :, question-mark ?, asterisk *, space, or open bracket [
|
|
|
|
# anywhere.
|
|
|
|
#
|
|
|
|
# Additionally, % must be escaped because it is used for escaping
|
|
|
|
# and we want our escaped refname to be reversible
|
|
|
|
$refname =~ s{([ \%~\^:\?\*\[\t])}{uc sprintf('%%%02x',ord($1))}eg;
|
|
|
|
|
|
|
|
# no slash-separated component can begin with a dot .
|
|
|
|
# /.* becomes /%2E*
|
|
|
|
$refname =~ s{/\.}{/%2E}g;
|
|
|
|
|
|
|
|
# It cannot have two consecutive dots .. anywhere
|
|
|
|
# .. becomes %2E%2E
|
|
|
|
$refname =~ s{\.\.}{%2E%2E}g;
|
|
|
|
|
|
|
|
return $refname;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub desanitize_refname {
|
|
|
|
my ($refname) = @_;
|
|
|
|
$refname =~ s{%(?:([0-9A-F]{2}))}{chr hex($1)}eg;
|
|
|
|
return $refname;
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
|
2007-02-12 22:25:25 +01:00
|
|
|
sub svm_uuid {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{svm}->{uuid} if $self->svm;
|
|
|
|
$self->ra;
|
|
|
|
unless ($self->{svm}) {
|
|
|
|
die "SVM UUID not cached, and reading remotely failed\n";
|
|
|
|
}
|
|
|
|
$self->{svm}->{uuid};
|
|
|
|
}
|
2007-02-11 05:46:50 +01:00
|
|
|
|
2007-02-12 22:25:25 +01:00
|
|
|
sub svm {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{svm} if $self->{svm};
|
|
|
|
my $svm;
|
2007-02-11 05:46:50 +01:00
|
|
|
# see if we have it in our config, first:
|
|
|
|
eval {
|
2007-02-12 22:25:25 +01:00
|
|
|
my $section = "svn-remote.$self->{repo_id}";
|
|
|
|
$svm = {
|
2007-02-11 10:20:26 +01:00
|
|
|
source => tmp_config('--get', "$section.svm-source"),
|
|
|
|
uuid => tmp_config('--get', "$section.svm-uuid"),
|
2007-02-17 11:53:07 +01:00
|
|
|
replace => tmp_config('--get', "$section.svm-replace"),
|
2007-02-11 05:46:50 +01:00
|
|
|
}
|
|
|
|
};
|
2007-02-17 11:53:07 +01:00
|
|
|
if ($svm && $svm->{source} && $svm->{uuid} && $svm->{replace}) {
|
|
|
|
$self->{svm} = $svm;
|
|
|
|
}
|
2007-02-12 22:25:25 +01:00
|
|
|
$self->{svm};
|
|
|
|
}
|
|
|
|
|
|
|
|
sub _set_svm_vars {
|
|
|
|
my ($self, $ra) = @_;
|
2007-02-13 09:38:02 +01:00
|
|
|
return $ra if $self->svm;
|
|
|
|
|
|
|
|
my @err = ( "useSvmProps set, but failed to read SVM properties\n",
|
2007-02-17 11:53:07 +01:00
|
|
|
"(svm:source, svm:uuid) ",
|
2007-02-13 09:38:02 +01:00
|
|
|
"from the following URLs:\n" );
|
|
|
|
sub read_svm_props {
|
2007-02-17 11:53:07 +01:00
|
|
|
my ($self, $ra, $path, $r) = @_;
|
|
|
|
my $props = ($ra->get_dir($path, $r))[2];
|
2007-02-13 09:38:02 +01:00
|
|
|
my $src = $props->{'svm:source'};
|
|
|
|
my $uuid = $props->{'svm:uuid'};
|
2007-02-17 11:53:07 +01:00
|
|
|
return undef if (!$src || !$uuid);
|
2007-02-12 22:25:25 +01:00
|
|
|
|
2007-02-17 11:53:07 +01:00
|
|
|
chomp($src, $uuid);
|
2007-02-12 22:25:25 +01:00
|
|
|
|
2007-02-13 09:38:02 +01:00
|
|
|
$uuid =~ m{^[0-9a-f\-]{30,}$}
|
|
|
|
or die "doesn't look right - svm:uuid is '$uuid'\n";
|
2007-02-17 11:53:07 +01:00
|
|
|
|
|
|
|
# the '!' is used to mark the repos_root!/relative/path
|
|
|
|
$src =~ s{/?!/?}{/};
|
2007-02-13 09:38:02 +01:00
|
|
|
$src =~ s{/+$}{}; # no trailing slashes please
|
2007-02-17 11:53:07 +01:00
|
|
|
# username is of no interest
|
2007-02-11 05:46:50 +01:00
|
|
|
$src =~ s{(^[a-z\+]*://)[^/@]*@}{$1};
|
|
|
|
|
2007-02-17 11:53:07 +01:00
|
|
|
my $replace = $ra->{url};
|
|
|
|
$replace .= "/$path" if length $path;
|
|
|
|
|
2007-02-13 09:38:02 +01:00
|
|
|
my $section = "svn-remote.$self->{repo_id}";
|
2007-02-17 11:53:07 +01:00
|
|
|
tmp_config("$section.svm-source", $src);
|
|
|
|
tmp_config("$section.svm-replace", $replace);
|
|
|
|
tmp_config("$section.svm-uuid", $uuid);
|
|
|
|
$self->{svm} = {
|
|
|
|
source => $src,
|
|
|
|
uuid => $uuid,
|
|
|
|
replace => $replace
|
|
|
|
};
|
2007-02-13 09:38:02 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
my $r = $ra->get_latest_revnum;
|
|
|
|
my $path = $self->{path};
|
2007-02-17 11:53:07 +01:00
|
|
|
my %tried;
|
2007-02-13 09:38:02 +01:00
|
|
|
while (length $path) {
|
2007-02-17 11:53:07 +01:00
|
|
|
unless ($tried{"$self->{url}/$path"}) {
|
|
|
|
return $ra if $self->read_svm_props($ra, $path, $r);
|
|
|
|
$tried{"$self->{url}/$path"} = 1;
|
2007-02-13 09:38:02 +01:00
|
|
|
}
|
2007-02-17 11:53:07 +01:00
|
|
|
$path =~ s#/?[^/]+$##;
|
2007-02-11 05:46:50 +01:00
|
|
|
}
|
2007-02-17 11:53:07 +01:00
|
|
|
die "Path: '$path' should be ''\n" if $path ne '';
|
|
|
|
return $ra if $self->read_svm_props($ra, $path, $r);
|
|
|
|
$tried{"$self->{url}/$path"} = 1;
|
2007-02-13 09:38:02 +01:00
|
|
|
|
|
|
|
if ($ra->{repos_root} eq $self->{url}) {
|
2007-02-17 11:53:07 +01:00
|
|
|
die @err, (map { " $_\n" } keys %tried), "\n";
|
2007-02-13 09:38:02 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
# nope, make sure we're connected to the repository root:
|
|
|
|
my $ok;
|
|
|
|
my @tried_b;
|
|
|
|
$path = $ra->{svn_path};
|
|
|
|
$ra = Git::SVN::Ra->new($ra->{repos_root});
|
|
|
|
while (length $path) {
|
2007-02-17 11:53:07 +01:00
|
|
|
unless ($tried{"$ra->{url}/$path"}) {
|
|
|
|
$ok = $self->read_svm_props($ra, $path, $r);
|
|
|
|
last if $ok;
|
|
|
|
$tried{"$ra->{url}/$path"} = 1;
|
|
|
|
}
|
|
|
|
$path =~ s#/?[^/]+$##;
|
2007-02-13 09:38:02 +01:00
|
|
|
}
|
2007-02-17 11:53:07 +01:00
|
|
|
die "Path: '$path' should be ''\n" if $path ne '';
|
|
|
|
$ok ||= $self->read_svm_props($ra, $path, $r);
|
|
|
|
$tried{"$ra->{url}/$path"} = 1;
|
2007-02-13 09:38:02 +01:00
|
|
|
if (!$ok) {
|
2007-02-17 11:53:07 +01:00
|
|
|
die @err, (map { " $_\n" } keys %tried), "\n";
|
2007-02-13 09:38:02 +01:00
|
|
|
}
|
|
|
|
Git::SVN::Ra->new($self->{url});
|
2007-02-11 05:46:50 +01:00
|
|
|
}
|
|
|
|
|
2007-02-17 04:57:29 +01:00
|
|
|
sub svnsync {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{svnsync} if $self->{svnsync};
|
|
|
|
|
|
|
|
if ($self->no_metadata) {
|
|
|
|
die "Can't have both 'noMetadata' and ",
|
|
|
|
"'useSvnsyncProps' options set!\n";
|
|
|
|
}
|
|
|
|
if ($self->rewrite_root) {
|
|
|
|
die "Can't have both 'useSvnsyncProps' and 'rewriteRoot' ",
|
|
|
|
"options set!\n";
|
|
|
|
}
|
|
|
|
|
|
|
|
my $svnsync;
|
|
|
|
# see if we have it in our config, first:
|
|
|
|
eval {
|
|
|
|
my $section = "svn-remote.$self->{repo_id}";
|
|
|
|
$svnsync = {
|
|
|
|
url => tmp_config('--get', "$section.svnsync-url"),
|
|
|
|
uuid => tmp_config('--get', "$section.svnsync-uuid"),
|
|
|
|
}
|
|
|
|
};
|
|
|
|
if ($svnsync && $svnsync->{url} && $svnsync->{uuid}) {
|
|
|
|
return $self->{svnsync} = $svnsync;
|
|
|
|
}
|
|
|
|
|
|
|
|
my $err = "useSvnsyncProps set, but failed to read " .
|
|
|
|
"svnsync property: svn:sync-from-";
|
|
|
|
my $rp = $self->ra->rev_proplist(0);
|
|
|
|
|
|
|
|
my $url = $rp->{'svn:sync-from-url'} or die $err . "url\n";
|
|
|
|
$url =~ m{^[a-z\+]+://} or
|
|
|
|
die "doesn't look right - svn:sync-from-url is '$url'\n";
|
|
|
|
|
|
|
|
my $uuid = $rp->{'svn:sync-from-uuid'} or die $err . "uuid\n";
|
|
|
|
$uuid =~ m{^[0-9a-f\-]{30,}$} or
|
|
|
|
die "doesn't look right - svn:sync-from-uuid is '$uuid'\n";
|
|
|
|
|
|
|
|
my $section = "svn-remote.$self->{repo_id}";
|
|
|
|
tmp_config('--add', "$section.svnsync-uuid", $uuid);
|
|
|
|
tmp_config('--add', "$section.svnsync-url", $url);
|
|
|
|
return $self->{svnsync} = { url => $url, uuid => $uuid };
|
|
|
|
}
|
|
|
|
|
2007-02-12 22:25:25 +01:00
|
|
|
# this allows us to memoize our SVN::Ra UUID locally and avoid a
|
|
|
|
# remote lookup (useful for 'git svn log').
|
|
|
|
sub ra_uuid {
|
|
|
|
my ($self) = @_;
|
|
|
|
unless ($self->{ra_uuid}) {
|
|
|
|
my $key = "svn-remote.$self->{repo_id}.uuid";
|
|
|
|
my $uuid = eval { tmp_config('--get', $key) };
|
|
|
|
if (!$@ && $uuid && $uuid =~ /^([a-f\d\-]{30,})$/) {
|
|
|
|
$self->{ra_uuid} = $uuid;
|
|
|
|
} else {
|
|
|
|
die "ra_uuid called without URL\n" unless $self->{url};
|
|
|
|
$self->{ra_uuid} = $self->ra->get_uuid;
|
|
|
|
tmp_config('--add', $key, $self->{ra_uuid});
|
|
|
|
}
|
|
|
|
}
|
|
|
|
$self->{ra_uuid};
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub ra {
|
|
|
|
my ($self) = shift;
|
2007-02-11 05:46:50 +01:00
|
|
|
my $ra = Git::SVN::Ra->new($self->{url});
|
2007-02-11 09:51:33 +01:00
|
|
|
if ($self->use_svm_props && !$self->{svm}) {
|
|
|
|
if ($self->no_metadata) {
|
2007-02-12 00:21:24 +01:00
|
|
|
die "Can't have both 'noMetadata' and ",
|
|
|
|
"'useSvmProps' options set!\n";
|
2007-02-17 04:57:29 +01:00
|
|
|
} elsif ($self->use_svnsync_props) {
|
|
|
|
die "Can't have both 'useSvnsyncProps' and ",
|
|
|
|
"'useSvmProps' options set!\n";
|
2007-02-11 09:51:33 +01:00
|
|
|
}
|
2007-02-12 22:25:25 +01:00
|
|
|
$ra = $self->_set_svm_vars($ra);
|
2007-02-11 05:46:50 +01:00
|
|
|
$self->{-want_revprops} = 1;
|
|
|
|
}
|
|
|
|
$ra;
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-01-22 11:20:33 +01:00
|
|
|
sub rel_path {
|
|
|
|
my ($self) = @_;
|
|
|
|
my $repos_root = $self->ra->{repos_root};
|
|
|
|
return $self->{path} if ($self->{url} eq $repos_root);
|
2007-03-26 01:35:31 +02:00
|
|
|
my $url = $self->{url} .
|
|
|
|
(length $self->{path} ? "/$self->{path}" : $self->{path});
|
|
|
|
$url =~ s!^\Q$repos_root\E(?:/+|$)!!g;
|
|
|
|
$url;
|
2007-01-22 11:20:33 +01:00
|
|
|
}
|
|
|
|
|
2007-10-16 16:36:48 +02:00
|
|
|
# prop_walk(PATH, REV, SUB)
|
|
|
|
# -------------------------
|
|
|
|
# Recursively traverse PATH at revision REV and invoke SUB for each
|
|
|
|
# directory that contains a SVN property. SUB will be invoked as
|
|
|
|
# follows: &SUB(gs, path, props); where `gs' is this instance of
|
|
|
|
# Git::SVN, `path' the path to the directory where the properties
|
|
|
|
# `props' were found. The `path' will be relative to point of checkout,
|
|
|
|
# that is, if url://repo/trunk is the current Git branch, and that
|
|
|
|
# directory contains a sub-directory `d', SUB will be invoked with `/d/'
|
|
|
|
# as `path' (note the trailing `/').
|
|
|
|
sub prop_walk {
|
|
|
|
my ($self, $path, $rev, $sub) = @_;
|
|
|
|
|
|
|
|
my ($dirent, undef, $props) = $self->ra->get_dir($path, $rev);
|
|
|
|
$path =~ s#^/*#/#g;
|
2007-01-11 21:14:21 +01:00
|
|
|
my $p = $path;
|
2007-10-16 16:36:48 +02:00
|
|
|
# Strip the irrelevant part of the path.
|
|
|
|
$p =~ s#^/+\Q$self->{path}\E(/|$)#/#;
|
|
|
|
# Ensure the path is terminated by a `/'.
|
|
|
|
$p =~ s#/*$#/#;
|
|
|
|
|
|
|
|
# The properties contain all the internal SVN stuff nobody
|
|
|
|
# (usually) cares about.
|
|
|
|
my $interesting_props = 0;
|
|
|
|
foreach (keys %{$props}) {
|
|
|
|
# If it doesn't start with `svn:', it must be a
|
|
|
|
# user-defined property.
|
|
|
|
++$interesting_props and next if $_ !~ /^svn:/;
|
|
|
|
# FIXME: Fragile, if SVN adds new public properties,
|
|
|
|
# this needs to be updated.
|
|
|
|
++$interesting_props if /^svn:(?:ignore|keywords|executable
|
|
|
|
|eol-style|mime-type
|
|
|
|
|externals|needs-lock)$/x;
|
|
|
|
}
|
|
|
|
&$sub($self, $p, $props) if $interesting_props;
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
foreach (sort keys %$dirent) {
|
2007-05-13 10:04:43 +02:00
|
|
|
next if $dirent->{$_}->{kind} != $SVN::Node::dir;
|
2007-10-16 16:36:48 +02:00
|
|
|
$self->prop_walk($path . '/' . $_, $rev, $sub);
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-26 02:35:40 +01:00
|
|
|
sub last_rev { ($_[0]->last_rev_commit)[0] }
|
|
|
|
sub last_commit { ($_[0]->last_rev_commit)[1] }
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
# returns the newest SVN revision number and newest commit SHA1
|
|
|
|
sub last_rev_commit {
|
|
|
|
my ($self) = @_;
|
|
|
|
if (defined $self->{last_rev} && defined $self->{last_commit}) {
|
|
|
|
return ($self->{last_rev}, $self->{last_commit});
|
|
|
|
}
|
2007-01-11 21:26:16 +01:00
|
|
|
my $c = ::verify_ref($self->refname.'^0');
|
2007-02-11 09:51:33 +01:00
|
|
|
if ($c && !$self->use_svm_props && !$self->no_metadata) {
|
2007-01-11 21:26:16 +01:00
|
|
|
my $rev = (::cmt_metadata($c))[1];
|
2007-01-11 21:14:21 +01:00
|
|
|
if (defined $rev) {
|
|
|
|
($self->{last_rev}, $self->{last_commit}) = ($rev, $c);
|
|
|
|
return ($rev, $c);
|
|
|
|
}
|
|
|
|
}
|
2007-02-12 22:25:25 +01:00
|
|
|
my $db_path = $self->db_path;
|
|
|
|
unless (-e $db_path) {
|
|
|
|
($self->{last_rev}, $self->{last_commit}) = (undef, undef);
|
|
|
|
return (undef, undef);
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
my $offset = -41; # from tail
|
|
|
|
my $rl;
|
2007-02-12 22:25:25 +01:00
|
|
|
open my $fh, '<', $db_path or croak "$db_path not readable: $!\n";
|
2007-02-01 02:57:36 +01:00
|
|
|
sysseek($fh, $offset, 2); # don't care for errors
|
|
|
|
sysread($fh, $rl, 41) == 41 or return (undef, undef);
|
2007-01-11 21:14:21 +01:00
|
|
|
chomp $rl;
|
2007-02-01 02:57:36 +01:00
|
|
|
while (('0' x40) eq $rl && sysseek($fh, 0, 1) != 0) {
|
2007-01-11 21:14:21 +01:00
|
|
|
$offset -= 41;
|
2007-02-01 02:57:36 +01:00
|
|
|
sysseek($fh, $offset, 2); # don't care for errors
|
|
|
|
sysread($fh, $rl, 41) == 41 or return (undef, undef);
|
2007-01-11 21:14:21 +01:00
|
|
|
chomp $rl;
|
|
|
|
}
|
2007-02-11 09:51:33 +01:00
|
|
|
if ($c && $c ne $rl) {
|
2007-02-12 22:25:25 +01:00
|
|
|
die "$db_path and ", $self->refname,
|
2007-02-01 02:22:31 +01:00
|
|
|
" inconsistent!:\n$c != $rl\n";
|
|
|
|
}
|
2007-02-01 02:57:36 +01:00
|
|
|
my $rev = sysseek($fh, 0, 1) or croak $!;
|
2007-01-11 21:14:21 +01:00
|
|
|
$rev = ($rev - 41) / 41;
|
|
|
|
close $fh or croak $!;
|
|
|
|
($self->{last_rev}, $self->{last_commit}) = ($rev, $c);
|
|
|
|
return ($rev, $c);
|
|
|
|
}
|
|
|
|
|
2007-01-26 02:35:40 +01:00
|
|
|
sub get_fetch_range {
|
|
|
|
my ($self, $min, $max) = @_;
|
|
|
|
$max ||= $self->ra->get_latest_revnum;
|
2007-02-01 02:22:31 +01:00
|
|
|
$min ||= $self->rev_db_max;
|
2007-01-26 02:35:40 +01:00
|
|
|
(++$min, $max);
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-02-11 05:46:50 +01:00
|
|
|
sub tmp_config {
|
2007-02-11 10:20:26 +01:00
|
|
|
my (@args) = @_;
|
2007-02-16 13:09:28 +01:00
|
|
|
my $old_def_config = "$ENV{GIT_DIR}/svn/config";
|
|
|
|
my $config = "$ENV{GIT_DIR}/svn/.metadata";
|
2007-06-13 11:37:05 +02:00
|
|
|
if (! -f $config && -f $old_def_config) {
|
2007-02-16 13:09:28 +01:00
|
|
|
rename $old_def_config, $config or
|
|
|
|
die "Failed rename $old_def_config => $config: $!\n";
|
|
|
|
}
|
2007-02-11 05:46:50 +01:00
|
|
|
my $old_config = $ENV{GIT_CONFIG};
|
2007-02-11 10:20:26 +01:00
|
|
|
$ENV{GIT_CONFIG} = $config;
|
2007-02-11 05:46:50 +01:00
|
|
|
$@ = undef;
|
2007-02-15 00:10:44 +01:00
|
|
|
my @ret = eval {
|
|
|
|
unless (-f $config) {
|
|
|
|
mkfile($config);
|
|
|
|
open my $fh, '>', $config or
|
|
|
|
die "Can't open $config: $!\n";
|
|
|
|
print $fh "; This file is used internally by ",
|
|
|
|
"git-svn\n" or die
|
|
|
|
"Couldn't write to $config: $!\n";
|
|
|
|
print $fh "; You should not have to edit it\n" or
|
|
|
|
die "Couldn't write to $config: $!\n";
|
|
|
|
close $fh or die "Couldn't close $config: $!\n";
|
|
|
|
}
|
|
|
|
command('config', @args);
|
|
|
|
};
|
2007-02-11 05:46:50 +01:00
|
|
|
my $err = $@;
|
|
|
|
if (defined $old_config) {
|
|
|
|
$ENV{GIT_CONFIG} = $old_config;
|
|
|
|
} else {
|
|
|
|
delete $ENV{GIT_CONFIG};
|
|
|
|
}
|
|
|
|
die $err if $err;
|
|
|
|
wantarray ? @ret : $ret[0];
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub tmp_index_do {
|
|
|
|
my ($self, $sub) = @_;
|
|
|
|
my $old_index = $ENV{GIT_INDEX_FILE};
|
|
|
|
$ENV{GIT_INDEX_FILE} = $self->{index};
|
2007-02-11 05:46:50 +01:00
|
|
|
$@ = undef;
|
2007-02-15 00:10:44 +01:00
|
|
|
my @ret = eval {
|
|
|
|
my ($dir, $base) = ($self->{index} =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
mkpath([$dir]) unless -d $dir;
|
|
|
|
&$sub;
|
|
|
|
};
|
2007-02-11 05:46:50 +01:00
|
|
|
my $err = $@;
|
|
|
|
if (defined $old_index) {
|
2007-01-11 21:14:21 +01:00
|
|
|
$ENV{GIT_INDEX_FILE} = $old_index;
|
|
|
|
} else {
|
|
|
|
delete $ENV{GIT_INDEX_FILE};
|
|
|
|
}
|
2007-02-11 05:46:50 +01:00
|
|
|
die $err if $err;
|
2007-01-11 21:14:21 +01:00
|
|
|
wantarray ? @ret : $ret[0];
|
|
|
|
}
|
|
|
|
|
|
|
|
sub assert_index_clean {
|
|
|
|
my ($self, $treeish) = @_;
|
|
|
|
|
|
|
|
$self->tmp_index_do(sub {
|
|
|
|
command_noisy('read-tree', $treeish) unless -e $self->{index};
|
|
|
|
my $x = command_oneline('write-tree');
|
|
|
|
my ($y) = (command(qw/cat-file commit/, $treeish) =~
|
|
|
|
/^tree ($::sha1)/mo);
|
2007-02-15 01:29:52 +01:00
|
|
|
return if $y eq $x;
|
|
|
|
|
|
|
|
warn "Index mismatch: $y != $x\nrereading $treeish\n";
|
|
|
|
unlink $self->{index} or die "unlink $self->{index}: $!\n";
|
|
|
|
command_noisy('read-tree', $treeish);
|
2007-01-11 21:14:21 +01:00
|
|
|
$x = command_oneline('write-tree');
|
|
|
|
if ($y ne $x) {
|
|
|
|
::fatal "trees ($treeish) $y != $x\n",
|
2007-10-16 16:36:52 +02:00
|
|
|
"Something is seriously wrong...";
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub get_commit_parents {
|
2007-01-28 07:28:56 +01:00
|
|
|
my ($self, $log_entry) = @_;
|
2007-01-11 21:14:21 +01:00
|
|
|
my (%seen, @ret, @tmp);
|
2007-01-28 07:28:56 +01:00
|
|
|
# legacy support for 'set-tree'; this is only used by set_tree_cb:
|
|
|
|
if (my $ip = $self->{inject_parents}) {
|
|
|
|
if (my $commit = delete $ip->{$log_entry->{revision}}) {
|
|
|
|
push @tmp, $commit;
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
}
|
2007-01-11 21:26:16 +01:00
|
|
|
if (my $cur = ::verify_ref($self->refname.'^0')) {
|
2007-01-11 21:14:21 +01:00
|
|
|
push @tmp, $cur;
|
|
|
|
}
|
2007-06-13 11:23:28 +02:00
|
|
|
if (my $ipd = $self->{inject_parents_dcommit}) {
|
|
|
|
if (my $commit = delete $ipd->{$log_entry->{revision}}) {
|
|
|
|
push @tmp, @$commit;
|
|
|
|
}
|
|
|
|
}
|
2007-01-14 07:35:53 +01:00
|
|
|
push @tmp, $_ foreach (@{$log_entry->{parents}}, @tmp);
|
2007-01-11 21:14:21 +01:00
|
|
|
while (my $p = shift @tmp) {
|
|
|
|
next if $seen{$p};
|
|
|
|
$seen{$p} = 1;
|
|
|
|
push @ret, $p;
|
|
|
|
# MAXPARENT is defined to 16 in commit-tree.c:
|
|
|
|
last if @ret >= 16;
|
|
|
|
}
|
|
|
|
if (@tmp) {
|
2007-01-14 07:35:53 +01:00
|
|
|
die "r$log_entry->{revision}: No room for parents:\n\t",
|
2007-01-11 21:14:21 +01:00
|
|
|
join("\n\t", @tmp), "\n";
|
|
|
|
}
|
|
|
|
@ret;
|
|
|
|
}
|
|
|
|
|
2007-02-17 04:15:21 +01:00
|
|
|
sub rewrite_root {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{-rewrite_root} if exists $self->{-rewrite_root};
|
|
|
|
my $k = "svn-remote.$self->{repo_id}.rewriteRoot";
|
|
|
|
my $rwr = eval { command_oneline(qw/config --get/, $k) };
|
|
|
|
if ($rwr) {
|
|
|
|
$rwr =~ s#/+$##;
|
|
|
|
if ($rwr !~ m#^[a-z\+]+://#) {
|
|
|
|
die "$rwr is not a valid URL (key: $k)\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
$self->{-rewrite_root} = $rwr;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub metadata_url {
|
|
|
|
my ($self) = @_;
|
|
|
|
($self->rewrite_root || $self->{url}) .
|
|
|
|
(length $self->{path} ? '/' . $self->{path} : '');
|
|
|
|
}
|
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
sub full_url {
|
2007-01-11 21:14:21 +01:00
|
|
|
my ($self) = @_;
|
2007-01-30 04:16:01 +01:00
|
|
|
$self->{url} . (length $self->{path} ? '/' . $self->{path} : '');
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub do_git_commit {
|
2007-01-28 07:28:56 +01:00
|
|
|
my ($self, $log_entry) = @_;
|
2007-01-31 11:45:50 +01:00
|
|
|
my $lr = $self->last_rev;
|
|
|
|
if (defined $lr && $lr >= $log_entry->{revision}) {
|
|
|
|
die "Last fetched revision of ", $self->refname,
|
|
|
|
" was r$lr, but we are about to fetch: ",
|
|
|
|
"r$log_entry->{revision}!\n";
|
|
|
|
}
|
2007-01-14 07:35:53 +01:00
|
|
|
if (my $c = $self->rev_db_get($log_entry->{revision})) {
|
|
|
|
croak "$log_entry->{revision} = $c already exists! ",
|
2007-01-11 21:14:21 +01:00
|
|
|
"Why are we refetching it?\n";
|
|
|
|
}
|
2007-02-13 09:38:02 +01:00
|
|
|
$ENV{GIT_AUTHOR_NAME} = $ENV{GIT_COMMITTER_NAME} = $log_entry->{name};
|
|
|
|
$ENV{GIT_AUTHOR_EMAIL} = $ENV{GIT_COMMITTER_EMAIL} =
|
|
|
|
$log_entry->{email};
|
2007-01-14 07:35:53 +01:00
|
|
|
$ENV{GIT_AUTHOR_DATE} = $ENV{GIT_COMMITTER_DATE} = $log_entry->{date};
|
2007-01-11 21:14:21 +01:00
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
my $tree = $log_entry->{tree};
|
2007-01-11 21:14:21 +01:00
|
|
|
if (!defined $tree) {
|
|
|
|
$tree = $self->tmp_index_do(sub {
|
|
|
|
command_oneline('write-tree') });
|
|
|
|
}
|
|
|
|
die "Tree is not a valid sha1: $tree\n" if $tree !~ /^$::sha1$/o;
|
|
|
|
|
|
|
|
my @exec = ('git-commit-tree', $tree);
|
2007-01-28 07:28:56 +01:00
|
|
|
foreach ($self->get_commit_parents($log_entry)) {
|
2007-01-11 21:14:21 +01:00
|
|
|
push @exec, '-p', $_;
|
|
|
|
}
|
|
|
|
defined(my $pid = open3(my $msg_fh, my $out_fh, '>&STDERR', @exec))
|
|
|
|
or croak $!;
|
2007-01-14 07:35:53 +01:00
|
|
|
print $msg_fh $log_entry->{log} or croak $!;
|
2007-02-11 09:51:33 +01:00
|
|
|
unless ($self->no_metadata) {
|
2007-02-11 05:46:50 +01:00
|
|
|
print $msg_fh "\ngit-svn-id: $log_entry->{metadata}\n"
|
|
|
|
or croak $!;
|
2007-01-31 12:06:56 +01:00
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
$msg_fh->flush == 0 or croak $!;
|
|
|
|
close $msg_fh or croak $!;
|
|
|
|
chomp(my $commit = do { local $/; <$out_fh> });
|
|
|
|
close $out_fh or croak $!;
|
|
|
|
waitpid $pid, 0;
|
|
|
|
croak $? if $?;
|
|
|
|
if ($commit !~ /^$::sha1$/o) {
|
|
|
|
die "Failed to commit, invalid sha1: $commit\n";
|
|
|
|
}
|
|
|
|
|
2007-01-31 22:54:23 +01:00
|
|
|
$self->rev_db_set($log_entry->{revision}, $commit, 1);
|
2007-01-11 21:14:21 +01:00
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
$self->{last_rev} = $log_entry->{revision};
|
2007-01-11 21:14:21 +01:00
|
|
|
$self->{last_commit} = $commit;
|
2007-02-11 05:46:50 +01:00
|
|
|
print "r$log_entry->{revision}";
|
|
|
|
if (defined $log_entry->{svm_revision}) {
|
|
|
|
print " (\@$log_entry->{svm_revision})";
|
2007-02-12 22:25:25 +01:00
|
|
|
$self->rev_db_set($log_entry->{svm_revision}, $commit,
|
|
|
|
0, $self->svm_uuid);
|
2007-02-11 05:46:50 +01:00
|
|
|
}
|
|
|
|
print " = $commit ($self->{ref_id})\n";
|
2007-01-31 21:28:10 +01:00
|
|
|
if (defined $_repack && (--$_repack_nr == 0)) {
|
|
|
|
$_repack_nr = $_repack;
|
|
|
|
# repack doesn't use any arguments with spaces in them, does it?
|
|
|
|
print "Running git repack $_repack_flags ...\n";
|
|
|
|
command_noisy('repack', split(/\s+/, $_repack_flags));
|
|
|
|
print "Done repacking\n";
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
return $commit;
|
|
|
|
}
|
|
|
|
|
2007-02-07 03:35:30 +01:00
|
|
|
sub match_paths {
|
|
|
|
my ($self, $paths, $r) = @_;
|
2007-02-09 21:17:57 +01:00
|
|
|
return 1 if $self->{path} eq '';
|
2007-02-09 11:19:41 +01:00
|
|
|
if (my $path = $paths->{"/$self->{path}"}) {
|
|
|
|
return ($path->{action} eq 'D') ? 0 : 1;
|
|
|
|
}
|
2007-02-09 21:17:57 +01:00
|
|
|
$self->{path_regex} ||= qr/^\/\Q$self->{path}\E\//;
|
2007-02-07 03:35:30 +01:00
|
|
|
if (grep /$self->{path_regex}/, keys %$paths) {
|
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
my $c = '';
|
|
|
|
foreach (split m#/#, $self->{path}) {
|
|
|
|
$c .= "/$_";
|
2007-02-10 22:28:50 +01:00
|
|
|
next unless ($paths->{$c} &&
|
|
|
|
($paths->{$c}->{action} =~ /^[AR]$/));
|
2007-02-08 21:53:57 +01:00
|
|
|
if ($self->ra->check_path($self->{path}, $r) ==
|
|
|
|
$SVN::Node::dir) {
|
2007-02-07 03:35:30 +01:00
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
2007-01-22 11:20:33 +01:00
|
|
|
sub find_parent_branch {
|
|
|
|
my ($self, $paths, $rev) = @_;
|
2007-02-11 09:51:33 +01:00
|
|
|
return undef unless $self->follow_parent;
|
2007-01-26 00:44:54 +01:00
|
|
|
unless (defined $paths) {
|
2007-01-31 12:45:28 +01:00
|
|
|
my $err_handler = $SVN::Error::handler;
|
|
|
|
$SVN::Error::handler = \&Git::SVN::Ra::skip_unknown_revs;
|
2007-01-30 23:04:22 +01:00
|
|
|
$self->ra->get_log([$self->{path}], $rev, $rev, 0, 1, 1, sub {
|
|
|
|
$paths =
|
|
|
|
Git::SVN::Ra::dup_changed_paths($_[0]) });
|
2007-01-31 12:45:28 +01:00
|
|
|
$SVN::Error::handler = $err_handler;
|
2007-01-26 00:44:54 +01:00
|
|
|
}
|
|
|
|
return undef unless defined $paths;
|
2007-01-22 11:20:33 +01:00
|
|
|
|
|
|
|
# look for a parent from another branch:
|
2007-01-24 11:16:25 +01:00
|
|
|
my @b_path_components = split m#/#, $self->rel_path;
|
|
|
|
my @a_path_components;
|
|
|
|
my $i;
|
|
|
|
while (@b_path_components) {
|
|
|
|
$i = $paths->{'/'.join('/', @b_path_components)};
|
2007-02-10 22:28:50 +01:00
|
|
|
last if $i && defined $i->{copyfrom_path};
|
2007-01-24 11:16:25 +01:00
|
|
|
unshift(@a_path_components, pop(@b_path_components));
|
|
|
|
}
|
2007-02-10 22:28:50 +01:00
|
|
|
return undef unless defined $i && defined $i->{copyfrom_path};
|
|
|
|
my $branch_from = $i->{copyfrom_path};
|
2007-01-24 11:16:25 +01:00
|
|
|
if (@a_path_components) {
|
|
|
|
print STDERR "branch_from: $branch_from => ";
|
|
|
|
$branch_from .= '/'.join('/', @a_path_components);
|
|
|
|
print STDERR $branch_from, "\n";
|
|
|
|
}
|
2007-01-26 02:35:40 +01:00
|
|
|
my $r = $i->{copyfrom_rev};
|
2007-01-22 11:20:33 +01:00
|
|
|
my $repos_root = $self->ra->{repos_root};
|
|
|
|
my $url = $self->ra->{url};
|
|
|
|
my $new_url = $repos_root . $branch_from;
|
|
|
|
print STDERR "Found possible branch point: ",
|
|
|
|
"$new_url => ", $self->full_url, ", $r\n";
|
|
|
|
$branch_from =~ s#^/##;
|
2007-02-13 23:22:11 +01:00
|
|
|
my $gs = Git::SVN->find_by_url($new_url, $repos_root, $branch_from);
|
2007-01-22 11:20:33 +01:00
|
|
|
unless ($gs) {
|
2007-01-29 06:34:23 +01:00
|
|
|
my $ref_id = $self->{ref_id};
|
|
|
|
$ref_id =~ s/\@\d+$//;
|
|
|
|
$ref_id .= "\@$r";
|
2007-01-22 11:20:33 +01:00
|
|
|
# just grow a tail if we're not unique enough :x
|
|
|
|
$ref_id .= '-' while find_ref($ref_id);
|
2007-01-29 06:34:23 +01:00
|
|
|
print STDERR "Initializing parent: $ref_id\n";
|
2007-02-01 12:30:31 +01:00
|
|
|
$gs = Git::SVN->init($new_url, '', $ref_id, $ref_id, 1);
|
2007-01-22 11:20:33 +01:00
|
|
|
}
|
|
|
|
my ($r0, $parent) = $gs->find_rev_before($r, 1);
|
2007-02-11 09:51:33 +01:00
|
|
|
if (!defined $r0 || !defined $parent) {
|
2007-04-15 12:01:29 +02:00
|
|
|
my ($base, $head) = parse_revision_argument(0, $r);
|
|
|
|
if ($base <= $r) {
|
|
|
|
$gs->fetch($base, $r);
|
|
|
|
}
|
2007-01-22 11:20:33 +01:00
|
|
|
($r0, $parent) = $gs->last_rev_commit;
|
|
|
|
}
|
2007-02-01 13:12:41 +01:00
|
|
|
if (defined $r0 && defined $parent) {
|
2007-01-22 11:20:33 +01:00
|
|
|
print STDERR "Found branch parent: ($self->{ref_id}) $parent\n";
|
|
|
|
my $ed;
|
|
|
|
if ($self->ra->can_do_switch) {
|
2007-02-23 11:21:59 +01:00
|
|
|
$self->assert_index_clean($parent);
|
2007-01-22 20:44:57 +01:00
|
|
|
print STDERR "Following parent with do_switch\n";
|
2007-01-22 11:20:33 +01:00
|
|
|
# do_switch works with svn/trunk >= r22312, but that
|
2007-01-28 13:59:05 +01:00
|
|
|
# is not included with SVN 1.4.3 (the latest version
|
2007-01-22 11:20:33 +01:00
|
|
|
# at the moment), so we can't rely on it
|
|
|
|
$self->{last_commit} = $parent;
|
|
|
|
$ed = SVN::Git::Fetcher->new($self);
|
2007-01-31 11:45:50 +01:00
|
|
|
$gs->ra->gs_do_switch($r0, $rev, $gs,
|
2007-01-22 11:20:33 +01:00
|
|
|
$self->full_url, $ed)
|
|
|
|
or die "SVN connection failed somewhere...\n";
|
2007-09-28 19:24:19 +02:00
|
|
|
} elsif ($self->ra->trees_match($new_url, $r0,
|
|
|
|
$self->full_url, $rev)) {
|
|
|
|
print STDERR "Trees match:\n",
|
|
|
|
" $new_url\@$r0\n",
|
|
|
|
" ${\$self->full_url}\@$rev\n",
|
|
|
|
"Following parent with no changes\n";
|
|
|
|
$self->tmp_index_do(sub {
|
|
|
|
command_noisy('read-tree', $parent);
|
|
|
|
});
|
|
|
|
$self->{last_commit} = $parent;
|
2007-01-22 11:20:33 +01:00
|
|
|
} else {
|
2007-01-22 20:44:57 +01:00
|
|
|
print STDERR "Following parent with do_update\n";
|
2007-01-22 11:20:33 +01:00
|
|
|
$ed = SVN::Git::Fetcher->new($self);
|
2007-01-31 11:45:50 +01:00
|
|
|
$self->ra->gs_do_update($rev, $rev, $self, $ed)
|
2007-01-22 11:20:33 +01:00
|
|
|
or die "SVN connection failed somewhere...\n";
|
|
|
|
}
|
2007-01-30 03:34:55 +01:00
|
|
|
print STDERR "Successfully followed parent\n";
|
2007-01-22 11:20:33 +01:00
|
|
|
return $self->make_log_entry($rev, [$parent], $ed);
|
|
|
|
}
|
|
|
|
return undef;
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub do_fetch {
|
2007-01-19 02:50:01 +01:00
|
|
|
my ($self, $paths, $rev) = @_;
|
2007-01-22 11:20:33 +01:00
|
|
|
my $ed;
|
2007-01-11 21:14:21 +01:00
|
|
|
my ($last_rev, @parents);
|
2007-02-09 10:28:30 +01:00
|
|
|
if (my $lc = $self->last_commit) {
|
|
|
|
# we can have a branch that was deleted, then re-added
|
|
|
|
# under the same name but copied from another path, in
|
|
|
|
# which case we'll have multiple parents (we don't
|
|
|
|
# want to break the original ref, nor lose copypath info):
|
|
|
|
if (my $log_entry = $self->find_parent_branch($paths, $rev)) {
|
|
|
|
push @{$log_entry->{parents}}, $lc;
|
|
|
|
return $log_entry;
|
|
|
|
}
|
2007-01-22 11:20:33 +01:00
|
|
|
$ed = SVN::Git::Fetcher->new($self);
|
2007-01-11 21:14:21 +01:00
|
|
|
$last_rev = $self->{last_rev};
|
2007-02-09 10:28:30 +01:00
|
|
|
$ed->{c} = $lc;
|
|
|
|
@parents = ($lc);
|
2007-01-11 21:14:21 +01:00
|
|
|
} else {
|
|
|
|
$last_rev = $rev;
|
2007-01-22 11:20:33 +01:00
|
|
|
if (my $log_entry = $self->find_parent_branch($paths, $rev)) {
|
|
|
|
return $log_entry;
|
|
|
|
}
|
|
|
|
$ed = SVN::Git::Fetcher->new($self);
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
2007-01-31 11:45:50 +01:00
|
|
|
unless ($self->ra->gs_do_update($last_rev, $rev, $self, $ed)) {
|
2007-01-11 21:14:21 +01:00
|
|
|
die "SVN connection failed somewhere...\n";
|
|
|
|
}
|
|
|
|
$self->make_log_entry($rev, \@parents, $ed);
|
|
|
|
}
|
|
|
|
|
2007-01-25 20:53:13 +01:00
|
|
|
sub get_untracked {
|
|
|
|
my ($self, $ed) = @_;
|
|
|
|
my @out;
|
|
|
|
my $h = $ed->{empty};
|
2007-01-11 21:14:21 +01:00
|
|
|
foreach (sort keys %$h) {
|
|
|
|
my $act = $h->{$_} ? '+empty_dir' : '-empty_dir';
|
2007-01-25 20:53:13 +01:00
|
|
|
push @out, " $act: " . uri_encode($_);
|
2007-01-11 21:14:21 +01:00
|
|
|
warn "W: $act: $_\n";
|
|
|
|
}
|
|
|
|
foreach my $t (qw/dir_prop file_prop/) {
|
2007-01-25 20:53:13 +01:00
|
|
|
$h = $ed->{$t} or next;
|
2007-01-11 21:14:21 +01:00
|
|
|
foreach my $path (sort keys %$h) {
|
|
|
|
my $ppath = $path eq '' ? '.' : $path;
|
|
|
|
foreach my $prop (sort keys %{$h->{$path}}) {
|
2007-01-15 08:21:16 +01:00
|
|
|
next if $SKIP_PROP{$prop};
|
2007-01-11 21:14:21 +01:00
|
|
|
my $v = $h->{$path}->{$prop};
|
2007-01-25 20:53:13 +01:00
|
|
|
my $t_ppath_prop = "$t: " .
|
|
|
|
uri_encode($ppath) . ' ' .
|
|
|
|
uri_encode($prop);
|
2007-01-11 21:14:21 +01:00
|
|
|
if (defined $v) {
|
2007-01-25 20:53:13 +01:00
|
|
|
push @out, " +$t_ppath_prop " .
|
|
|
|
uri_encode($v);
|
2007-01-11 21:14:21 +01:00
|
|
|
} else {
|
2007-01-25 20:53:13 +01:00
|
|
|
push @out, " -$t_ppath_prop";
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
foreach my $t (qw/absent_file absent_directory/) {
|
2007-01-25 20:53:13 +01:00
|
|
|
$h = $ed->{$t} or next;
|
2007-01-11 21:14:21 +01:00
|
|
|
foreach my $parent (sort keys %$h) {
|
|
|
|
foreach my $path (sort @{$h->{$parent}}) {
|
2007-01-25 20:53:13 +01:00
|
|
|
push @out, " $t: " .
|
|
|
|
uri_encode("$parent/$path");
|
2007-01-11 21:14:21 +01:00
|
|
|
warn "W: $t: $parent/$path ",
|
|
|
|
"Insufficient permissions?\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2007-01-25 20:53:13 +01:00
|
|
|
\@out;
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-01-14 11:17:00 +01:00
|
|
|
sub parse_svn_date {
|
|
|
|
my $date = shift || return '+0000 1970-01-01 00:00:00';
|
|
|
|
my ($Y,$m,$d,$H,$M,$S) = ($date =~ /^(\d{4})\-(\d\d)\-(\d\d)T
|
|
|
|
(\d\d)\:(\d\d)\:(\d\d).\d+Z$/x) or
|
|
|
|
croak "Unable to parse date: $date\n";
|
|
|
|
"+0000 $Y-$m-$d $H:$M:$S";
|
|
|
|
}
|
|
|
|
|
|
|
|
sub check_author {
|
|
|
|
my ($author) = @_;
|
|
|
|
if (!defined $author || length $author == 0) {
|
|
|
|
$author = '(no author)';
|
|
|
|
}
|
|
|
|
if (defined $::_authors && ! defined $::users{$author}) {
|
|
|
|
die "Author: $author not defined in $::_authors file\n";
|
|
|
|
}
|
|
|
|
$author;
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub make_log_entry {
|
2007-01-25 20:53:13 +01:00
|
|
|
my ($self, $rev, $parents, $ed) = @_;
|
|
|
|
my $untracked = $self->get_untracked($ed);
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
open my $un, '>>', "$self->{dir}/unhandled.log" or croak $!;
|
2007-01-25 20:53:13 +01:00
|
|
|
print $un "r$rev\n" or croak $!;
|
|
|
|
print $un $_, "\n" foreach @$untracked;
|
|
|
|
my %log_entry = ( parents => $parents || [], revision => $rev,
|
|
|
|
log => '');
|
2007-02-07 03:35:30 +01:00
|
|
|
|
2007-02-11 05:46:50 +01:00
|
|
|
my $headrev;
|
2007-02-07 03:35:30 +01:00
|
|
|
my $logged = delete $self->{logged_rev_props};
|
2007-02-11 05:46:50 +01:00
|
|
|
if (!$logged || $self->{-want_revprops}) {
|
2007-02-07 03:35:30 +01:00
|
|
|
my $rp = $self->ra->rev_proplist($rev);
|
|
|
|
foreach (sort keys %$rp) {
|
|
|
|
my $v = $rp->{$_};
|
|
|
|
if (/^svn:(author|date|log)$/) {
|
|
|
|
$log_entry{$1} = $v;
|
2007-02-11 05:46:50 +01:00
|
|
|
} elsif ($_ eq 'svm:headrev') {
|
|
|
|
$headrev = $v;
|
2007-02-07 03:35:30 +01:00
|
|
|
} else {
|
|
|
|
print $un " rev_prop: ", uri_encode($_), ' ',
|
|
|
|
uri_encode($v), "\n";
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
2007-02-07 03:35:30 +01:00
|
|
|
} else {
|
|
|
|
map { $log_entry{$_} = $logged->{$_} } keys %$logged;
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
close $un or croak $!;
|
2007-01-25 20:53:13 +01:00
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
$log_entry{date} = parse_svn_date($log_entry{date});
|
|
|
|
$log_entry{log} .= "\n";
|
2007-02-13 09:38:02 +01:00
|
|
|
my $author = $log_entry{author} = check_author($log_entry{author});
|
|
|
|
my ($name, $email) = defined $::users{$author} ? @{$::users{$author}}
|
|
|
|
: ($author, undef);
|
2007-02-11 09:51:33 +01:00
|
|
|
if (defined $headrev && $self->use_svm_props) {
|
2007-02-17 04:15:21 +01:00
|
|
|
if ($self->rewrite_root) {
|
|
|
|
die "Can't have both 'useSvmProps' and 'rewriteRoot' ",
|
|
|
|
"options set!\n";
|
|
|
|
}
|
2007-02-11 05:46:50 +01:00
|
|
|
my ($uuid, $r) = $headrev =~ m{^([a-f\d\-]{30,}):(\d+)$};
|
2007-02-17 11:53:07 +01:00
|
|
|
# we don't want "SVM: initializing mirror for junk" ...
|
|
|
|
return undef if $r == 0;
|
|
|
|
my $svm = $self->svm;
|
|
|
|
if ($uuid ne $svm->{uuid}) {
|
2007-02-11 05:46:50 +01:00
|
|
|
die "UUID mismatch on SVM path:\n",
|
2007-02-17 11:53:07 +01:00
|
|
|
"expected: $svm->{uuid}\n",
|
2007-02-11 05:46:50 +01:00
|
|
|
" got: $uuid\n";
|
|
|
|
}
|
2007-02-17 11:53:07 +01:00
|
|
|
my $full_url = $self->full_url;
|
|
|
|
$full_url =~ s#^\Q$svm->{replace}\E(/|$)#$svm->{source}$1# or
|
|
|
|
die "Failed to replace '$svm->{replace}' with ",
|
|
|
|
"'$svm->{source}' in $full_url\n";
|
2007-02-23 00:32:29 +01:00
|
|
|
# throw away username for storing in records
|
|
|
|
remove_username($full_url);
|
2007-02-11 05:46:50 +01:00
|
|
|
$log_entry{metadata} = "$full_url\@$r $uuid";
|
|
|
|
$log_entry{svm_revision} = $r;
|
2007-02-13 09:38:02 +01:00
|
|
|
$email ||= "$author\@$uuid"
|
2007-02-17 04:57:29 +01:00
|
|
|
} elsif ($self->use_svnsync_props) {
|
|
|
|
my $full_url = $self->svnsync->{url};
|
|
|
|
$full_url .= "/$self->{path}" if length $self->{path};
|
2007-04-25 03:02:07 +02:00
|
|
|
remove_username($full_url);
|
2007-02-17 04:57:29 +01:00
|
|
|
my $uuid = $self->svnsync->{uuid};
|
|
|
|
$log_entry{metadata} = "$full_url\@$rev $uuid";
|
|
|
|
$email ||= "$author\@$uuid"
|
2007-02-11 05:46:50 +01:00
|
|
|
} else {
|
2007-04-25 03:02:07 +02:00
|
|
|
my $url = $self->metadata_url;
|
|
|
|
remove_username($url);
|
|
|
|
$log_entry{metadata} = "$url\@$rev " .
|
2007-02-12 22:25:25 +01:00
|
|
|
$self->ra->get_uuid;
|
2007-02-13 09:38:02 +01:00
|
|
|
$email ||= "$author\@" . $self->ra->get_uuid;
|
2007-02-11 05:46:50 +01:00
|
|
|
}
|
2007-02-13 09:38:02 +01:00
|
|
|
$log_entry{name} = $name;
|
|
|
|
$log_entry{email} = $email;
|
2007-01-11 21:14:21 +01:00
|
|
|
\%log_entry;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub fetch {
|
2007-01-26 02:35:40 +01:00
|
|
|
my ($self, $min_rev, $max_rev, @parents) = @_;
|
2007-01-11 21:14:21 +01:00
|
|
|
my ($last_rev, $last_commit) = $self->last_rev_commit;
|
2007-01-26 02:35:40 +01:00
|
|
|
my ($base, $head) = $self->get_fetch_range($min_rev, $max_rev);
|
2007-02-08 21:53:57 +01:00
|
|
|
$self->ra->gs_fetch_loop_common($base, $head, [$self]);
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub set_tree_cb {
|
|
|
|
my ($self, $log_entry, $tree, $rev, $date, $author) = @_;
|
2007-02-10 22:58:33 +01:00
|
|
|
$self->{inject_parents} = { $rev => $tree };
|
|
|
|
$self->fetch(undef, undef);
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub set_tree {
|
|
|
|
my ($self, $tree) = (shift, shift);
|
2007-01-15 08:21:16 +01:00
|
|
|
my $log_entry = ::get_commit_entry($tree);
|
2007-01-11 21:14:21 +01:00
|
|
|
unless ($self->{last_rev}) {
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal("Must have an existing revision to commit");
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
2007-01-27 23:33:08 +01:00
|
|
|
my %ed_opts = ( r => $self->{last_rev},
|
|
|
|
log => $log_entry->{log},
|
|
|
|
ra => $self->ra,
|
|
|
|
tree_a => $self->{last_commit},
|
|
|
|
tree_b => $tree,
|
|
|
|
editor_cb => sub {
|
|
|
|
$self->set_tree_cb($log_entry, $tree, @_) },
|
|
|
|
svn_path => $self->{path} );
|
|
|
|
if (!SVN::Git::Editor->new(\%ed_opts)->apply_diff) {
|
2007-01-11 21:14:21 +01:00
|
|
|
print "No changes\nr$self->{last_rev} = $tree\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-30 22:11:14 +01:00
|
|
|
sub rebuild {
|
|
|
|
my ($self) = @_;
|
2007-02-12 22:25:25 +01:00
|
|
|
my $db_path = $self->db_path;
|
2007-02-16 13:05:33 +01:00
|
|
|
return if (-e $db_path && ! -z $db_path);
|
|
|
|
return unless ::verify_ref($self->refname.'^0');
|
2007-02-12 22:25:25 +01:00
|
|
|
if (-f $self->{db_root}) {
|
|
|
|
rename $self->{db_root}, $db_path or die
|
|
|
|
"rename $self->{db_root} => $db_path failed: $!\n";
|
|
|
|
my ($dir, $base) = ($db_path =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
symlink $base, $self->{db_root} or die
|
|
|
|
"symlink $base => $self->{db_root} failed: $!\n";
|
|
|
|
return;
|
|
|
|
}
|
|
|
|
print "Rebuilding $db_path ...\n";
|
2007-08-31 23:29:49 +02:00
|
|
|
my ($log, $ctx) = command_output_pipe("log", '--no-color', $self->refname);
|
2007-01-30 22:11:14 +01:00
|
|
|
my $latest;
|
|
|
|
my $full_url = $self->full_url;
|
2007-02-23 00:32:29 +01:00
|
|
|
remove_username($full_url);
|
2007-01-30 22:11:14 +01:00
|
|
|
my $svn_uuid;
|
2007-06-30 10:56:13 +02:00
|
|
|
my $c;
|
|
|
|
while (<$log>) {
|
|
|
|
if ( m{^commit ($::sha1)$} ) {
|
|
|
|
$c = $1;
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
next unless s{^\s*(git-svn-id:)}{$1};
|
|
|
|
my ($url, $rev, $uuid) = ::extract_metadata($_);
|
2007-02-23 00:32:29 +01:00
|
|
|
remove_username($url);
|
2007-01-30 22:11:14 +01:00
|
|
|
|
|
|
|
# ignore merges (from set-tree)
|
|
|
|
next if (!defined $rev || !$uuid);
|
|
|
|
|
|
|
|
# if we merged or otherwise started elsewhere, this is
|
|
|
|
# how we break out of it
|
|
|
|
if ((defined $svn_uuid && ($uuid ne $svn_uuid)) ||
|
|
|
|
($full_url && $url && ($url ne $full_url))) {
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
$latest ||= $rev;
|
|
|
|
$svn_uuid ||= $uuid;
|
|
|
|
|
|
|
|
$self->rev_db_set($rev, $c);
|
|
|
|
print "r$rev = $c\n";
|
|
|
|
}
|
2007-06-30 10:56:13 +02:00
|
|
|
command_close_pipe($log, $ctx);
|
2007-02-12 22:25:25 +01:00
|
|
|
print "Done rebuilding $db_path\n";
|
2007-01-30 22:11:14 +01:00
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
# rev_db:
|
|
|
|
# Tie::File seems to be prone to offset errors if revisions get sparse,
|
|
|
|
# it's not that fast, either. Tie::File is also not in Perl 5.6. So
|
|
|
|
# one of my favorite modules is out :< Next up would be one of the DBM
|
|
|
|
# modules, but I'm not sure which is most portable... So I'll just
|
|
|
|
# go with something that's plain-text, but still capable of
|
|
|
|
# being randomly accessed. So here's my ultra-simple fixed-width
|
|
|
|
# database. All records are 40 characters + "\n", so it's easy to seek
|
|
|
|
# to a revision: (41 * rev) is the byte offset.
|
|
|
|
# A record of 40 0s denotes an empty revision.
|
|
|
|
# And yes, it's still pretty fast (faster than Tie::File).
|
2007-02-12 00:21:24 +01:00
|
|
|
# These files are disposable unless noMetadata or useSvmProps is set
|
2007-01-11 21:14:21 +01:00
|
|
|
|
2007-02-12 22:25:25 +01:00
|
|
|
sub _rev_db_set {
|
|
|
|
my ($fh, $rev, $commit) = @_;
|
|
|
|
my $offset = $rev * 41;
|
|
|
|
# assume that append is the common case:
|
|
|
|
seek $fh, 0, 2 or croak $!;
|
|
|
|
my $pos = tell $fh;
|
|
|
|
if ($pos < $offset) {
|
|
|
|
for (1 .. (($offset - $pos) / 41)) {
|
|
|
|
print $fh (('0' x 40),"\n") or croak $!;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
seek $fh, $offset, 0 or croak $!;
|
|
|
|
print $fh $commit,"\n" or croak $!;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub mkfile {
|
|
|
|
my ($path) = @_;
|
|
|
|
unless (-e $path) {
|
|
|
|
my ($dir, $base) = ($path =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
mkpath([$dir]) unless -d $dir;
|
|
|
|
open my $fh, '>>', $path or die "Couldn't create $path: $!\n";
|
|
|
|
close $fh or die "Couldn't close (create) $path: $!\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub rev_db_set {
|
2007-02-12 22:25:25 +01:00
|
|
|
my ($self, $rev, $commit, $update_ref, $uuid) = @_;
|
|
|
|
length $commit == 40 or die "arg3 must be a full SHA1 hexsum\n";
|
|
|
|
my $db = $self->db_path($uuid);
|
|
|
|
my $db_lock = "$db.lock";
|
2007-01-31 22:54:23 +01:00
|
|
|
my $sig;
|
|
|
|
if ($update_ref) {
|
|
|
|
$SIG{INT} = $SIG{HUP} = $SIG{TERM} = $SIG{ALRM} = $SIG{PIPE} =
|
|
|
|
$SIG{USR1} = $SIG{USR2} = sub { $sig = $_[0] };
|
|
|
|
}
|
2007-02-12 22:25:25 +01:00
|
|
|
mkfile($db);
|
|
|
|
|
2007-01-31 22:54:23 +01:00
|
|
|
$LOCKFILES{$db_lock} = 1;
|
2007-02-12 00:21:24 +01:00
|
|
|
my $sync;
|
|
|
|
# both of these options make our .rev_db file very, very important
|
|
|
|
# and we can't afford to lose it because rebuild() won't work
|
|
|
|
if ($self->use_svm_props || $self->no_metadata) {
|
|
|
|
$sync = 1;
|
2007-01-31 22:54:23 +01:00
|
|
|
copy($db, $db_lock) or die "rev_db_set(@_): ",
|
2007-02-12 22:25:25 +01:00
|
|
|
"Failed to copy: ",
|
2007-01-31 22:54:23 +01:00
|
|
|
"$db => $db_lock ($!)\n";
|
|
|
|
} else {
|
|
|
|
rename $db, $db_lock or die "rev_db_set(@_): ",
|
2007-02-12 22:25:25 +01:00
|
|
|
"Failed to rename: ",
|
2007-01-31 22:54:23 +01:00
|
|
|
"$db => $db_lock ($!)\n";
|
|
|
|
}
|
2007-02-12 22:25:25 +01:00
|
|
|
open my $fh, '+<', $db_lock or die "Couldn't open $db_lock: $!\n";
|
|
|
|
_rev_db_set($fh, $rev, $commit);
|
2007-02-12 00:21:24 +01:00
|
|
|
if ($sync) {
|
|
|
|
$fh->flush or die "Couldn't flush $db_lock: $!\n";
|
|
|
|
$fh->sync or die "Couldn't sync $db_lock: $!\n";
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
close $fh or croak $!;
|
2007-01-31 22:54:23 +01:00
|
|
|
if ($update_ref) {
|
2007-02-16 10:45:13 +01:00
|
|
|
$_head = $self;
|
2007-01-31 22:54:23 +01:00
|
|
|
command_noisy('update-ref', '-m', "r$rev",
|
|
|
|
$self->refname, $commit);
|
|
|
|
}
|
|
|
|
rename $db_lock, $db or die "rev_db_set(@_): ", "Failed to rename: ",
|
|
|
|
"$db_lock => $db ($!)\n";
|
|
|
|
delete $LOCKFILES{$db_lock};
|
|
|
|
if ($update_ref) {
|
|
|
|
$SIG{INT} = $SIG{HUP} = $SIG{TERM} = $SIG{ALRM} = $SIG{PIPE} =
|
|
|
|
$SIG{USR1} = $SIG{USR2} = 'DEFAULT';
|
|
|
|
kill $sig, $$ if defined $sig;
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-02-01 02:22:31 +01:00
|
|
|
sub rev_db_max {
|
|
|
|
my ($self) = @_;
|
2007-02-16 13:05:33 +01:00
|
|
|
$self->rebuild;
|
2007-02-12 22:25:25 +01:00
|
|
|
my $db_path = $self->db_path;
|
|
|
|
my @stat = stat $db_path or return 0;
|
|
|
|
($stat[7] % 41) == 0 or die "$db_path inconsistent size: $stat[7]\n";
|
2007-02-01 02:22:31 +01:00
|
|
|
my $max = $stat[7] / 41;
|
|
|
|
(($max > 0) ? $max - 1 : 0);
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub rev_db_get {
|
2007-02-12 22:25:25 +01:00
|
|
|
my ($self, $rev, $uuid) = @_;
|
2007-01-11 21:14:21 +01:00
|
|
|
my $ret;
|
|
|
|
my $offset = $rev * 41;
|
2007-02-12 22:25:25 +01:00
|
|
|
my $db_path = $self->db_path($uuid);
|
|
|
|
return undef unless -e $db_path;
|
|
|
|
open my $fh, '<', $db_path or croak $!;
|
2007-02-01 02:57:36 +01:00
|
|
|
if (sysseek($fh, $offset, 0) == $offset) {
|
|
|
|
my $read = sysread($fh, $ret, 40);
|
|
|
|
$ret = undef if ($read != 40 || $ret eq ('0'x40));
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
close $fh or croak $!;
|
|
|
|
$ret;
|
|
|
|
}
|
|
|
|
|
2007-01-22 11:20:33 +01:00
|
|
|
sub find_rev_before {
|
|
|
|
my ($self, $rev, $eq_ok) = @_;
|
|
|
|
--$rev unless $eq_ok;
|
|
|
|
while ($rev > 0) {
|
|
|
|
if (my $c = $self->rev_db_get($rev)) {
|
|
|
|
return ($rev, $c);
|
|
|
|
}
|
|
|
|
--$rev;
|
|
|
|
}
|
|
|
|
return (undef, undef);
|
|
|
|
}
|
|
|
|
|
2007-01-11 21:14:21 +01:00
|
|
|
sub _new {
|
2007-01-19 02:50:01 +01:00
|
|
|
my ($class, $repo_id, $ref_id, $path) = @_;
|
|
|
|
unless (defined $repo_id && length $repo_id) {
|
|
|
|
$repo_id = $Git::SVN::default_repo_id;
|
|
|
|
}
|
|
|
|
unless (defined $ref_id && length $ref_id) {
|
2007-01-22 20:44:57 +01:00
|
|
|
$_[2] = $ref_id = $Git::SVN::default_ref_id;
|
2007-01-19 02:50:01 +01:00
|
|
|
}
|
|
|
|
$_[1] = $repo_id = sanitize_remote_name($repo_id);
|
|
|
|
my $dir = "$ENV{GIT_DIR}/svn/$ref_id";
|
|
|
|
$_[3] = $path = '' unless (defined $path);
|
2007-02-15 00:10:44 +01:00
|
|
|
mkpath(["$ENV{GIT_DIR}/svn"]);
|
2007-02-12 22:25:25 +01:00
|
|
|
bless {
|
|
|
|
ref_id => $ref_id, dir => $dir, index => "$dir/index",
|
2007-02-11 05:46:50 +01:00
|
|
|
path => $path, config => "$ENV{GIT_DIR}/svn/config",
|
2007-02-12 22:25:25 +01:00
|
|
|
db_root => "$dir/.rev_db", repo_id => $repo_id }, $class;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub db_path {
|
|
|
|
my ($self, $uuid) = @_;
|
|
|
|
$uuid ||= $self->ra_uuid;
|
|
|
|
"$self->{db_root}.$uuid";
|
2007-01-11 21:14:21 +01:00
|
|
|
}
|
|
|
|
|
2007-01-14 11:17:00 +01:00
|
|
|
sub uri_encode {
|
|
|
|
my ($f) = @_;
|
|
|
|
$f =~ s#([^a-zA-Z0-9\*!\:_\./\-])#uc sprintf("%%%02x",ord($1))#eg;
|
|
|
|
$f
|
|
|
|
}
|
2007-01-11 21:14:21 +01:00
|
|
|
|
2007-02-23 00:32:29 +01:00
|
|
|
sub remove_username {
|
|
|
|
$_[0] =~ s{^([^:]*://)[^@]+@}{$1};
|
|
|
|
}
|
|
|
|
|
2007-01-04 09:45:03 +01:00
|
|
|
package Git::SVN::Prompt;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
require SVN::Core;
|
|
|
|
use vars qw/$_no_auth_cache $_username/;
|
|
|
|
|
|
|
|
sub simple {
|
2006-11-24 10:38:04 +01:00
|
|
|
my ($cred, $realm, $default_username, $may_save, $pool) = @_;
|
|
|
|
$may_save = undef if $_no_auth_cache;
|
|
|
|
$default_username = $_username if defined $_username;
|
|
|
|
if (defined $default_username && length $default_username) {
|
|
|
|
if (defined $realm && length $realm) {
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "Authentication realm: $realm\n";
|
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
}
|
|
|
|
$cred->username($default_username);
|
|
|
|
} else {
|
2007-01-04 09:45:03 +01:00
|
|
|
username($cred, $realm, $may_save, $pool);
|
2006-11-24 10:38:04 +01:00
|
|
|
}
|
|
|
|
$cred->password(_read_password("Password for '" .
|
|
|
|
$cred->username . "': ", $realm));
|
|
|
|
$cred->may_save($may_save);
|
|
|
|
$SVN::_Core::SVN_NO_ERROR;
|
|
|
|
}
|
|
|
|
|
2007-01-04 09:45:03 +01:00
|
|
|
sub ssl_server_trust {
|
2006-11-24 10:38:04 +01:00
|
|
|
my ($cred, $realm, $failures, $cert_info, $may_save, $pool) = @_;
|
|
|
|
$may_save = undef if $_no_auth_cache;
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "Error validating server certificate for '$realm':\n";
|
2007-10-15 09:19:12 +02:00
|
|
|
{
|
|
|
|
no warnings 'once';
|
|
|
|
# All variables SVN::Auth::SSL::* are used only once,
|
|
|
|
# so we're shutting up Perl warnings about this.
|
|
|
|
if ($failures & $SVN::Auth::SSL::UNKNOWNCA) {
|
|
|
|
print STDERR " - The certificate is not issued ",
|
|
|
|
"by a trusted authority. Use the\n",
|
|
|
|
" fingerprint to validate ",
|
|
|
|
"the certificate manually!\n";
|
|
|
|
}
|
|
|
|
if ($failures & $SVN::Auth::SSL::CNMISMATCH) {
|
|
|
|
print STDERR " - The certificate hostname ",
|
|
|
|
"does not match.\n";
|
|
|
|
}
|
|
|
|
if ($failures & $SVN::Auth::SSL::NOTYETVALID) {
|
|
|
|
print STDERR " - The certificate is not yet valid.\n";
|
|
|
|
}
|
|
|
|
if ($failures & $SVN::Auth::SSL::EXPIRED) {
|
|
|
|
print STDERR " - The certificate has expired.\n";
|
|
|
|
}
|
|
|
|
if ($failures & $SVN::Auth::SSL::OTHER) {
|
|
|
|
print STDERR " - The certificate has ",
|
|
|
|
"an unknown error.\n";
|
|
|
|
}
|
|
|
|
} # no warnings 'once'
|
2007-01-16 05:15:55 +01:00
|
|
|
printf STDERR
|
|
|
|
"Certificate information:\n".
|
2006-11-24 10:38:04 +01:00
|
|
|
" - Hostname: %s\n".
|
|
|
|
" - Valid: from %s until %s\n".
|
|
|
|
" - Issuer: %s\n".
|
|
|
|
" - Fingerprint: %s\n",
|
|
|
|
map $cert_info->$_, qw(hostname valid_from valid_until
|
2007-01-16 05:15:55 +01:00
|
|
|
issuer_dname fingerprint);
|
2006-11-24 10:38:04 +01:00
|
|
|
my $choice;
|
|
|
|
prompt:
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR $may_save ?
|
2006-11-24 10:38:04 +01:00
|
|
|
"(R)eject, accept (t)emporarily or accept (p)ermanently? " :
|
|
|
|
"(R)eject or accept (t)emporarily? ";
|
2007-01-16 05:15:55 +01:00
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
$choice = lc(substr(<STDIN> || 'R', 0, 1));
|
|
|
|
if ($choice =~ /^t$/i) {
|
|
|
|
$cred->may_save(undef);
|
|
|
|
} elsif ($choice =~ /^r$/i) {
|
|
|
|
return -1;
|
|
|
|
} elsif ($may_save && $choice =~ /^p$/i) {
|
|
|
|
$cred->may_save($may_save);
|
|
|
|
} else {
|
|
|
|
goto prompt;
|
|
|
|
}
|
|
|
|
$cred->accepted_failures($failures);
|
|
|
|
$SVN::_Core::SVN_NO_ERROR;
|
|
|
|
}
|
|
|
|
|
2007-01-04 09:45:03 +01:00
|
|
|
sub ssl_client_cert {
|
2006-11-24 10:38:04 +01:00
|
|
|
my ($cred, $realm, $may_save, $pool) = @_;
|
|
|
|
$may_save = undef if $_no_auth_cache;
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "Client certificate filename: ";
|
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
chomp(my $filename = <STDIN>);
|
|
|
|
$cred->cert_file($filename);
|
|
|
|
$cred->may_save($may_save);
|
|
|
|
$SVN::_Core::SVN_NO_ERROR;
|
|
|
|
}
|
|
|
|
|
2007-01-04 09:45:03 +01:00
|
|
|
sub ssl_client_cert_pw {
|
2006-11-24 10:38:04 +01:00
|
|
|
my ($cred, $realm, $may_save, $pool) = @_;
|
|
|
|
$may_save = undef if $_no_auth_cache;
|
|
|
|
$cred->password(_read_password("Password: ", $realm));
|
|
|
|
$cred->may_save($may_save);
|
|
|
|
$SVN::_Core::SVN_NO_ERROR;
|
|
|
|
}
|
|
|
|
|
2007-01-04 09:45:03 +01:00
|
|
|
sub username {
|
2006-11-24 10:38:04 +01:00
|
|
|
my ($cred, $realm, $may_save, $pool) = @_;
|
|
|
|
$may_save = undef if $_no_auth_cache;
|
|
|
|
if (defined $realm && length $realm) {
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "Authentication realm: $realm\n";
|
2006-11-24 10:38:04 +01:00
|
|
|
}
|
|
|
|
my $username;
|
|
|
|
if (defined $_username) {
|
|
|
|
$username = $_username;
|
|
|
|
} else {
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "Username: ";
|
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
chomp($username = <STDIN>);
|
|
|
|
}
|
|
|
|
$cred->username($username);
|
|
|
|
$cred->may_save($may_save);
|
|
|
|
$SVN::_Core::SVN_NO_ERROR;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub _read_password {
|
|
|
|
my ($prompt, $realm) = @_;
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR $prompt;
|
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
require Term::ReadKey;
|
|
|
|
Term::ReadKey::ReadMode('noecho');
|
|
|
|
my $password = '';
|
|
|
|
while (defined(my $key = Term::ReadKey::ReadKey(0))) {
|
|
|
|
last if $key =~ /[\012\015]/; # \n\r
|
|
|
|
$password .= $key;
|
|
|
|
}
|
|
|
|
Term::ReadKey::ReadMode('restore');
|
2007-01-16 05:15:55 +01:00
|
|
|
print STDERR "\n";
|
|
|
|
STDERR->flush;
|
2006-11-24 10:38:04 +01:00
|
|
|
$password;
|
|
|
|
}
|
|
|
|
|
2006-11-28 06:44:48 +01:00
|
|
|
package SVN::Git::Fetcher;
|
|
|
|
use vars qw/@ISA/;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
use Carp qw/croak/;
|
|
|
|
use IO::File qw//;
|
2007-01-30 01:27:08 +01:00
|
|
|
use Digest::MD5;
|
2006-11-28 06:44:48 +01:00
|
|
|
|
|
|
|
# file baton members: path, mode_a, mode_b, pool, fh, blob, base
|
|
|
|
sub new {
|
|
|
|
my ($class, $git_svn) = @_;
|
|
|
|
my $self = SVN::Delta::Editor->new;
|
|
|
|
bless $self, $class;
|
2007-01-14 11:17:00 +01:00
|
|
|
$self->{c} = $git_svn->{last_commit} if exists $git_svn->{last_commit};
|
2006-12-12 23:47:00 +01:00
|
|
|
$self->{empty} = {};
|
|
|
|
$self->{dir_prop} = {};
|
|
|
|
$self->{file_prop} = {};
|
|
|
|
$self->{absent_dir} = {};
|
|
|
|
$self->{absent_file} = {};
|
2007-01-24 12:30:57 +01:00
|
|
|
$self->{gii} = $git_svn->tmp_index_do(sub { Git::IndexInfo->new });
|
2006-11-28 06:44:48 +01:00
|
|
|
$self;
|
|
|
|
}
|
|
|
|
|
2007-01-22 20:44:57 +01:00
|
|
|
sub set_path_strip {
|
|
|
|
my ($self, $path) = @_;
|
2007-02-09 21:17:57 +01:00
|
|
|
$self->{path_strip} = qr/^\Q$path\E(\/|$)/ if length $path;
|
2007-01-22 20:44:57 +01:00
|
|
|
}
|
|
|
|
|
2006-12-12 23:47:00 +01:00
|
|
|
sub open_root {
|
|
|
|
{ path => '' };
|
|
|
|
}
|
|
|
|
|
|
|
|
sub open_directory {
|
|
|
|
my ($self, $path, $pb, $rev) = @_;
|
|
|
|
{ path => $path };
|
|
|
|
}
|
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
sub git_path {
|
|
|
|
my ($self, $path) = @_;
|
2007-01-28 13:59:05 +01:00
|
|
|
if ($self->{path_strip}) {
|
|
|
|
$path =~ s!$self->{path_strip}!! or
|
|
|
|
die "Failed to strip path '$path' ($self->{path_strip})\n";
|
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
$path;
|
|
|
|
}
|
|
|
|
|
2006-11-28 06:44:48 +01:00
|
|
|
sub delete_entry {
|
|
|
|
my ($self, $path, $rev, $pb) = @_;
|
2007-01-04 10:38:18 +01:00
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
my $gpath = $self->git_path($path);
|
2007-01-31 11:45:50 +01:00
|
|
|
return undef if ($gpath eq '');
|
|
|
|
|
2007-01-04 10:38:18 +01:00
|
|
|
# remove entire directories.
|
2007-01-19 02:50:01 +01:00
|
|
|
if (command('ls-tree', $self->{c}, '--', $gpath) =~ /^040000 tree/) {
|
2007-01-04 10:38:18 +01:00
|
|
|
my ($ls, $ctx) = command_output_pipe(qw/ls-tree
|
|
|
|
-r --name-only -z/,
|
2007-01-19 02:50:01 +01:00
|
|
|
$self->{c}, '--', $gpath);
|
2007-01-04 10:38:18 +01:00
|
|
|
local $/ = "\0";
|
|
|
|
while (<$ls>) {
|
2007-01-24 12:30:57 +01:00
|
|
|
chomp;
|
|
|
|
$self->{gii}->remove($_);
|
2007-02-09 21:23:47 +01:00
|
|
|
print "\tD\t$_\n" unless $::_q;
|
2007-01-04 10:38:18 +01:00
|
|
|
}
|
2007-02-09 21:23:47 +01:00
|
|
|
print "\tD\t$gpath/\n" unless $::_q;
|
2007-01-04 10:38:18 +01:00
|
|
|
command_close_pipe($ls, $ctx);
|
|
|
|
$self->{empty}->{$path} = 0
|
|
|
|
} else {
|
2007-01-24 12:30:57 +01:00
|
|
|
$self->{gii}->remove($gpath);
|
2007-02-09 21:23:47 +01:00
|
|
|
print "\tD\t$gpath\n" unless $::_q;
|
2007-01-04 10:38:18 +01:00
|
|
|
}
|
2006-11-28 06:44:48 +01:00
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub open_file {
|
|
|
|
my ($self, $path, $pb, $rev) = @_;
|
2007-01-19 02:50:01 +01:00
|
|
|
my $gpath = $self->git_path($path);
|
|
|
|
my ($mode, $blob) = (command('ls-tree', $self->{c}, '--', $gpath)
|
2006-11-28 06:44:48 +01:00
|
|
|
=~ /^(\d{6}) blob ([a-f\d]{40})\t/);
|
2006-12-08 10:55:19 +01:00
|
|
|
unless (defined $mode && defined $blob) {
|
|
|
|
die "$path was not found in commit $self->{c} (r$rev)\n";
|
|
|
|
}
|
2006-11-28 06:44:48 +01:00
|
|
|
{ path => $path, mode_a => $mode, mode_b => $mode, blob => $blob,
|
2006-11-28 11:50:17 +01:00
|
|
|
pool => SVN::Pool->new, action => 'M' };
|
2006-11-28 06:44:48 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub add_file {
|
|
|
|
my ($self, $path, $pb, $cp_path, $cp_rev) = @_;
|
2006-12-12 23:47:00 +01:00
|
|
|
my ($dir, $file) = ($path =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
delete $self->{empty}->{$dir};
|
2006-11-28 06:44:48 +01:00
|
|
|
{ path => $path, mode_a => 100644, mode_b => 100644,
|
2006-11-28 11:50:17 +01:00
|
|
|
pool => SVN::Pool->new, action => 'A' };
|
2006-11-28 06:44:48 +01:00
|
|
|
}
|
|
|
|
|
2006-12-12 23:47:00 +01:00
|
|
|
sub add_directory {
|
|
|
|
my ($self, $path, $cp_path, $cp_rev) = @_;
|
|
|
|
my ($dir, $file) = ($path =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
delete $self->{empty}->{$dir};
|
|
|
|
$self->{empty}->{$path} = 1;
|
|
|
|
{ path => $path };
|
|
|
|
}
|
|
|
|
|
|
|
|
sub change_dir_prop {
|
|
|
|
my ($self, $db, $prop, $value) = @_;
|
|
|
|
$self->{dir_prop}->{$db->{path}} ||= {};
|
|
|
|
$self->{dir_prop}->{$db->{path}}->{$prop} = $value;
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub absent_directory {
|
|
|
|
my ($self, $path, $pb) = @_;
|
|
|
|
$self->{absent_dir}->{$pb->{path}} ||= [];
|
|
|
|
push @{$self->{absent_dir}->{$pb->{path}}}, $path;
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub absent_file {
|
|
|
|
my ($self, $path, $pb) = @_;
|
|
|
|
$self->{absent_file}->{$pb->{path}} ||= [];
|
|
|
|
push @{$self->{absent_file}->{$pb->{path}}}, $path;
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
2006-11-28 06:44:48 +01:00
|
|
|
sub change_file_prop {
|
|
|
|
my ($self, $fb, $prop, $value) = @_;
|
|
|
|
if ($prop eq 'svn:executable') {
|
|
|
|
if ($fb->{mode_b} != 120000) {
|
|
|
|
$fb->{mode_b} = defined $value ? 100755 : 100644;
|
|
|
|
}
|
|
|
|
} elsif ($prop eq 'svn:special') {
|
|
|
|
$fb->{mode_b} = defined $value ? 120000 : 100644;
|
2006-12-12 23:47:00 +01:00
|
|
|
} else {
|
|
|
|
$self->{file_prop}->{$fb->{path}} ||= {};
|
|
|
|
$self->{file_prop}->{$fb->{path}}->{$prop} = $value;
|
2006-11-28 06:44:48 +01:00
|
|
|
}
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub apply_textdelta {
|
|
|
|
my ($self, $fb, $exp) = @_;
|
|
|
|
my $fh = IO::File->new_tmpfile;
|
|
|
|
$fh->autoflush(1);
|
|
|
|
# $fh gets auto-closed() by SVN::TxDelta::apply(),
|
|
|
|
# (but $base does not,) so dup() it for reading in close_file
|
|
|
|
open my $dup, '<&', $fh or croak $!;
|
|
|
|
my $base = IO::File->new_tmpfile;
|
|
|
|
$base->autoflush(1);
|
|
|
|
if ($fb->{blob}) {
|
|
|
|
defined (my $pid = fork) or croak $!;
|
|
|
|
if (!$pid) {
|
|
|
|
open STDOUT, '>&', $base or croak $!;
|
|
|
|
print STDOUT 'link ' if ($fb->{mode_a} == 120000);
|
|
|
|
exec qw/git-cat-file blob/, $fb->{blob} or croak $!;
|
|
|
|
}
|
|
|
|
waitpid $pid, 0;
|
|
|
|
croak $? if $?;
|
|
|
|
|
|
|
|
if (defined $exp) {
|
|
|
|
seek $base, 0, 0 or croak $!;
|
|
|
|
my $md5 = Digest::MD5->new;
|
|
|
|
$md5->addfile($base);
|
|
|
|
my $got = $md5->hexdigest;
|
|
|
|
die "Checksum mismatch: $fb->{path} $fb->{blob}\n",
|
|
|
|
"expected: $exp\n",
|
|
|
|
" got: $got\n" if ($got ne $exp);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
seek $base, 0, 0 or croak $!;
|
|
|
|
$fb->{fh} = $dup;
|
|
|
|
$fb->{base} = $base;
|
|
|
|
[ SVN::TxDelta::apply($base, $fh, undef, $fb->{path}, $fb->{pool}) ];
|
|
|
|
}
|
|
|
|
|
|
|
|
sub close_file {
|
|
|
|
my ($self, $fb, $exp) = @_;
|
|
|
|
my $hash;
|
2007-01-19 02:50:01 +01:00
|
|
|
my $path = $self->git_path($fb->{path});
|
2006-11-28 06:44:48 +01:00
|
|
|
if (my $fh = $fb->{fh}) {
|
2007-05-28 00:59:01 +02:00
|
|
|
if (defined $exp) {
|
|
|
|
seek($fh, 0, 0) or croak $!;
|
|
|
|
my $md5 = Digest::MD5->new;
|
|
|
|
$md5->addfile($fh);
|
|
|
|
my $got = $md5->hexdigest;
|
|
|
|
if ($got ne $exp) {
|
|
|
|
die "Checksum mismatch: $path\n",
|
|
|
|
"expected: $exp\n got: $got\n";
|
|
|
|
}
|
|
|
|
}
|
2007-04-29 23:05:54 +02:00
|
|
|
sysseek($fh, 0, 0) or croak $!;
|
2006-11-28 06:44:48 +01:00
|
|
|
if ($fb->{mode_b} == 120000) {
|
2007-04-29 23:05:54 +02:00
|
|
|
sysread($fh, my $buf, 5) == 5 or croak $!;
|
2006-11-28 06:44:48 +01:00
|
|
|
$buf eq 'link ' or die "$path has mode 120000",
|
|
|
|
"but is not a link\n";
|
|
|
|
}
|
|
|
|
defined(my $pid = open my $out,'-|') or die "Can't fork: $!\n";
|
|
|
|
if (!$pid) {
|
|
|
|
open STDIN, '<&', $fh or croak $!;
|
|
|
|
exec qw/git-hash-object -w --stdin/ or croak $!;
|
|
|
|
}
|
|
|
|
chomp($hash = do { local $/; <$out> });
|
|
|
|
close $out or croak $!;
|
|
|
|
close $fh or croak $!;
|
|
|
|
$hash =~ /^[a-f\d]{40}$/ or die "not a sha1: $hash\n";
|
|
|
|
close $fb->{base} or croak $!;
|
|
|
|
} else {
|
|
|
|
$hash = $fb->{blob} or die "no blob information\n";
|
|
|
|
}
|
|
|
|
$fb->{pool}->clear;
|
2007-01-24 12:30:57 +01:00
|
|
|
$self->{gii}->update($fb->{mode_b}, $hash, $path) or croak $!;
|
2007-02-09 21:23:47 +01:00
|
|
|
print "\t$fb->{action}\t$path\n" if $fb->{action} && ! $::_q;
|
2006-11-28 06:44:48 +01:00
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub abort_edit {
|
|
|
|
my $self = shift;
|
2007-01-24 12:30:57 +01:00
|
|
|
$self->{nr} = $self->{gii}->{nr};
|
|
|
|
delete $self->{gii};
|
2006-11-28 06:44:48 +01:00
|
|
|
$self->SUPER::abort_edit(@_);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub close_edit {
|
|
|
|
my $self = shift;
|
2006-11-28 23:06:05 +01:00
|
|
|
$self->{git_commit_ok} = 1;
|
2007-01-24 12:30:57 +01:00
|
|
|
$self->{nr} = $self->{gii}->{nr};
|
|
|
|
delete $self->{gii};
|
2006-11-28 06:44:48 +01:00
|
|
|
$self->SUPER::close_edit(@_);
|
|
|
|
}
|
2006-06-16 11:55:13 +02:00
|
|
|
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
package SVN::Git::Editor;
|
2007-01-29 09:07:49 +01:00
|
|
|
use vars qw/@ISA $_rmdir $_cp_similarity $_find_copies_harder $_rename_limit/;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
use Carp qw/croak/;
|
|
|
|
use IO::File;
|
2007-01-30 01:27:08 +01:00
|
|
|
use Digest::MD5;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
|
|
|
|
sub new {
|
2007-01-27 23:33:08 +01:00
|
|
|
my ($class, $opts) = @_;
|
|
|
|
foreach (qw/svn_path r ra tree_a tree_b log editor_cb/) {
|
|
|
|
die "$_ required!\n" unless (defined $opts->{$_});
|
|
|
|
}
|
|
|
|
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my $mods = generate_diff($opts->{tree_a}, $opts->{tree_b});
|
|
|
|
my $types = check_diff_paths($opts->{ra}, $opts->{svn_path},
|
|
|
|
$opts->{r}, $mods);
|
|
|
|
|
|
|
|
# $opts->{ra} functions should not be used after this:
|
|
|
|
my @ce = $opts->{ra}->get_commit_editor($opts->{log},
|
|
|
|
$opts->{editor_cb}, $pool);
|
|
|
|
my $self = SVN::Delta::Editor->new(@ce, $pool);
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
bless $self, $class;
|
2007-01-27 23:33:08 +01:00
|
|
|
foreach (qw/svn_path r tree_a tree_b/) {
|
|
|
|
$self->{$_} = $opts->{$_};
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
2007-01-27 23:33:08 +01:00
|
|
|
$self->{url} = $opts->{ra}->{url};
|
|
|
|
$self->{mods} = $mods;
|
|
|
|
$self->{types} = $types;
|
|
|
|
$self->{pool} = $pool;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->{bat} = { '' => $self->open_root($self->{r}, $self->{pool}) };
|
|
|
|
$self->{rm} = { };
|
2007-01-26 10:32:45 +01:00
|
|
|
$self->{path_prefix} = length $self->{svn_path} ?
|
|
|
|
"$self->{svn_path}/" : '';
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
return $self;
|
|
|
|
}
|
|
|
|
|
2007-01-27 23:33:08 +01:00
|
|
|
sub generate_diff {
|
|
|
|
my ($tree_a, $tree_b) = @_;
|
|
|
|
my @diff_tree = qw(diff-tree -z -r);
|
2007-01-29 09:07:49 +01:00
|
|
|
if ($_cp_similarity) {
|
|
|
|
push @diff_tree, "-C$_cp_similarity";
|
2007-01-27 23:33:08 +01:00
|
|
|
} else {
|
|
|
|
push @diff_tree, '-C';
|
|
|
|
}
|
2007-01-29 09:07:49 +01:00
|
|
|
push @diff_tree, '--find-copies-harder' if $_find_copies_harder;
|
|
|
|
push @diff_tree, "-l$_rename_limit" if defined $_rename_limit;
|
2007-01-27 23:33:08 +01:00
|
|
|
push @diff_tree, $tree_a, $tree_b;
|
|
|
|
my ($diff_fh, $ctx) = command_output_pipe(@diff_tree);
|
|
|
|
local $/ = "\0";
|
|
|
|
my $state = 'meta';
|
|
|
|
my @mods;
|
|
|
|
while (<$diff_fh>) {
|
|
|
|
chomp $_; # this gets rid of the trailing "\0"
|
|
|
|
if ($state eq 'meta' && /^:(\d{6})\s(\d{6})\s
|
|
|
|
$::sha1\s($::sha1)\s
|
|
|
|
([MTCRAD])\d*$/xo) {
|
|
|
|
push @mods, { mode_a => $1, mode_b => $2,
|
|
|
|
sha1_b => $3, chg => $4 };
|
|
|
|
if ($4 =~ /^(?:C|R)$/) {
|
|
|
|
$state = 'file_a';
|
|
|
|
} else {
|
|
|
|
$state = 'file_b';
|
|
|
|
}
|
|
|
|
} elsif ($state eq 'file_a') {
|
|
|
|
my $x = $mods[$#mods] or croak "Empty array\n";
|
|
|
|
if ($x->{chg} !~ /^(?:C|R)$/) {
|
|
|
|
croak "Error parsing $_, $x->{chg}\n";
|
|
|
|
}
|
|
|
|
$x->{file_a} = $_;
|
|
|
|
$state = 'file_b';
|
|
|
|
} elsif ($state eq 'file_b') {
|
|
|
|
my $x = $mods[$#mods] or croak "Empty array\n";
|
|
|
|
if (exists $x->{file_a} && $x->{chg} !~ /^(?:C|R)$/) {
|
|
|
|
croak "Error parsing $_, $x->{chg}\n";
|
|
|
|
}
|
|
|
|
if (!exists $x->{file_a} && $x->{chg} =~ /^(?:C|R)$/) {
|
|
|
|
croak "Error parsing $_, $x->{chg}\n";
|
|
|
|
}
|
|
|
|
$x->{file_b} = $_;
|
|
|
|
$state = 'meta';
|
|
|
|
} else {
|
|
|
|
croak "Error parsing $_\n";
|
|
|
|
}
|
|
|
|
}
|
|
|
|
command_close_pipe($diff_fh, $ctx);
|
|
|
|
\@mods;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub check_diff_paths {
|
|
|
|
my ($ra, $pfx, $rev, $mods) = @_;
|
|
|
|
my %types;
|
|
|
|
$pfx .= '/' if length $pfx;
|
|
|
|
|
|
|
|
sub type_diff_paths {
|
|
|
|
my ($ra, $types, $path, $rev) = @_;
|
|
|
|
my @p = split m#/+#, $path;
|
|
|
|
my $c = shift @p;
|
|
|
|
unless (defined $types->{$c}) {
|
|
|
|
$types->{$c} = $ra->check_path($c, $rev);
|
|
|
|
}
|
|
|
|
while (@p) {
|
|
|
|
$c .= '/' . shift @p;
|
|
|
|
next if defined $types->{$c};
|
|
|
|
$types->{$c} = $ra->check_path($c, $rev);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
foreach my $m (@$mods) {
|
|
|
|
foreach my $f (qw/file_a file_b/) {
|
|
|
|
next unless defined $m->{$f};
|
|
|
|
my ($dir) = ($m->{$f} =~ m#^(.*?)/?(?:[^/]+)$#);
|
|
|
|
if (length $pfx.$dir && ! defined $types{$dir}) {
|
|
|
|
type_diff_paths($ra, \%types, $pfx.$dir, $rev);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
\%types;
|
|
|
|
}
|
|
|
|
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
sub split_path {
|
|
|
|
return ($_[0] =~ m#^(.*?)/?([^/]+)$#);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub repo_path {
|
2007-01-26 10:32:45 +01:00
|
|
|
my ($self, $path) = @_;
|
|
|
|
$self->{path_prefix}.(defined $path ? $path : '');
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
|
|
|
|
|
|
|
sub url_path {
|
|
|
|
my ($self, $path) = @_;
|
2007-07-16 06:53:50 +02:00
|
|
|
if ($self->{url} =~ m#^https?://#) {
|
|
|
|
$path =~ s/([^a-zA-Z0-9_.-])/uc sprintf("%%%02x",ord($1))/eg;
|
|
|
|
}
|
2007-01-27 10:32:00 +01:00
|
|
|
$self->{url} . '/' . $self->repo_path($path);
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
|
|
|
|
|
|
|
sub rmdirs {
|
2007-01-27 23:33:08 +01:00
|
|
|
my ($self) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my $rm = $self->{rm};
|
|
|
|
delete $rm->{''}; # we never delete the url we're tracking
|
|
|
|
return unless %$rm;
|
|
|
|
|
|
|
|
foreach (keys %$rm) {
|
|
|
|
my @d = split m#/#, $_;
|
|
|
|
my $c = shift @d;
|
|
|
|
$rm->{$c} = 1;
|
|
|
|
while (@d) {
|
|
|
|
$c .= '/' . shift @d;
|
|
|
|
$rm->{$c} = 1;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
delete $rm->{$self->{svn_path}};
|
|
|
|
delete $rm->{''}; # we never delete the url we're tracking
|
|
|
|
return unless %$rm;
|
|
|
|
|
2007-01-27 23:33:08 +01:00
|
|
|
my ($fh, $ctx) = command_output_pipe(qw/ls-tree --name-only -r -z/,
|
|
|
|
$self->{tree_b});
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
local $/ = "\0";
|
|
|
|
while (<$fh>) {
|
|
|
|
chomp;
|
2006-11-25 07:38:17 +01:00
|
|
|
my @dn = split m#/#, $_;
|
2006-06-20 02:59:35 +02:00
|
|
|
while (pop @dn) {
|
|
|
|
delete $rm->{join '/', @dn};
|
|
|
|
}
|
|
|
|
unless (%$rm) {
|
2007-02-01 22:12:26 +01:00
|
|
|
close $fh;
|
2006-06-20 02:59:35 +02:00
|
|
|
return;
|
|
|
|
}
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
}
|
2006-12-15 19:59:54 +01:00
|
|
|
command_close_pipe($fh, $ctx);
|
2006-06-20 02:59:35 +02:00
|
|
|
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($r, $p, $bat) = ($self->{r}, $self->{pool}, $self->{bat});
|
|
|
|
foreach my $d (sort { $b =~ tr#/#/# <=> $a =~ tr#/#/# } keys %$rm) {
|
|
|
|
$self->close_directory($bat->{$d}, $p);
|
|
|
|
my ($dn) = ($d =~ m#^(.*?)/?(?:[^/]+)$#);
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\tD+\t$d/\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->SUPER::delete_entry($d, $r, $bat->{$dn}, $p);
|
|
|
|
delete $bat->{$d};
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
sub open_or_add_dir {
|
|
|
|
my ($self, $full_path, $baton) = @_;
|
2007-01-27 10:32:00 +01:00
|
|
|
my $t = $self->{types}->{$full_path};
|
|
|
|
if (!defined $t) {
|
|
|
|
die "$full_path not known in r$self->{r} or we have a bug!\n";
|
|
|
|
}
|
2007-10-15 09:19:12 +02:00
|
|
|
{
|
|
|
|
no warnings 'once';
|
|
|
|
# SVN::Node::none and SVN::Node::file are used only once,
|
|
|
|
# so we're shutting up Perl's warnings about them.
|
|
|
|
if ($t == $SVN::Node::none) {
|
|
|
|
return $self->add_directory($full_path, $baton,
|
|
|
|
undef, -1, $self->{pool});
|
|
|
|
} elsif ($t == $SVN::Node::dir) {
|
|
|
|
return $self->open_directory($full_path, $baton,
|
|
|
|
$self->{r}, $self->{pool});
|
|
|
|
} # no warnings 'once'
|
|
|
|
print STDERR "$full_path already exists in repository at ",
|
|
|
|
"r$self->{r} and it is not a directory (",
|
|
|
|
($t == $SVN::Node::file ? 'file' : 'unknown'),"/$t)\n";
|
|
|
|
} # no warnings 'once'
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
exit 1;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub ensure_path {
|
|
|
|
my ($self, $path) = @_;
|
|
|
|
my $bat = $self->{bat};
|
2007-01-27 10:32:00 +01:00
|
|
|
my $repo_path = $self->repo_path($path);
|
|
|
|
return $bat->{''} unless (length $repo_path);
|
|
|
|
my @p = split m#/+#, $repo_path;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my $c = shift @p;
|
|
|
|
$bat->{$c} ||= $self->open_or_add_dir($c, $bat->{''});
|
|
|
|
while (@p) {
|
|
|
|
my $c0 = $c;
|
|
|
|
$c .= '/' . shift @p;
|
|
|
|
$bat->{$c} ||= $self->open_or_add_dir($c, $bat->{$c0});
|
|
|
|
}
|
|
|
|
return $bat->{$c};
|
|
|
|
}
|
|
|
|
|
|
|
|
sub A {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $m) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($dir, $file) = split_path($m->{file_b});
|
|
|
|
my $pbat = $self->ensure_path($dir);
|
|
|
|
my $fbat = $self->add_file($self->repo_path($m->{file_b}), $pbat,
|
|
|
|
undef, -1);
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\tA\t$m->{file_b}\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->chg_file($fbat, $m);
|
|
|
|
$self->close_file($fbat,undef,$self->{pool});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub C {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $m) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($dir, $file) = split_path($m->{file_b});
|
|
|
|
my $pbat = $self->ensure_path($dir);
|
|
|
|
my $fbat = $self->add_file($self->repo_path($m->{file_b}), $pbat,
|
|
|
|
$self->url_path($m->{file_a}), $self->{r});
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\tC\t$m->{file_a} => $m->{file_b}\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->chg_file($fbat, $m);
|
|
|
|
$self->close_file($fbat,undef,$self->{pool});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub delete_entry {
|
|
|
|
my ($self, $path, $pbat) = @_;
|
|
|
|
my $rpath = $self->repo_path($path);
|
|
|
|
my ($dir, $file) = split_path($rpath);
|
|
|
|
$self->{rm}->{$dir} = 1;
|
|
|
|
$self->SUPER::delete_entry($rpath, $self->{r}, $pbat, $self->{pool});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub R {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $m) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($dir, $file) = split_path($m->{file_b});
|
|
|
|
my $pbat = $self->ensure_path($dir);
|
|
|
|
my $fbat = $self->add_file($self->repo_path($m->{file_b}), $pbat,
|
|
|
|
$self->url_path($m->{file_a}), $self->{r});
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\tR\t$m->{file_a} => $m->{file_b}\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->chg_file($fbat, $m);
|
|
|
|
$self->close_file($fbat,undef,$self->{pool});
|
|
|
|
|
|
|
|
($dir, $file) = split_path($m->{file_a});
|
|
|
|
$pbat = $self->ensure_path($dir);
|
|
|
|
$self->delete_entry($m->{file_a}, $pbat);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub M {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $m) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($dir, $file) = split_path($m->{file_b});
|
|
|
|
my $pbat = $self->ensure_path($dir);
|
|
|
|
my $fbat = $self->open_file($self->repo_path($m->{file_b}),
|
|
|
|
$pbat,$self->{r},$self->{pool});
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\t$m->{chg}\t$m->{file_b}\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->chg_file($fbat, $m);
|
|
|
|
$self->close_file($fbat,undef,$self->{pool});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub T { shift->M(@_) }
|
|
|
|
|
|
|
|
sub change_file_prop {
|
|
|
|
my ($self, $fbat, $pname, $pval) = @_;
|
|
|
|
$self->SUPER::change_file_prop($fbat, $pname, $pval, $self->{pool});
|
|
|
|
}
|
|
|
|
|
|
|
|
sub chg_file {
|
|
|
|
my ($self, $fbat, $m) = @_;
|
|
|
|
if ($m->{mode_b} =~ /755$/ && $m->{mode_a} !~ /755$/) {
|
|
|
|
$self->change_file_prop($fbat,'svn:executable','*');
|
|
|
|
} elsif ($m->{mode_b} !~ /755$/ && $m->{mode_a} =~ /755$/) {
|
|
|
|
$self->change_file_prop($fbat,'svn:executable',undef);
|
|
|
|
}
|
|
|
|
my $fh = IO::File->new_tmpfile or croak $!;
|
|
|
|
if ($m->{mode_b} =~ /^120/) {
|
|
|
|
print $fh 'link ' or croak $!;
|
|
|
|
$self->change_file_prop($fbat,'svn:special','*');
|
|
|
|
} elsif ($m->{mode_a} =~ /^120/ && $m->{mode_b} !~ /^120/) {
|
|
|
|
$self->change_file_prop($fbat,'svn:special',undef);
|
|
|
|
}
|
|
|
|
defined(my $pid = fork) or croak $!;
|
|
|
|
if (!$pid) {
|
|
|
|
open STDOUT, '>&', $fh or croak $!;
|
|
|
|
exec qw/git-cat-file blob/, $m->{sha1_b} or croak $!;
|
|
|
|
}
|
|
|
|
waitpid $pid, 0;
|
|
|
|
croak $? if $?;
|
|
|
|
$fh->flush == 0 or croak $!;
|
|
|
|
seek $fh, 0, 0 or croak $!;
|
|
|
|
|
|
|
|
my $md5 = Digest::MD5->new;
|
|
|
|
$md5->addfile($fh) or croak $!;
|
|
|
|
seek $fh, 0, 0 or croak $!;
|
|
|
|
|
|
|
|
my $exp = $md5->hexdigest;
|
2006-10-15 00:48:35 +02:00
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my $atd = $self->apply_textdelta($fbat, undef, $pool);
|
|
|
|
my $got = SVN::TxDelta::send_stream($fh, @$atd, $pool);
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
die "Checksum mismatch\nexpected: $exp\ngot: $got\n" if ($got ne $exp);
|
2006-10-15 00:48:35 +02:00
|
|
|
$pool->clear;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
|
|
|
|
close $fh or croak $!;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub D {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $m) = @_;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
my ($dir, $file) = split_path($m->{file_b});
|
|
|
|
my $pbat = $self->ensure_path($dir);
|
2007-01-14 07:35:53 +01:00
|
|
|
print "\tD\t$m->{file_b}\n" unless $::_q;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->delete_entry($m->{file_b}, $pbat);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub close_edit {
|
|
|
|
my ($self) = @_;
|
|
|
|
my ($p,$bat) = ($self->{pool}, $self->{bat});
|
|
|
|
foreach (sort { $b =~ tr#/#/# <=> $a =~ tr#/#/# } keys %$bat) {
|
2007-05-19 11:58:37 +02:00
|
|
|
next if $_ eq '';
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->close_directory($bat->{$_}, $p);
|
|
|
|
}
|
2007-05-19 11:58:37 +02:00
|
|
|
$self->close_directory($bat->{''}, $p);
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->SUPER::close_edit($p);
|
|
|
|
$p->clear;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub abort_edit {
|
|
|
|
my ($self) = @_;
|
|
|
|
$self->SUPER::abort_edit($self->{pool});
|
2007-01-27 23:33:08 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub DESTROY {
|
|
|
|
my $self = shift;
|
|
|
|
$self->SUPER::DESTROY(@_);
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
$self->{pool}->clear;
|
|
|
|
}
|
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
# this drives the editor
|
|
|
|
sub apply_diff {
|
2007-01-27 23:33:08 +01:00
|
|
|
my ($self) = @_;
|
|
|
|
my $mods = $self->{mods};
|
2007-01-14 07:35:53 +01:00
|
|
|
my %o = ( D => 1, R => 0, C => -1, A => 3, M => 3, T => 3 );
|
2007-01-27 10:32:00 +01:00
|
|
|
foreach my $m (sort { $o{$a->{chg}} <=> $o{$b->{chg}} } @$mods) {
|
2007-01-14 07:35:53 +01:00
|
|
|
my $f = $m->{chg};
|
|
|
|
if (defined $o{$f}) {
|
|
|
|
$self->$f($m);
|
|
|
|
} else {
|
2007-10-16 16:36:52 +02:00
|
|
|
fatal("Invalid change type: $f");
|
2007-01-14 07:35:53 +01:00
|
|
|
}
|
|
|
|
}
|
2007-01-29 09:07:49 +01:00
|
|
|
$self->rmdirs if $_rmdir;
|
2007-01-27 10:32:00 +01:00
|
|
|
if (@$mods == 0) {
|
2007-01-14 07:35:53 +01:00
|
|
|
$self->abort_edit;
|
|
|
|
} else {
|
|
|
|
$self->close_edit;
|
|
|
|
}
|
2007-01-27 10:32:00 +01:00
|
|
|
return scalar @$mods;
|
2007-01-14 07:35:53 +01:00
|
|
|
}
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
package Git::SVN::Ra;
|
2007-02-15 01:04:10 +01:00
|
|
|
use vars qw/@ISA $config_dir $_log_window_size/;
|
2007-01-10 10:22:38 +01:00
|
|
|
use strict;
|
|
|
|
use warnings;
|
2007-09-07 13:00:40 +02:00
|
|
|
my ($ra_invalid, $can_do_switch, %ignored_err, $RA);
|
2007-01-10 10:22:38 +01:00
|
|
|
|
|
|
|
BEGIN {
|
|
|
|
# enforce temporary pool usage for some simple functions
|
2007-06-15 05:43:59 +02:00
|
|
|
no strict 'refs';
|
|
|
|
for my $f (qw/rev_proplist get_latest_revnum get_uuid get_repos_root/) {
|
|
|
|
my $SUPER = "SUPER::$f";
|
|
|
|
*$f = sub {
|
|
|
|
my $self = shift;
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my @ret = $self->$SUPER(@_,$pool);
|
|
|
|
$pool->clear;
|
|
|
|
wantarray ? @ret : $ret[0];
|
|
|
|
};
|
2007-01-10 10:22:38 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-09-28 19:24:19 +02:00
|
|
|
sub _auth_providers () {
|
|
|
|
[
|
|
|
|
SVN::Client::get_simple_provider(),
|
|
|
|
SVN::Client::get_ssl_server_trust_file_provider(),
|
|
|
|
SVN::Client::get_simple_prompt_provider(
|
|
|
|
\&Git::SVN::Prompt::simple, 2),
|
|
|
|
SVN::Client::get_ssl_client_cert_file_provider(),
|
|
|
|
SVN::Client::get_ssl_client_cert_prompt_provider(
|
|
|
|
\&Git::SVN::Prompt::ssl_client_cert, 2),
|
|
|
|
SVN::Client::get_ssl_client_cert_pw_prompt_provider(
|
|
|
|
\&Git::SVN::Prompt::ssl_client_cert_pw, 2),
|
|
|
|
SVN::Client::get_username_provider(),
|
|
|
|
SVN::Client::get_ssl_server_trust_prompt_provider(
|
|
|
|
\&Git::SVN::Prompt::ssl_server_trust),
|
|
|
|
SVN::Client::get_username_prompt_provider(
|
|
|
|
\&Git::SVN::Prompt::username, 2)
|
|
|
|
]
|
|
|
|
}
|
|
|
|
|
2007-11-12 08:37:42 +01:00
|
|
|
sub escape_uri_only {
|
|
|
|
my ($uri) = @_;
|
|
|
|
my @tmp;
|
|
|
|
foreach (split m{/}, $uri) {
|
|
|
|
s/([^\w.-])/sprintf("%%%02X",ord($1))/eg;
|
|
|
|
push @tmp, $_;
|
|
|
|
}
|
|
|
|
join('/', @tmp);
|
|
|
|
}
|
|
|
|
|
|
|
|
sub escape_url {
|
|
|
|
my ($url) = @_;
|
|
|
|
if ($url =~ m#^(https?)://([^/]+)(.*)$#) {
|
|
|
|
my ($scheme, $domain, $uri) = ($1, $2, escape_uri_only($3));
|
|
|
|
$url = "$scheme://$domain$uri";
|
|
|
|
}
|
|
|
|
$url;
|
|
|
|
}
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
sub new {
|
|
|
|
my ($class, $url) = @_;
|
2007-01-19 03:22:18 +01:00
|
|
|
$url =~ s!/+$!!;
|
2007-01-30 04:16:01 +01:00
|
|
|
return $RA if ($RA && $RA->{url} eq $url);
|
2007-01-19 03:22:18 +01:00
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
SVN::_Core::svn_config_ensure($config_dir, undef);
|
2007-09-28 19:24:19 +02:00
|
|
|
my ($baton, $callbacks) = SVN::Core::auth_open_helper(_auth_providers);
|
2007-01-10 10:22:38 +01:00
|
|
|
my $config = SVN::Core::config_get_config($config_dir);
|
2007-07-04 23:07:42 +02:00
|
|
|
$RA = undef;
|
2007-10-06 20:57:19 +02:00
|
|
|
my $dont_store_passwords = 1;
|
|
|
|
my $conf_t = ${$config}{'config'};
|
|
|
|
{
|
2007-10-15 09:19:12 +02:00
|
|
|
no warnings 'once';
|
2007-10-06 20:57:19 +02:00
|
|
|
# The usage of $SVN::_Core::SVN_CONFIG_* variables
|
|
|
|
# produces warnings that variables are used only once.
|
|
|
|
# I had not found the better way to shut them up, so
|
2007-10-15 09:19:12 +02:00
|
|
|
# the warnings of type 'once' are disabled in this block.
|
2007-10-06 20:57:19 +02:00
|
|
|
if (SVN::_Core::svn_config_get_bool($conf_t,
|
|
|
|
$SVN::_Core::SVN_CONFIG_SECTION_AUTH,
|
|
|
|
$SVN::_Core::SVN_CONFIG_OPTION_STORE_PASSWORDS,
|
|
|
|
1) == 0) {
|
|
|
|
SVN::_Core::svn_auth_set_parameter($baton,
|
|
|
|
$SVN::_Core::SVN_AUTH_PARAM_DONT_STORE_PASSWORDS,
|
|
|
|
bless (\$dont_store_passwords, "_p_void"));
|
|
|
|
}
|
|
|
|
if (SVN::_Core::svn_config_get_bool($conf_t,
|
|
|
|
$SVN::_Core::SVN_CONFIG_SECTION_AUTH,
|
|
|
|
$SVN::_Core::SVN_CONFIG_OPTION_STORE_AUTH_CREDS,
|
|
|
|
1) == 0) {
|
|
|
|
$Git::SVN::Prompt::_no_auth_cache = 1;
|
|
|
|
}
|
2007-10-15 09:19:12 +02:00
|
|
|
} # no warnings 'once'
|
2007-11-12 08:37:42 +01:00
|
|
|
my $self = SVN::Ra->new(url => escape_url($url), auth => $baton,
|
2007-01-10 10:22:38 +01:00
|
|
|
config => $config,
|
|
|
|
pool => SVN::Pool->new,
|
|
|
|
auth_provider_callbacks => $callbacks);
|
2007-11-12 08:37:42 +01:00
|
|
|
$self->{url} = $url;
|
2007-01-10 10:22:38 +01:00
|
|
|
$self->{svn_path} = $url;
|
|
|
|
$self->{repos_root} = $self->get_repos_root;
|
2007-02-09 21:17:57 +01:00
|
|
|
$self->{svn_path} =~ s#^\Q$self->{repos_root}\E(/|$)##;
|
2007-05-13 10:04:43 +02:00
|
|
|
$self->{cache} = { check_path => { r => 0, data => {} },
|
|
|
|
get_dir => { r => 0, data => {} } };
|
2007-01-30 04:16:01 +01:00
|
|
|
$RA = bless $self, $class;
|
2007-01-10 10:22:38 +01:00
|
|
|
}
|
|
|
|
|
2007-05-13 10:04:43 +02:00
|
|
|
sub check_path {
|
|
|
|
my ($self, $path, $r) = @_;
|
|
|
|
my $cache = $self->{cache}->{check_path};
|
|
|
|
if ($r == $cache->{r} && exists $cache->{data}->{$path}) {
|
|
|
|
return $cache->{data}->{$path};
|
|
|
|
}
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my $t = $self->SUPER::check_path($path, $r, $pool);
|
|
|
|
$pool->clear;
|
|
|
|
if ($r != $cache->{r}) {
|
|
|
|
%{$cache->{data}} = ();
|
|
|
|
$cache->{r} = $r;
|
|
|
|
}
|
|
|
|
$cache->{data}->{$path} = $t;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub get_dir {
|
|
|
|
my ($self, $dir, $r) = @_;
|
|
|
|
my $cache = $self->{cache}->{get_dir};
|
|
|
|
if ($r == $cache->{r}) {
|
|
|
|
if (my $x = $cache->{data}->{$dir}) {
|
|
|
|
return wantarray ? @$x : $x->[0];
|
|
|
|
}
|
|
|
|
}
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my ($d, undef, $props) = $self->SUPER::get_dir($dir, $r, $pool);
|
|
|
|
my %dirents = map { $_ => { kind => $d->{$_}->kind } } keys %$d;
|
|
|
|
$pool->clear;
|
|
|
|
if ($r != $cache->{r}) {
|
|
|
|
%{$cache->{data}} = ();
|
|
|
|
$cache->{r} = $r;
|
|
|
|
}
|
|
|
|
$cache->{data}->{$dir} = [ \%dirents, $r, $props ];
|
|
|
|
wantarray ? (\%dirents, $r, $props) : \%dirents;
|
|
|
|
}
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
sub DESTROY {
|
2007-01-30 04:16:01 +01:00
|
|
|
# do not call the real DESTROY since we store ourselves in $RA
|
2007-01-10 10:22:38 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub get_log {
|
|
|
|
my ($self, @args) = @_;
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
splice(@args, 3, 1) if ($SVN::Core::VERSION le '1.2.0');
|
|
|
|
my $ret = $self->SUPER::get_log(@args, $pool);
|
|
|
|
$pool->clear;
|
|
|
|
$ret;
|
|
|
|
}
|
|
|
|
|
2007-09-28 19:24:19 +02:00
|
|
|
sub trees_match {
|
|
|
|
my ($self, $url1, $rev1, $url2, $rev2) = @_;
|
|
|
|
my $ctx = SVN::Client->new(auth => _auth_providers);
|
|
|
|
my $out = IO::File->new_tmpfile;
|
|
|
|
|
|
|
|
# older SVN (1.1.x) doesn't take $pool as the last parameter for
|
|
|
|
# $ctx->diff(), so we'll create a default one
|
|
|
|
my $pool = SVN::Pool->new_default_sub;
|
|
|
|
|
|
|
|
$ra_invalid = 1; # this will open a new SVN::Ra connection to $url1
|
|
|
|
$ctx->diff([], $url1, $rev1, $url2, $rev2, 1, 1, 0, $out, $out);
|
|
|
|
$out->flush;
|
|
|
|
my $ret = (($out->stat)[7] == 0);
|
|
|
|
close $out or croak $!;
|
|
|
|
|
|
|
|
$ret;
|
|
|
|
}
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
sub get_commit_editor {
|
2007-01-14 07:35:53 +01:00
|
|
|
my ($self, $log, $cb, $pool) = @_;
|
2007-01-10 10:22:38 +01:00
|
|
|
my @lock = $SVN::Core::VERSION ge '1.2.0' ? (undef, 0) : ();
|
2007-01-14 07:35:53 +01:00
|
|
|
$self->SUPER::get_commit_editor($log, $cb, @lock, $pool);
|
2007-01-10 10:22:38 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
sub gs_do_update {
|
2007-01-31 11:45:50 +01:00
|
|
|
my ($self, $rev_a, $rev_b, $gs, $editor) = @_;
|
|
|
|
my $new = ($rev_a == $rev_b);
|
|
|
|
my $path = $gs->{path};
|
|
|
|
|
2007-02-23 11:21:59 +01:00
|
|
|
if ($new && -e $gs->{index}) {
|
|
|
|
unlink $gs->{index} or die
|
|
|
|
"Couldn't unlink index: $gs->{index}: $!\n";
|
|
|
|
}
|
2007-01-10 10:22:38 +01:00
|
|
|
my $pool = SVN::Pool->new;
|
2007-01-22 20:44:57 +01:00
|
|
|
$editor->set_path_strip($path);
|
2007-01-28 13:59:05 +01:00
|
|
|
my (@pc) = split m#/#, $path;
|
|
|
|
my $reporter = $self->do_update($rev_b, (@pc ? shift @pc : ''),
|
2007-01-31 11:45:50 +01:00
|
|
|
1, $editor, $pool);
|
2007-01-10 10:22:38 +01:00
|
|
|
my @lock = $SVN::Core::VERSION ge '1.2.0' ? (undef) : ();
|
2007-01-28 13:59:05 +01:00
|
|
|
|
|
|
|
# Since we can't rely on svn_ra_reparent being available, we'll
|
|
|
|
# just have to do some magic with set_path to make it so
|
|
|
|
# we only want a partial path.
|
|
|
|
my $sp = '';
|
|
|
|
my $final = join('/', @pc);
|
|
|
|
while (@pc) {
|
|
|
|
$reporter->set_path($sp, $rev_b, 0, @lock, $pool);
|
|
|
|
$sp .= '/' if length $sp;
|
|
|
|
$sp .= shift @pc;
|
|
|
|
}
|
|
|
|
die "BUG: '$sp' != '$final'\n" if ($sp ne $final);
|
|
|
|
|
|
|
|
$reporter->set_path($sp, $rev_a, $new, @lock, $pool);
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
$reporter->finish_report($pool);
|
|
|
|
$pool->clear;
|
|
|
|
$editor->{git_commit_ok};
|
|
|
|
}
|
|
|
|
|
2007-01-28 13:59:05 +01:00
|
|
|
# this requires SVN 1.4.3 or later (do_switch didn't work before 1.4.3, and
|
|
|
|
# svn_ra_reparent didn't work before 1.4)
|
2007-01-10 10:22:38 +01:00
|
|
|
sub gs_do_switch {
|
2007-01-31 11:45:50 +01:00
|
|
|
my ($self, $rev_a, $rev_b, $gs, $url_b, $editor) = @_;
|
|
|
|
my $path = $gs->{path};
|
2007-01-10 10:22:38 +01:00
|
|
|
my $pool = SVN::Pool->new;
|
2007-01-28 13:59:05 +01:00
|
|
|
|
|
|
|
my $full_url = $self->{url};
|
|
|
|
my $old_url = $full_url;
|
2007-11-12 08:37:42 +01:00
|
|
|
$full_url .= '/' . escape_uri_only($path) if length $path;
|
2007-01-30 04:16:01 +01:00
|
|
|
my ($ra, $reparented);
|
|
|
|
if ($old_url ne $full_url) {
|
|
|
|
if ($old_url !~ m#^svn(\+ssh)?://#) {
|
|
|
|
SVN::_Ra::svn_ra_reparent($self->{session}, $full_url,
|
|
|
|
$pool);
|
|
|
|
$self->{url} = $full_url;
|
|
|
|
$reparented = 1;
|
|
|
|
} else {
|
2007-09-07 13:00:40 +02:00
|
|
|
$_[0] = undef;
|
|
|
|
$self = undef;
|
|
|
|
$RA = undef;
|
2007-01-30 04:16:01 +01:00
|
|
|
$ra = Git::SVN::Ra->new($full_url);
|
2007-09-07 13:00:40 +02:00
|
|
|
$ra_invalid = 1;
|
2007-01-30 04:16:01 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
$ra ||= $self;
|
2007-01-31 11:45:50 +01:00
|
|
|
my $reporter = $ra->do_switch($rev_b, '', 1, $url_b, $editor, $pool);
|
2007-01-10 10:22:38 +01:00
|
|
|
my @lock = $SVN::Core::VERSION ge '1.2.0' ? (undef) : ();
|
2007-01-22 20:44:57 +01:00
|
|
|
$reporter->set_path('', $rev_a, 0, @lock, $pool);
|
2007-01-10 10:22:38 +01:00
|
|
|
$reporter->finish_report($pool);
|
2007-01-28 13:59:05 +01:00
|
|
|
|
2007-01-30 04:16:01 +01:00
|
|
|
if ($reparented) {
|
|
|
|
SVN::_Ra::svn_ra_reparent($self->{session}, $old_url, $pool);
|
|
|
|
$self->{url} = $old_url;
|
|
|
|
}
|
2007-01-28 13:59:05 +01:00
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
$pool->clear;
|
|
|
|
$editor->{git_commit_ok};
|
|
|
|
}
|
|
|
|
|
2007-06-13 11:37:03 +02:00
|
|
|
sub longest_common_path {
|
|
|
|
my ($gsv, $globs) = @_;
|
2007-02-07 20:50:16 +01:00
|
|
|
my %common;
|
2007-02-08 21:53:57 +01:00
|
|
|
my $common_max = scalar @$gsv;
|
|
|
|
|
|
|
|
foreach my $gs (@$gsv) {
|
2007-02-07 20:50:16 +01:00
|
|
|
my @tmp = split m#/#, $gs->{path};
|
|
|
|
my $p = '';
|
|
|
|
foreach (@tmp) {
|
|
|
|
$p .= length($p) ? "/$_" : $_;
|
|
|
|
$common{$p} ||= 0;
|
|
|
|
$common{$p}++;
|
|
|
|
}
|
|
|
|
}
|
2007-02-08 21:53:57 +01:00
|
|
|
$globs ||= [];
|
|
|
|
$common_max += scalar @$globs;
|
|
|
|
foreach my $glob (@$globs) {
|
|
|
|
my @tmp = split m#/#, $glob->{path}->{left};
|
|
|
|
my $p = '';
|
|
|
|
foreach (@tmp) {
|
|
|
|
$p .= length($p) ? "/$_" : $_;
|
|
|
|
$common{$p} ||= 0;
|
|
|
|
$common{$p}++;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-02-07 20:50:16 +01:00
|
|
|
my $longest_path = '';
|
|
|
|
foreach (sort {length $b <=> length $a} keys %common) {
|
2007-02-08 21:53:57 +01:00
|
|
|
if ($common{$_} == $common_max) {
|
2007-02-07 20:50:16 +01:00
|
|
|
$longest_path = $_;
|
|
|
|
last;
|
|
|
|
}
|
2007-01-28 07:28:56 +01:00
|
|
|
}
|
2007-06-13 11:37:03 +02:00
|
|
|
$longest_path;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub gs_fetch_loop_common {
|
|
|
|
my ($self, $base, $head, $gsv, $globs) = @_;
|
|
|
|
return if ($base > $head);
|
|
|
|
my $inc = $_log_window_size;
|
|
|
|
my ($min, $max) = ($base, $head < $base + $inc ? $head : $base + $inc);
|
|
|
|
my $longest_path = longest_common_path($gsv, $globs);
|
2007-09-07 13:00:40 +02:00
|
|
|
my $ra_url = $self->{url};
|
2007-01-28 07:28:56 +01:00
|
|
|
while (1) {
|
2007-01-30 23:04:22 +01:00
|
|
|
my %revs;
|
2007-02-07 20:50:16 +01:00
|
|
|
my $err;
|
2007-01-30 03:34:55 +01:00
|
|
|
my $err_handler = $SVN::Error::handler;
|
2007-02-07 20:50:16 +01:00
|
|
|
$SVN::Error::handler = sub {
|
|
|
|
($err) = @_;
|
|
|
|
skip_unknown_revs($err);
|
|
|
|
};
|
|
|
|
sub _cb {
|
|
|
|
my ($paths, $r, $author, $date, $log) = @_;
|
|
|
|
[ dup_changed_paths($paths),
|
|
|
|
{ author => $author, date => $date, log => $log } ];
|
|
|
|
}
|
|
|
|
$self->get_log([$longest_path], $min, $max, 0, 1, 1,
|
|
|
|
sub { $revs{$_[1]} = _cb(@_) });
|
|
|
|
if ($err && $max >= $head) {
|
|
|
|
print STDERR "Path '$longest_path' ",
|
|
|
|
"was probably deleted:\n",
|
|
|
|
$err->expanded_message,
|
|
|
|
"\nWill attempt to follow ",
|
|
|
|
"revisions r$min .. r$max ",
|
|
|
|
"committed before the deletion\n";
|
|
|
|
my $hi = $max;
|
|
|
|
while (--$hi >= $min) {
|
|
|
|
my $ok;
|
|
|
|
$self->get_log([$longest_path], $min, $hi,
|
|
|
|
0, 1, 1, sub {
|
|
|
|
$ok ||= $_[1];
|
|
|
|
$revs{$_[1]} = _cb(@_) });
|
|
|
|
if ($ok) {
|
|
|
|
print STDERR "r$min .. r$ok OK\n";
|
|
|
|
last;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2007-01-30 23:04:22 +01:00
|
|
|
$SVN::Error::handler = $err_handler;
|
2007-02-07 03:35:30 +01:00
|
|
|
|
2007-02-08 21:53:57 +01:00
|
|
|
my %exists = map { $_->{path} => $_ } @$gsv;
|
2007-01-30 23:04:22 +01:00
|
|
|
foreach my $r (sort {$a <=> $b} keys %revs) {
|
2007-02-07 03:35:30 +01:00
|
|
|
my ($paths, $logged) = @{$revs{$r}};
|
2007-02-08 21:53:57 +01:00
|
|
|
|
|
|
|
foreach my $gs ($self->match_globs(\%exists, $paths,
|
|
|
|
$globs, $r)) {
|
2007-02-07 03:35:30 +01:00
|
|
|
if ($gs->rev_db_max >= $r) {
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
next unless $gs->match_paths($paths, $r);
|
|
|
|
$gs->{logged_rev_props} = $logged;
|
2007-02-15 01:29:52 +01:00
|
|
|
if (my $last_commit = $gs->last_commit) {
|
|
|
|
$gs->assert_index_clean($last_commit);
|
|
|
|
}
|
2007-02-07 03:35:30 +01:00
|
|
|
my $log_entry = $gs->do_fetch($paths, $r);
|
|
|
|
if ($log_entry) {
|
2007-01-28 07:28:56 +01:00
|
|
|
$gs->do_git_commit($log_entry);
|
|
|
|
}
|
|
|
|
}
|
2007-02-08 21:53:57 +01:00
|
|
|
foreach my $g (@$globs) {
|
2007-02-11 10:20:26 +01:00
|
|
|
my $k = "svn-remote.$g->{remote}." .
|
|
|
|
"$g->{t}-maxRev";
|
|
|
|
Git::SVN::tmp_config($k, $r);
|
2007-02-08 21:53:57 +01:00
|
|
|
}
|
2007-09-07 13:00:40 +02:00
|
|
|
if ($ra_invalid) {
|
|
|
|
$_[0] = undef;
|
|
|
|
$self = undef;
|
|
|
|
$RA = undef;
|
|
|
|
$self = Git::SVN::Ra->new($ra_url);
|
|
|
|
$ra_invalid = undef;
|
|
|
|
}
|
2007-01-28 07:28:56 +01:00
|
|
|
}
|
2007-02-01 02:22:31 +01:00
|
|
|
# pre-fill the .rev_db since it'll eventually get filled in
|
|
|
|
# with '0' x40 if something new gets committed
|
2007-02-08 21:53:57 +01:00
|
|
|
foreach my $gs (@$gsv) {
|
2007-02-01 02:22:31 +01:00
|
|
|
next if defined $gs->rev_db_get($max);
|
|
|
|
$gs->rev_db_set($max, 0 x40);
|
|
|
|
}
|
2007-02-13 01:03:32 +01:00
|
|
|
foreach my $g (@$globs) {
|
|
|
|
my $k = "svn-remote.$g->{remote}.$g->{t}-maxRev";
|
|
|
|
Git::SVN::tmp_config($k, $max);
|
|
|
|
}
|
2007-01-28 07:28:56 +01:00
|
|
|
last if $max >= $head;
|
|
|
|
$min = $max + 1;
|
|
|
|
$max += $inc;
|
|
|
|
$max = $head if ($max > $head);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-02-08 21:53:57 +01:00
|
|
|
sub match_globs {
|
|
|
|
my ($self, $exists, $paths, $globs, $r) = @_;
|
2007-02-10 22:28:50 +01:00
|
|
|
|
|
|
|
sub get_dir_check {
|
|
|
|
my ($self, $exists, $g, $r) = @_;
|
|
|
|
my @x = eval { $self->get_dir($g->{path}->{left}, $r) };
|
|
|
|
return unless scalar @x == 3;
|
|
|
|
my $dirents = $x[0];
|
|
|
|
foreach my $de (keys %$dirents) {
|
2007-05-13 10:04:43 +02:00
|
|
|
next if $dirents->{$de}->{kind} != $SVN::Node::dir;
|
2007-02-10 22:28:50 +01:00
|
|
|
my $p = $g->{path}->full_path($de);
|
|
|
|
next if $exists->{$p};
|
|
|
|
next if (length $g->{path}->{right} &&
|
|
|
|
($self->check_path($p, $r) !=
|
|
|
|
$SVN::Node::dir));
|
|
|
|
$exists->{$p} = Git::SVN->init($self->{url}, $p, undef,
|
|
|
|
$g->{ref}->full_path($de), 1);
|
|
|
|
}
|
|
|
|
}
|
2007-02-08 21:53:57 +01:00
|
|
|
foreach my $g (@$globs) {
|
2007-02-10 22:28:50 +01:00
|
|
|
if (my $path = $paths->{"/$g->{path}->{left}"}) {
|
|
|
|
if ($path->{action} =~ /^[AR]$/) {
|
|
|
|
get_dir_check($self, $exists, $g, $r);
|
|
|
|
}
|
|
|
|
}
|
2007-02-08 21:53:57 +01:00
|
|
|
foreach (keys %$paths) {
|
2007-02-14 22:32:21 +01:00
|
|
|
if (/$g->{path}->{left_regex}/ &&
|
|
|
|
!/$g->{path}->{regex}/) {
|
2007-02-10 22:28:50 +01:00
|
|
|
next if $paths->{$_}->{action} !~ /^[AR]$/;
|
|
|
|
get_dir_check($self, $exists, $g, $r);
|
|
|
|
}
|
2007-02-08 21:53:57 +01:00
|
|
|
next unless /$g->{path}->{regex}/;
|
|
|
|
my $p = $1;
|
|
|
|
my $pathname = $g->{path}->full_path($p);
|
|
|
|
next if $exists->{$pathname};
|
2007-04-18 09:17:33 +02:00
|
|
|
next if ($self->check_path($pathname, $r) !=
|
|
|
|
$SVN::Node::dir);
|
2007-02-08 21:53:57 +01:00
|
|
|
$exists->{$pathname} = Git::SVN->init(
|
|
|
|
$self->{url}, $pathname, undef,
|
|
|
|
$g->{ref}->full_path($p), 1);
|
|
|
|
}
|
|
|
|
my $c = '';
|
|
|
|
foreach (split m#/#, $g->{path}->{left}) {
|
|
|
|
$c .= "/$_";
|
|
|
|
next unless ($paths->{$c} &&
|
2007-02-10 22:28:50 +01:00
|
|
|
($paths->{$c}->{action} =~ /^[AR]$/));
|
|
|
|
get_dir_check($self, $exists, $g, $r);
|
2007-02-08 21:53:57 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
values %$exists;
|
|
|
|
}
|
|
|
|
|
2007-01-24 01:29:23 +01:00
|
|
|
sub minimize_url {
|
|
|
|
my ($self) = @_;
|
|
|
|
return $self->{url} if ($self->{url} eq $self->{repos_root});
|
|
|
|
my $url = $self->{repos_root};
|
|
|
|
my @components = split(m!/!, $self->{svn_path});
|
|
|
|
my $c = '';
|
|
|
|
do {
|
|
|
|
$url .= "/$c" if length $c;
|
|
|
|
eval { (ref $self)->new($url)->get_latest_revnum };
|
|
|
|
} while ($@ && ($c = shift @components));
|
|
|
|
$url;
|
|
|
|
}
|
|
|
|
|
2007-01-10 10:22:38 +01:00
|
|
|
sub can_do_switch {
|
|
|
|
my $self = shift;
|
|
|
|
unless (defined $can_do_switch) {
|
|
|
|
my $pool = SVN::Pool->new;
|
|
|
|
my $rep = eval {
|
|
|
|
$self->do_switch(1, '', 0, $self->{url},
|
|
|
|
SVN::Delta::Editor->new, $pool);
|
|
|
|
};
|
|
|
|
if ($@) {
|
|
|
|
$can_do_switch = 0;
|
|
|
|
} else {
|
|
|
|
$rep->abort_report($pool);
|
|
|
|
$can_do_switch = 1;
|
|
|
|
}
|
|
|
|
$pool->clear;
|
|
|
|
}
|
|
|
|
$can_do_switch;
|
|
|
|
}
|
|
|
|
|
2007-01-28 07:28:56 +01:00
|
|
|
sub skip_unknown_revs {
|
|
|
|
my ($err) = @_;
|
|
|
|
my $errno = $err->apr_err();
|
|
|
|
# Maybe the branch we're tracking didn't
|
|
|
|
# exist when the repo started, so it's
|
|
|
|
# not an error if it doesn't, just continue
|
|
|
|
#
|
|
|
|
# Wonderfully consistent library, eh?
|
|
|
|
# 160013 - svn:// and file://
|
|
|
|
# 175002 - http(s)://
|
|
|
|
# 175007 - http(s):// (this repo required authorization, too...)
|
|
|
|
# More codes may be discovered later...
|
|
|
|
if ($errno == 175007 || $errno == 175002 || $errno == 160013) {
|
2007-03-31 02:54:48 +02:00
|
|
|
my $err_key = $err->expanded_message;
|
|
|
|
# revision numbers change every time, filter them out
|
|
|
|
$err_key =~ s/\d+/\0/g;
|
|
|
|
$err_key = "$errno\0$err_key";
|
|
|
|
unless ($ignored_err{$err_key}) {
|
|
|
|
warn "W: Ignoring error from SVN, path probably ",
|
|
|
|
"does not exist: ($errno): ",
|
|
|
|
$err->expanded_message,"\n";
|
|
|
|
$ignored_err{$err_key} = 1;
|
|
|
|
}
|
2007-01-28 07:28:56 +01:00
|
|
|
return;
|
|
|
|
}
|
|
|
|
die "Error from SVN, ($errno): ", $err->expanded_message,"\n";
|
|
|
|
}
|
|
|
|
|
|
|
|
# svn_log_changed_path_t objects passed to get_log are likely to be
|
|
|
|
# overwritten even if only the refs are copied to an external variable,
|
|
|
|
# so we should dup the structures in their entirety. Using an externally
|
|
|
|
# passed pool (instead of our temporary and quickly cleared pool in
|
|
|
|
# Git::SVN::Ra) does not help matters at all...
|
|
|
|
sub dup_changed_paths {
|
|
|
|
my ($paths) = @_;
|
|
|
|
return undef unless $paths;
|
|
|
|
my %ret;
|
|
|
|
foreach my $p (keys %$paths) {
|
|
|
|
my $i = $paths->{$p};
|
|
|
|
my %s = map { $_ => $i->$_ }
|
|
|
|
qw/copyfrom_path copyfrom_rev action/;
|
|
|
|
$ret{$p} = \%s;
|
|
|
|
}
|
|
|
|
\%ret;
|
|
|
|
}
|
|
|
|
|
2007-01-12 11:35:20 +01:00
|
|
|
package Git::SVN::Log;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
use POSIX qw/strftime/;
|
|
|
|
use vars qw/$TZ $limit $color $pager $non_recursive $verbose $oneline
|
|
|
|
%rusers $show_commit $incremental/;
|
|
|
|
my $l_fmt;
|
|
|
|
|
|
|
|
sub cmt_showable {
|
|
|
|
my ($c) = @_;
|
|
|
|
return 1 if defined $c->{r};
|
2007-04-08 09:59:22 +02:00
|
|
|
|
|
|
|
# big commit message got truncated by the 16k pretty buffer in rev-list
|
2007-01-12 11:35:20 +01:00
|
|
|
if ($c->{l} && $c->{l}->[-1] eq "...\n" &&
|
|
|
|
$c->{a_raw} =~ /\@([a-f\d\-]+)>$/) {
|
2007-04-08 09:59:22 +02:00
|
|
|
@{$c->{l}} = ();
|
2007-01-14 07:35:53 +01:00
|
|
|
my @log = command(qw/cat-file commit/, $c->{c});
|
2007-04-08 09:59:22 +02:00
|
|
|
|
|
|
|
# shift off the headers
|
|
|
|
shift @log while ($log[0] ne '');
|
2007-01-14 07:35:53 +01:00
|
|
|
shift @log;
|
2007-04-08 09:59:22 +02:00
|
|
|
|
|
|
|
# TODO: make $c->{l} not have a trailing newline in the future
|
|
|
|
@{$c->{l}} = map { "$_\n" } grep !/^git-svn-id: /, @log;
|
2007-01-12 11:35:20 +01:00
|
|
|
|
|
|
|
(undef, $c->{r}, undef) = ::extract_metadata(
|
2007-01-14 07:35:53 +01:00
|
|
|
(grep(/^git-svn-id: /, @log))[-1]);
|
2007-01-12 11:35:20 +01:00
|
|
|
}
|
|
|
|
return defined $c->{r};
|
|
|
|
}
|
|
|
|
|
|
|
|
sub log_use_color {
|
|
|
|
return 1 if $color;
|
|
|
|
my ($dc, $dcvar);
|
|
|
|
$dcvar = 'color.diff';
|
|
|
|
$dc = `git-config --get $dcvar`;
|
|
|
|
if ($dc eq '') {
|
|
|
|
# nothing at all; fallback to "diff.color"
|
|
|
|
$dcvar = 'diff.color';
|
|
|
|
$dc = `git-config --get $dcvar`;
|
|
|
|
}
|
|
|
|
chomp($dc);
|
|
|
|
if ($dc eq 'auto') {
|
|
|
|
my $pc;
|
|
|
|
$pc = `git-config --get color.pager`;
|
|
|
|
if ($pc eq '') {
|
|
|
|
# does not have it -- fallback to pager.color
|
|
|
|
$pc = `git-config --bool --get pager.color`;
|
|
|
|
}
|
|
|
|
else {
|
|
|
|
$pc = `git-config --bool --get color.pager`;
|
|
|
|
if ($?) {
|
|
|
|
$pc = 'false';
|
|
|
|
}
|
|
|
|
}
|
|
|
|
chomp($pc);
|
|
|
|
if (-t *STDOUT || (defined $pager && $pc eq 'true')) {
|
|
|
|
return ($ENV{TERM} && $ENV{TERM} ne 'dumb');
|
|
|
|
}
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
return 0 if $dc eq 'never';
|
|
|
|
return 1 if $dc eq 'always';
|
|
|
|
chomp($dc = `git-config --bool --get $dcvar`);
|
|
|
|
return ($dc eq 'true');
|
|
|
|
}
|
|
|
|
|
|
|
|
sub git_svn_log_cmd {
|
2007-02-14 02:09:40 +01:00
|
|
|
my ($r_min, $r_max, @args) = @_;
|
|
|
|
my $head = 'HEAD';
|
2007-08-15 18:55:18 +02:00
|
|
|
my (@files, @log_opts);
|
2007-02-14 02:09:40 +01:00
|
|
|
foreach my $x (@args) {
|
2007-08-15 18:55:18 +02:00
|
|
|
if ($x eq '--' || @files) {
|
|
|
|
push @files, $x;
|
|
|
|
} else {
|
|
|
|
if (::verify_ref("$x^0")) {
|
|
|
|
$head = $x;
|
|
|
|
} else {
|
|
|
|
push @log_opts, $x;
|
|
|
|
}
|
|
|
|
}
|
2007-02-14 02:09:40 +01:00
|
|
|
}
|
|
|
|
|
2007-04-08 09:59:19 +02:00
|
|
|
my ($url, $rev, $uuid, $gs) = ::working_head_info($head);
|
|
|
|
$gs ||= Git::SVN->_new;
|
2007-01-12 11:35:20 +01:00
|
|
|
my @cmd = (qw/log --abbrev-commit --pretty=raw --default/,
|
|
|
|
$gs->refname);
|
|
|
|
push @cmd, '-r' unless $non_recursive;
|
|
|
|
push @cmd, qw/--raw --name-status/ if $verbose;
|
|
|
|
push @cmd, '--color' if log_use_color();
|
2007-08-15 18:55:18 +02:00
|
|
|
push @cmd, @log_opts;
|
|
|
|
if (defined $r_max && $r_max == $r_min) {
|
2007-01-12 11:35:20 +01:00
|
|
|
push @cmd, '--max-count=1';
|
|
|
|
if (my $c = $gs->rev_db_get($r_max)) {
|
|
|
|
push @cmd, $c;
|
|
|
|
}
|
2007-08-15 18:55:18 +02:00
|
|
|
} elsif (defined $r_max) {
|
2007-01-12 11:35:20 +01:00
|
|
|
my ($c_min, $c_max);
|
|
|
|
$c_max = $gs->rev_db_get($r_max);
|
|
|
|
$c_min = $gs->rev_db_get($r_min);
|
|
|
|
if (defined $c_min && defined $c_max) {
|
|
|
|
if ($r_max > $r_max) {
|
|
|
|
push @cmd, "$c_min..$c_max";
|
|
|
|
} else {
|
|
|
|
push @cmd, "$c_max..$c_min";
|
|
|
|
}
|
|
|
|
} elsif ($r_max > $r_min) {
|
|
|
|
push @cmd, $c_max;
|
|
|
|
} else {
|
|
|
|
push @cmd, $c_min;
|
|
|
|
}
|
|
|
|
}
|
2007-08-15 18:55:18 +02:00
|
|
|
return (@cmd, @files);
|
2007-01-12 11:35:20 +01:00
|
|
|
}
|
|
|
|
|
|
|
|
# adapted from pager.c
|
|
|
|
sub config_pager {
|
|
|
|
$pager ||= $ENV{GIT_PAGER} || $ENV{PAGER};
|
|
|
|
if (!defined $pager) {
|
|
|
|
$pager = 'less';
|
|
|
|
} elsif (length $pager == 0 || $pager eq 'cat') {
|
|
|
|
$pager = undef;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
sub run_pager {
|
2007-09-22 03:48:45 +02:00
|
|
|
return unless -t *STDOUT && defined $pager;
|
2007-01-12 11:35:20 +01:00
|
|
|
pipe my $rfd, my $wfd or return;
|
2007-10-16 16:36:52 +02:00
|
|
|
defined(my $pid = fork) or ::fatal "Can't fork: $!";
|
2007-01-12 11:35:20 +01:00
|
|
|
if (!$pid) {
|
|
|
|
open STDOUT, '>&', $wfd or
|
2007-10-16 16:36:52 +02:00
|
|
|
::fatal "Can't redirect to stdout: $!";
|
2007-01-12 11:35:20 +01:00
|
|
|
return;
|
|
|
|
}
|
2007-10-16 16:36:52 +02:00
|
|
|
open STDIN, '<&', $rfd or ::fatal "Can't redirect stdin: $!";
|
2007-01-12 11:35:20 +01:00
|
|
|
$ENV{LESS} ||= 'FRSX';
|
2007-10-16 16:36:52 +02:00
|
|
|
exec $pager or ::fatal "Can't run pager: $! ($pager)";
|
2007-01-12 11:35:20 +01:00
|
|
|
}
|
|
|
|
|
2007-01-27 23:38:10 +01:00
|
|
|
sub tz_to_s_offset {
|
|
|
|
my ($tz) = @_;
|
|
|
|
$tz =~ s/(\d\d)$//;
|
|
|
|
return ($1 * 60) + ($tz * 3600);
|
|
|
|
}
|
|
|
|
|
2007-01-12 11:35:20 +01:00
|
|
|
sub get_author_info {
|
|
|
|
my ($dest, $author, $t, $tz) = @_;
|
|
|
|
$author =~ s/(?:^\s*|\s*$)//g;
|
|
|
|
$dest->{a_raw} = $author;
|
|
|
|
my $au;
|
2007-01-14 11:17:00 +01:00
|
|
|
if ($::_authors) {
|
2007-01-12 11:35:20 +01:00
|
|
|
$au = $rusers{$author} || undef;
|
|
|
|
}
|
|
|
|
if (!$au) {
|
|
|
|
($au) = ($author =~ /<([^>]+)\@[^>]+>$/);
|
|
|
|
}
|
|
|
|
$dest->{t} = $t;
|
|
|
|
$dest->{tz} = $tz;
|
|
|
|
$dest->{a} = $au;
|
|
|
|
# Date::Parse isn't in the standard Perl distro :(
|
|
|
|
if ($tz =~ s/^\+//) {
|
2007-01-27 23:38:10 +01:00
|
|
|
$t += tz_to_s_offset($tz);
|
2007-01-12 11:35:20 +01:00
|
|
|
} elsif ($tz =~ s/^\-//) {
|
2007-01-27 23:38:10 +01:00
|
|
|
$t -= tz_to_s_offset($tz);
|
2007-01-12 11:35:20 +01:00
|
|
|
}
|
|
|
|
$dest->{t_utc} = $t;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub process_commit {
|
|
|
|
my ($c, $r_min, $r_max, $defer) = @_;
|
|
|
|
if (defined $r_min && defined $r_max) {
|
|
|
|
if ($r_min == $c->{r} && $r_min == $r_max) {
|
|
|
|
show_commit($c);
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
return 1 if $r_min == $r_max;
|
|
|
|
if ($r_min < $r_max) {
|
|
|
|
# we need to reverse the print order
|
|
|
|
return 0 if (defined $limit && --$limit < 0);
|
|
|
|
push @$defer, $c;
|
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
if ($r_min != $r_max) {
|
|
|
|
return 1 if ($r_min < $c->{r});
|
|
|
|
return 1 if ($r_max > $c->{r});
|
|
|
|
}
|
|
|
|
}
|
|
|
|
return 0 if (defined $limit && --$limit < 0);
|
|
|
|
show_commit($c);
|
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub show_commit {
|
|
|
|
my $c = shift;
|
|
|
|
if ($oneline) {
|
|
|
|
my $x = "\n";
|
|
|
|
if (my $l = $c->{l}) {
|
|
|
|
while ($l->[0] =~ /^\s*$/) { shift @$l }
|
|
|
|
$x = $l->[0];
|
|
|
|
}
|
|
|
|
$l_fmt ||= 'A' . length($c->{r});
|
|
|
|
print 'r',pack($l_fmt, $c->{r}),' | ';
|
|
|
|
print "$c->{c} | " if $show_commit;
|
|
|
|
print $x;
|
|
|
|
} else {
|
|
|
|
show_commit_normal($c);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
sub show_commit_changed_paths {
|
|
|
|
my ($c) = @_;
|
|
|
|
return unless $c->{changed};
|
|
|
|
print "Changed paths:\n", @{$c->{changed}};
|
|
|
|
}
|
|
|
|
|
|
|
|
sub show_commit_normal {
|
|
|
|
my ($c) = @_;
|
|
|
|
print '-' x72, "\nr$c->{r} | ";
|
|
|
|
print "$c->{c} | " if $show_commit;
|
|
|
|
print "$c->{a} | ", strftime("%Y-%m-%d %H:%M:%S %z (%a, %d %b %Y)",
|
|
|
|
localtime($c->{t_utc})), ' | ';
|
|
|
|
my $nr_line = 0;
|
|
|
|
|
|
|
|
if (my $l = $c->{l}) {
|
|
|
|
while ($l->[$#$l] eq "\n" && $#$l > 0
|
|
|
|
&& $l->[($#$l - 1)] eq "\n") {
|
|
|
|
pop @$l;
|
|
|
|
}
|
|
|
|
$nr_line = scalar @$l;
|
|
|
|
if (!$nr_line) {
|
|
|
|
print "1 line\n\n\n";
|
|
|
|
} else {
|
|
|
|
if ($nr_line == 1) {
|
|
|
|
$nr_line = '1 line';
|
|
|
|
} else {
|
|
|
|
$nr_line .= ' lines';
|
|
|
|
}
|
|
|
|
print $nr_line, "\n";
|
|
|
|
show_commit_changed_paths($c);
|
|
|
|
print "\n";
|
|
|
|
print $_ foreach @$l;
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
print "1 line\n";
|
|
|
|
show_commit_changed_paths($c);
|
|
|
|
print "\n";
|
|
|
|
|
|
|
|
}
|
2007-02-15 09:40:42 +01:00
|
|
|
foreach my $x (qw/raw stat diff/) {
|
2007-01-12 11:35:20 +01:00
|
|
|
if ($c->{$x}) {
|
|
|
|
print "\n";
|
|
|
|
print $_ foreach @{$c->{$x}}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
sub cmd_show_log {
|
|
|
|
my (@args) = @_;
|
|
|
|
my ($r_min, $r_max);
|
|
|
|
my $r_last = -1; # prevent dupes
|
|
|
|
if (defined $TZ) {
|
|
|
|
$ENV{TZ} = $TZ;
|
|
|
|
} else {
|
|
|
|
delete $ENV{TZ};
|
|
|
|
}
|
|
|
|
if (defined $::_revision) {
|
|
|
|
if ($::_revision =~ /^(\d+):(\d+)$/) {
|
|
|
|
($r_min, $r_max) = ($1, $2);
|
|
|
|
} elsif ($::_revision =~ /^\d+$/) {
|
|
|
|
$r_min = $r_max = $::_revision;
|
|
|
|
} else {
|
|
|
|
::fatal "-r$::_revision is not supported, use ",
|
2007-10-16 16:36:52 +02:00
|
|
|
"standard 'git log' arguments instead";
|
2007-01-12 11:35:20 +01:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
config_pager();
|
2007-08-15 18:55:18 +02:00
|
|
|
@args = git_svn_log_cmd($r_min, $r_max, @args);
|
2007-01-12 11:35:20 +01:00
|
|
|
my $log = command_output_pipe(@args);
|
|
|
|
run_pager();
|
2007-02-15 09:40:42 +01:00
|
|
|
my (@k, $c, $d, $stat);
|
2007-01-12 11:35:20 +01:00
|
|
|
my $esc_color = qr/(?:\033\[(?:(?:\d+;)*\d*)?m)*/;
|
|
|
|
while (<$log>) {
|
|
|
|
if (/^${esc_color}commit ($::sha1_short)/o) {
|
|
|
|
my $cmt = $1;
|
|
|
|
if ($c && cmt_showable($c) && $c->{r} != $r_last) {
|
|
|
|
$r_last = $c->{r};
|
|
|
|
process_commit($c, $r_min, $r_max, \@k) or
|
|
|
|
goto out;
|
|
|
|
}
|
|
|
|
$d = undef;
|
|
|
|
$c = { c => $cmt };
|
|
|
|
} elsif (/^${esc_color}author (.+) (\d+) ([\-\+]?\d+)$/o) {
|
|
|
|
get_author_info($c, $1, $2, $3);
|
|
|
|
} elsif (/^${esc_color}(?:tree|parent|committer) /o) {
|
|
|
|
# ignore
|
|
|
|
} elsif (/^${esc_color}:\d{6} \d{6} $::sha1_short/o) {
|
|
|
|
push @{$c->{raw}}, $_;
|
|
|
|
} elsif (/^${esc_color}[ACRMDT]\t/) {
|
|
|
|
# we could add $SVN->{svn_path} here, but that requires
|
|
|
|
# remote access at the moment (repo_path_split)...
|
|
|
|
s#^(${esc_color})([ACRMDT])\t#$1 $2 #o;
|
|
|
|
push @{$c->{changed}}, $_;
|
|
|
|
} elsif (/^${esc_color}diff /o) {
|
|
|
|
$d = 1;
|
|
|
|
push @{$c->{diff}}, $_;
|
|
|
|
} elsif ($d) {
|
|
|
|
push @{$c->{diff}}, $_;
|
2007-02-15 09:40:42 +01:00
|
|
|
} elsif (/^\ .+\ \|\s*\d+\ $esc_color[\+\-]*
|
|
|
|
$esc_color*[\+\-]*$esc_color$/x) {
|
|
|
|
$stat = 1;
|
|
|
|
push @{$c->{stat}}, $_;
|
|
|
|
} elsif ($stat && /^ \d+ files changed, \d+ insertions/) {
|
|
|
|
push @{$c->{stat}}, $_;
|
|
|
|
$stat = undef;
|
2007-01-12 11:35:20 +01:00
|
|
|
} elsif (/^${esc_color} (git-svn-id:.+)$/o) {
|
|
|
|
($c->{url}, $c->{r}, undef) = ::extract_metadata($1);
|
|
|
|
} elsif (s/^${esc_color} //o) {
|
|
|
|
push @{$c->{l}}, $_;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if ($c && defined $c->{r} && $c->{r} != $r_last) {
|
|
|
|
$r_last = $c->{r};
|
|
|
|
process_commit($c, $r_min, $r_max, \@k);
|
|
|
|
}
|
|
|
|
if (@k) {
|
|
|
|
my $swap = $r_max;
|
|
|
|
$r_max = $r_min;
|
|
|
|
$r_min = $swap;
|
|
|
|
process_commit($_, $r_min, $r_max) foreach reverse @k;
|
|
|
|
}
|
|
|
|
out:
|
2007-01-12 12:07:31 +01:00
|
|
|
close $log;
|
2007-01-12 11:35:20 +01:00
|
|
|
print '-' x72,"\n" unless $incremental || $oneline;
|
|
|
|
}
|
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
package Git::SVN::Migration;
|
|
|
|
# these version numbers do NOT correspond to actual version numbers
|
|
|
|
# of git nor git-svn. They are just relative.
|
|
|
|
#
|
|
|
|
# v0 layout: .git/$id/info/url, refs/heads/$id-HEAD
|
|
|
|
#
|
|
|
|
# v1 layout: .git/$id/info/url, refs/remotes/$id
|
|
|
|
#
|
|
|
|
# v2 layout: .git/svn/$id/info/url, refs/remotes/$id
|
|
|
|
#
|
|
|
|
# v3 layout: .git/svn/$id, refs/remotes/$id
|
|
|
|
# - info/url may remain for backwards compatibility
|
|
|
|
# - this is what we migrate up to this layout automatically,
|
|
|
|
# - this will be used by git svn init on single branches
|
2007-02-12 22:25:25 +01:00
|
|
|
# v3.1 layout (auto migrated):
|
|
|
|
# - .rev_db => .rev_db.$UUID, .rev_db will remain as a symlink
|
|
|
|
# for backwards compatibility
|
2007-01-19 02:50:01 +01:00
|
|
|
#
|
|
|
|
# v4 layout: .git/svn/$repo_id/$id, refs/remotes/$repo_id/$id
|
|
|
|
# - this is only created for newly multi-init-ed
|
|
|
|
# repositories. Similar in spirit to the
|
|
|
|
# --use-separate-remotes option in git-clone (now default)
|
|
|
|
# - we do not automatically migrate to this (following
|
|
|
|
# the example set by core git)
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
use Carp qw/croak/;
|
|
|
|
use File::Path qw/mkpath/;
|
2007-01-21 13:27:09 +01:00
|
|
|
use File::Basename qw/dirname basename/;
|
|
|
|
use vars qw/$_minimize/;
|
2007-01-19 02:50:01 +01:00
|
|
|
|
|
|
|
sub migrate_from_v0 {
|
|
|
|
my $git_dir = $ENV{GIT_DIR};
|
|
|
|
return undef unless -d $git_dir;
|
|
|
|
my ($fh, $ctx) = command_output_pipe(qw/rev-parse --symbolic --all/);
|
|
|
|
my $migrated = 0;
|
|
|
|
while (<$fh>) {
|
|
|
|
chomp;
|
|
|
|
my ($id, $orig_ref) = ($_, $_);
|
|
|
|
next unless $id =~ s#^refs/heads/(.+)-HEAD$#$1#;
|
|
|
|
next unless -f "$git_dir/$id/info/url";
|
|
|
|
my $new_ref = "refs/remotes/$id";
|
|
|
|
if (::verify_ref("$new_ref^0")) {
|
|
|
|
print STDERR "W: $orig_ref is probably an old ",
|
|
|
|
"branch used by an ancient version of ",
|
|
|
|
"git-svn.\n",
|
|
|
|
"However, $new_ref also exists.\n",
|
|
|
|
"We will not be able ",
|
|
|
|
"to use this branch until this ",
|
|
|
|
"ambiguity is resolved.\n";
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
print STDERR "Migrating from v0 layout...\n" if !$migrated;
|
|
|
|
print STDERR "Renaming ref: $orig_ref => $new_ref\n";
|
|
|
|
command_noisy('update-ref', $new_ref, $orig_ref);
|
|
|
|
command_noisy('update-ref', '-d', $orig_ref, $orig_ref);
|
|
|
|
$migrated++;
|
|
|
|
}
|
|
|
|
command_close_pipe($fh, $ctx);
|
|
|
|
print STDERR "Done migrating from v0 layout...\n" if $migrated;
|
|
|
|
$migrated;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub migrate_from_v1 {
|
|
|
|
my $git_dir = $ENV{GIT_DIR};
|
|
|
|
my $migrated = 0;
|
|
|
|
return $migrated unless -d $git_dir;
|
|
|
|
my $svn_dir = "$git_dir/svn";
|
|
|
|
|
|
|
|
# just in case somebody used 'svn' as their $id at some point...
|
|
|
|
return $migrated if -d $svn_dir && ! -f "$svn_dir/info/url";
|
|
|
|
|
|
|
|
print STDERR "Migrating from a git-svn v1 layout...\n";
|
|
|
|
mkpath([$svn_dir]);
|
|
|
|
print STDERR "Data from a previous version of git-svn exists, but\n\t",
|
|
|
|
"$svn_dir\n\t(required for this version ",
|
|
|
|
"($::VERSION) of git-svn) does not. exist\n";
|
|
|
|
my ($fh, $ctx) = command_output_pipe(qw/rev-parse --symbolic --all/);
|
|
|
|
while (<$fh>) {
|
|
|
|
my $x = $_;
|
|
|
|
next unless $x =~ s#^refs/remotes/##;
|
|
|
|
chomp $x;
|
|
|
|
next unless -f "$git_dir/$x/info/url";
|
|
|
|
my $u = eval { ::file_to_s("$git_dir/$x/info/url") };
|
|
|
|
next unless $u;
|
|
|
|
my $dn = dirname("$git_dir/svn/$x");
|
|
|
|
mkpath([$dn]) unless -d $dn;
|
|
|
|
if ($x eq 'svn') { # they used 'svn' as GIT_SVN_ID:
|
|
|
|
mkpath(["$git_dir/svn/svn"]);
|
|
|
|
print STDERR " - $git_dir/$x/info => ",
|
|
|
|
"$git_dir/svn/$x/info\n";
|
|
|
|
rename "$git_dir/$x/info", "$git_dir/svn/$x/info" or
|
|
|
|
croak "$!: $x";
|
|
|
|
# don't worry too much about these, they probably
|
|
|
|
# don't exist with repos this old (save for index,
|
|
|
|
# and we can easily regenerate that)
|
|
|
|
foreach my $f (qw/unhandled.log index .rev_db/) {
|
|
|
|
rename "$git_dir/$x/$f", "$git_dir/svn/$x/$f";
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
print STDERR " - $git_dir/$x => $git_dir/svn/$x\n";
|
|
|
|
rename "$git_dir/$x", "$git_dir/svn/$x" or
|
|
|
|
croak "$!: $x";
|
|
|
|
}
|
|
|
|
$migrated++;
|
|
|
|
}
|
|
|
|
command_close_pipe($fh, $ctx);
|
|
|
|
print STDERR "Done migrating from a git-svn v1 layout\n";
|
|
|
|
$migrated;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub read_old_urls {
|
|
|
|
my ($l_map, $pfx, $path) = @_;
|
|
|
|
my @dir;
|
|
|
|
foreach (<$path/*>) {
|
|
|
|
if (-r "$_/info/url") {
|
|
|
|
$pfx .= '/' if $pfx && $pfx !~ m!/$!;
|
|
|
|
my $ref_id = $pfx . basename $_;
|
|
|
|
my $url = ::file_to_s("$_/info/url");
|
|
|
|
$l_map->{$ref_id} = $url;
|
|
|
|
} elsif (-d $_) {
|
|
|
|
push @dir, $_;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
foreach (@dir) {
|
|
|
|
my $x = $_;
|
|
|
|
$x =~ s!^\Q$ENV{GIT_DIR}\E/svn/!!o;
|
|
|
|
read_old_urls($l_map, $x, $_);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
sub migrate_from_v2 {
|
|
|
|
my @cfg = command(qw/config -l/);
|
|
|
|
return if grep /^svn-remote\..+\.url=/, @cfg;
|
|
|
|
my %l_map;
|
|
|
|
read_old_urls(\%l_map, '', "$ENV{GIT_DIR}/svn");
|
|
|
|
my $migrated = 0;
|
|
|
|
|
|
|
|
foreach my $ref_id (sort keys %l_map) {
|
2007-02-01 13:06:27 +01:00
|
|
|
eval { Git::SVN->init($l_map{$ref_id}, '', undef, $ref_id) };
|
|
|
|
if ($@) {
|
|
|
|
Git::SVN->init($l_map{$ref_id}, '', $ref_id, $ref_id);
|
|
|
|
}
|
2007-01-19 02:50:01 +01:00
|
|
|
$migrated++;
|
|
|
|
}
|
|
|
|
$migrated;
|
|
|
|
}
|
|
|
|
|
2007-01-21 13:27:09 +01:00
|
|
|
sub minimize_connections {
|
|
|
|
my $r = Git::SVN::read_all_remotes();
|
|
|
|
my $new_urls = {};
|
|
|
|
my $root_repos = {};
|
|
|
|
foreach my $repo_id (keys %$r) {
|
|
|
|
my $url = $r->{$repo_id}->{url} or next;
|
|
|
|
my $fetch = $r->{$repo_id}->{fetch} or next;
|
|
|
|
my $ra = Git::SVN::Ra->new($url);
|
|
|
|
|
|
|
|
# skip existing cases where we already connect to the root
|
|
|
|
if (($ra->{url} eq $ra->{repos_root}) ||
|
|
|
|
(Git::SVN::sanitize_remote_name($ra->{repos_root}) eq
|
|
|
|
$repo_id)) {
|
|
|
|
$root_repos->{$ra->{url}} = $repo_id;
|
|
|
|
next;
|
|
|
|
}
|
|
|
|
|
|
|
|
my $root_ra = Git::SVN::Ra->new($ra->{repos_root});
|
|
|
|
my $root_path = $ra->{url};
|
2007-02-09 21:17:57 +01:00
|
|
|
$root_path =~ s#^\Q$ra->{repos_root}\E(/|$)##;
|
2007-01-21 13:27:09 +01:00
|
|
|
foreach my $path (keys %$fetch) {
|
|
|
|
my $ref_id = $fetch->{$path};
|
|
|
|
my $gs = Git::SVN->new($ref_id, $repo_id, $path);
|
|
|
|
|
|
|
|
# make sure we can read when connecting to
|
|
|
|
# a higher level of a repository
|
|
|
|
my ($last_rev, undef) = $gs->last_rev_commit;
|
|
|
|
if (!defined $last_rev) {
|
|
|
|
$last_rev = eval {
|
|
|
|
$root_ra->get_latest_revnum;
|
|
|
|
};
|
|
|
|
next if $@;
|
|
|
|
}
|
|
|
|
my $new = $root_path;
|
|
|
|
$new .= length $path ? "/$path" : '';
|
|
|
|
eval {
|
|
|
|
$root_ra->get_log([$new], $last_rev, $last_rev,
|
|
|
|
0, 0, 1, sub { });
|
|
|
|
};
|
|
|
|
next if $@;
|
|
|
|
$new_urls->{$ra->{repos_root}}->{$new} =
|
|
|
|
{ ref_id => $ref_id,
|
|
|
|
old_repo_id => $repo_id,
|
|
|
|
old_path => $path };
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
my @emptied;
|
|
|
|
foreach my $url (keys %$new_urls) {
|
|
|
|
# see if we can re-use an existing [svn-remote "repo_id"]
|
|
|
|
# instead of creating a(n ugly) new section:
|
|
|
|
my $repo_id = $root_repos->{$url} ||
|
|
|
|
Git::SVN::sanitize_remote_name($url);
|
|
|
|
|
|
|
|
my $fetch = $new_urls->{$url};
|
|
|
|
foreach my $path (keys %$fetch) {
|
|
|
|
my $x = $fetch->{$path};
|
|
|
|
Git::SVN->init($url, $path, $repo_id, $x->{ref_id});
|
|
|
|
my $pfx = "svn-remote.$x->{old_repo_id}";
|
|
|
|
|
|
|
|
my $old_fetch = quotemeta("$x->{old_path}:".
|
|
|
|
"refs/remotes/$x->{ref_id}");
|
2007-01-22 20:44:57 +01:00
|
|
|
command_noisy(qw/config --unset/,
|
2007-01-21 13:27:09 +01:00
|
|
|
"$pfx.fetch", '^'. $old_fetch . '$');
|
|
|
|
delete $r->{$x->{old_repo_id}}->
|
|
|
|
{fetch}->{$x->{old_path}};
|
|
|
|
if (!keys %{$r->{$x->{old_repo_id}}->{fetch}}) {
|
2007-01-22 20:44:57 +01:00
|
|
|
command_noisy(qw/config --unset/,
|
2007-01-21 13:27:09 +01:00
|
|
|
"$pfx.url");
|
|
|
|
push @emptied, $x->{old_repo_id}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if (@emptied) {
|
|
|
|
my $file = $ENV{GIT_CONFIG} || $ENV{GIT_CONFIG_LOCAL} ||
|
|
|
|
"$ENV{GIT_DIR}/config";
|
|
|
|
print STDERR <<EOF;
|
|
|
|
The following [svn-remote] sections in your config file ($file) are empty
|
|
|
|
and can be safely removed:
|
|
|
|
EOF
|
|
|
|
print STDERR "[svn-remote \"$_\"]\n" foreach @emptied;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-01-19 02:50:01 +01:00
|
|
|
sub migration_check {
|
|
|
|
migrate_from_v0();
|
|
|
|
migrate_from_v1();
|
|
|
|
migrate_from_v2();
|
2007-01-21 13:27:09 +01:00
|
|
|
minimize_connections() if $_minimize;
|
2007-01-19 02:50:01 +01:00
|
|
|
}
|
|
|
|
|
2007-01-24 12:30:57 +01:00
|
|
|
package Git::IndexInfo;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
use Git qw/command_input_pipe command_close_pipe/;
|
|
|
|
|
|
|
|
sub new {
|
|
|
|
my ($class) = @_;
|
|
|
|
my ($gui, $ctx) = command_input_pipe(qw/update-index -z --index-info/);
|
|
|
|
bless { gui => $gui, ctx => $ctx, nr => 0}, $class;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub remove {
|
|
|
|
my ($self, $path) = @_;
|
|
|
|
if (print { $self->{gui} } '0 ', 0 x 40, "\t", $path, "\0") {
|
|
|
|
return ++$self->{nr};
|
|
|
|
}
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub update {
|
|
|
|
my ($self, $mode, $hash, $path) = @_;
|
|
|
|
if (print { $self->{gui} } $mode, ' ', $hash, "\t", $path, "\0") {
|
|
|
|
return ++$self->{nr};
|
|
|
|
}
|
|
|
|
undef;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub DESTROY {
|
|
|
|
my ($self) = @_;
|
|
|
|
command_close_pipe($self->{gui}, $self->{ctx});
|
|
|
|
}
|
|
|
|
|
2007-02-03 22:29:17 +01:00
|
|
|
package Git::SVN::GlobSpec;
|
|
|
|
use strict;
|
|
|
|
use warnings;
|
|
|
|
|
|
|
|
sub new {
|
|
|
|
my ($class, $glob) = @_;
|
|
|
|
my $re = $glob;
|
|
|
|
$re =~ s!/+$!!g; # no need for trailing slashes
|
2007-02-09 21:17:57 +01:00
|
|
|
my $nr = ($re =~ s!^(.*)\*(.*)$!\(\[^/\]+\)!g);
|
2007-02-03 22:29:17 +01:00
|
|
|
my ($left, $right) = ($1, $2);
|
|
|
|
if ($nr > 1) {
|
2007-02-08 21:53:57 +01:00
|
|
|
die "Only one '*' wildcard expansion ",
|
|
|
|
"is supported (got $nr): '$glob'\n";
|
2007-02-03 22:29:17 +01:00
|
|
|
} elsif ($nr == 0) {
|
2007-02-08 21:53:57 +01:00
|
|
|
die "One '*' is needed for glob: '$glob'\n";
|
2007-02-03 22:29:17 +01:00
|
|
|
}
|
|
|
|
$re = quotemeta($left) . $re . quotemeta($right);
|
2007-02-09 21:17:57 +01:00
|
|
|
if (length $left && !($left =~ s!/+$!!g)) {
|
|
|
|
die "Missing trailing '/' on left side of: '$glob' ($left)\n";
|
|
|
|
}
|
|
|
|
if (length $right && !($right =~ s!^/+!!g)) {
|
|
|
|
die "Missing leading '/' on right side of: '$glob' ($right)\n";
|
|
|
|
}
|
2007-02-10 22:28:50 +01:00
|
|
|
my $left_re = qr/^\/\Q$left\E(\/|$)/;
|
|
|
|
bless { left => $left, right => $right, left_regex => $left_re,
|
2007-02-03 22:29:17 +01:00
|
|
|
regex => qr/$re/, glob => $glob }, $class;
|
|
|
|
}
|
|
|
|
|
|
|
|
sub full_path {
|
|
|
|
my ($self, $path) = @_;
|
|
|
|
return (length $self->{left} ? "$self->{left}/" : '') .
|
|
|
|
$path . (length $self->{right} ? "/$self->{right}" : '');
|
|
|
|
}
|
|
|
|
|
2006-02-16 10:24:16 +01:00
|
|
|
__END__
|
|
|
|
|
|
|
|
Data structures:
|
|
|
|
|
2007-02-03 22:29:17 +01:00
|
|
|
|
|
|
|
$remotes = { # returned by read_all_remotes()
|
|
|
|
'svn' => {
|
|
|
|
# svn-remote.svn.url=https://svn.musicpd.org
|
|
|
|
url => 'https://svn.musicpd.org',
|
|
|
|
# svn-remote.svn.fetch=mpd/trunk:trunk
|
|
|
|
fetch => {
|
|
|
|
'mpd/trunk' => 'trunk',
|
|
|
|
},
|
|
|
|
# svn-remote.svn.tags=mpd/tags/*:tags/*
|
|
|
|
tags => {
|
|
|
|
path => {
|
|
|
|
left => 'mpd/tags',
|
|
|
|
right => '',
|
|
|
|
regex => qr!mpd/tags/([^/]+)$!,
|
|
|
|
glob => 'tags/*',
|
|
|
|
},
|
|
|
|
ref => {
|
|
|
|
left => 'tags',
|
|
|
|
right => '',
|
|
|
|
regex => qr!tags/([^/]+)$!,
|
|
|
|
glob => 'tags/*',
|
|
|
|
},
|
|
|
|
}
|
|
|
|
}
|
|
|
|
};
|
|
|
|
|
2007-01-14 07:35:53 +01:00
|
|
|
$log_entry hashref as returned by libsvn_log_entry()
|
2006-02-16 10:24:16 +01:00
|
|
|
{
|
2007-01-14 07:35:53 +01:00
|
|
|
log => 'whitespace-formatted log entry
|
2006-02-16 10:24:16 +01:00
|
|
|
', # trailing newline is preserved
|
|
|
|
revision => '8', # integer
|
|
|
|
date => '2004-02-24T17:01:44.108345Z', # commit date
|
|
|
|
author => 'committer name'
|
|
|
|
};
|
|
|
|
|
2007-01-27 10:32:00 +01:00
|
|
|
|
|
|
|
# this is generated by generate_diff();
|
2006-02-16 10:24:16 +01:00
|
|
|
@mods = array of diff-index line hashes, each element represents one line
|
|
|
|
of diff-index output
|
|
|
|
|
|
|
|
diff-index line ($m hash)
|
|
|
|
{
|
|
|
|
mode_a => first column of diff-index output, no leading ':',
|
|
|
|
mode_b => second column of diff-index output,
|
|
|
|
sha1_b => sha1sum of the final blob,
|
2006-03-03 10:20:07 +01:00
|
|
|
chg => change type [MCRADT],
|
2006-02-16 10:24:16 +01:00
|
|
|
file_a => original file name of a file (iff chg is 'C' or 'R')
|
|
|
|
file_b => new/current file name of a file (any chg)
|
|
|
|
}
|
|
|
|
;
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
|
git-svn: add --follow-parent and --no-metadata options to fetch
--follow-parent:
This is especially helpful when we're tracking a directory
that has been moved around within the repository, or if we
started tracking a branch and never tracked the trunk it was
descended from.
This relies on the SVN::* libraries to work. We can't
reliably parse path info from the svn command-line client
without relying on XML, so it's better just to have the SVN::*
libs installed.
This also removes oldvalue verification when calling update-ref
In SVN, branches can be deleted, and then recreated under the
same path as the original one with different ancestry
information, causing parent information to be mismatched /
misordered.
Also force the current ref, if existing, to be a parent,
regardless of whether or not it was specified.
--no-metadata:
This gets rid of the git-svn-id: lines at the end of every commit.
With this, you lose the ability to use the rebuild command. If
you ever lose your .git/svn/git-svn/.rev_db file, you won't be
able to fetch again, either. This is fine for one-shot imports.
Also fix some issues with multi-fetch --follow-parent that were
exposed while testing this. Additionally, repack checking is
simplified greatly.
git-svn log will not work on repositories using this, either.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
Signed-off-by: Junio C Hamano <junkio@cox.net>
2006-06-28 04:39:13 +02:00
|
|
|
# retval of read_url_paths{,_all}();
|
|
|
|
$l_map = {
|
|
|
|
# repository root url
|
|
|
|
'https://svn.musicpd.org' => {
|
|
|
|
# repository path # GIT_SVN_ID
|
|
|
|
'mpd/trunk' => 'trunk',
|
|
|
|
'mpd/tags/0.11.5' => 'tags/0.11.5',
|
|
|
|
},
|
|
|
|
}
|
|
|
|
|
git-svn: add support for Perl SVN::* libraries
This means we no longer have to deal with having bloated SVN
working copies around and we get a nice performance increase as
well because we don't have to exec the SVN binary and start a
new server connection each time.
Of course we have to manually manage memory with SVN::Pool
whenever we can, and hack around cases where SVN just eats
memory despite pools (I blame Perl, too). I would like to
keep memory usage as stable as possible during long fetch/commit
processes since I still use computers with only 256-512M RAM.
commit should always be faster with the SVN library code. The
SVN::Delta interface is leaky (or I'm not using it with pools
correctly), so I'm forking on every commit, but that doesn't
seem to hurt performance too much (at least on normal Unix/Linux
systems where fork() is pretty cheap).
fetch should be faster in most common cases, but probably not all.
fetches will be faster where client/server delta generation is
the bottleneck and not bandwidth. Of course, full-files are
generated server-side via deltas, too. Full files are always
transferred when they're updated, just like git-svnimport and
unlike command-line svn. I'm also hacking around memory leaks
(see comments) here by using some more forks.
I've tested fetch with http://, https://, file://, and svn://
repositories, so we should be reasonably covered in terms of
error handling for fetching.
Of course, we'll keep plain command-line svn compatibility as a
fallback for people running SVN 1.1 (I'm looking into library
support for 1.1.x SVN, too). If you want to force command-line
SVN usage, set GIT_SVN_NO_LIB=1 in your environment.
We also require two simultaneous connections (just like
git-svnimport), but this shouldn't be a problem for most
servers.
Less important commands:
show-ignore is slower because it requires repository
access, but -r/--revision <num> can be specified.
graft-branches may use more memory, but it's a
short-term process and is funky-filename-safe.
Signed-off-by: Eric Wong <normalperson@yhbt.net>
2006-06-13 00:23:48 +02:00
|
|
|
Notes:
|
|
|
|
I don't trust the each() function on unless I created %hash myself
|
|
|
|
because the internal iterator may not have started at base.
|