Commit Graph

41 Commits

Author SHA1 Message Date
Jose Diaz-Gonzalez
874c235ba5 Merge pull request #30 from jonasrmichel/master
Fixes #29
2016-08-20 20:50:25 -04:00
Robert Bradshaw
8c12d54898 Implement incremental updates
Guarded with an --incremental flag.

Stores the time of the last update and only downloads issue and
pull request data since this time.  All other data is relatively
small (likely fetched with a single request) and so is simply
re-populated from scratch as before.
2016-08-17 21:31:59 -07:00
Kazuki Suda
79726c360d Fix cloning private repos with basic auth or token 2016-03-29 15:23:54 +09:00
Enrico Tröger
b9e35a50f5 Don't store issues which are actually pull requests
This prevents storing pull requests twice since the Github API returns
pull requests also as issues. Those issues will be skipped but only if
retrieving pull requests is requested as well.
Closes #23.
2016-02-14 16:36:40 +01:00
Jose Diaz-Gonzalez
29c9373d9d Merge pull request #32 from albertyw/soft-fail-hooks
Softly fail if not able to read hooks
2016-01-29 03:36:48 -05:00
Albert Wang
17141c1bb6 Softly fail if not able to read hooks 2016-01-29 00:20:53 -08:00
Albert Wang
d362adbbca Make user repository search go through endpoint capable of reading private repositories 2016-01-28 22:52:58 -08:00
Jonas Michel
1e5a90486c Fixes #29
Reporting an error when the user's rate limit is exceeded causes
the script to terminate after resuming execution from a rate limit
sleep. Instead of generating an explicit error we just want to
inform the user that the script is going to sleep until their rate
limit count resets.
2016-01-20 14:48:02 -06:00
Jonas Michel
9b74aff20b Fixes #29
The errors list was not being cleared out after resuming a backup
from a rate limit sleep. When the backup was resumed, the non-empty
errors list caused the backup to quit after the next `retrieve_data`
request.
2016-01-17 11:10:28 -06:00
Alex Hall
325f77dcd9 Prompt for password if only username given 2016-01-12 11:18:26 +02:00
Jose Diaz-Gonzalez
816447af19 Force proper remote url 2015-11-10 15:36:12 -05:00
Enrico Tröger
534145d178 Improve error handling in case of HTTP errors
In case of a HTTP status code 404, the returned 'r' was never assigned.
In case of URL errors which are not timeouts, we probably should bail
out.
2015-10-21 22:40:34 +02:00
Enrico Tröger
fe162eedd5 Add --hooks to also include web hooks into the backup 2015-10-21 22:39:45 +02:00
Jose Diaz-Gonzalez
53a9a22afb Merge pull request #22 from eht16/issue_17_create_output_directory
Create the user specified output directory if it does not exist
2015-10-16 15:05:29 -04:00
Jose Diaz-Gonzalez
2aa7d4cf1e Merge pull request #21 from eht16/fix_get_response_missing_auth
Add missing auth argument to _get_response()
2015-10-16 15:05:14 -04:00
Enrico Tröger
5fc27a4d42 Create the user specified output directory if it does not exist
Fixes #17.
2015-10-16 14:16:47 +02:00
Enrico Tröger
c8b3f048f5 Add repository URL to error message for non-existing repositories
This makes it easier for the user to identify which repository does not
exist or is not initialised, i.e. whether it is the main repository or
the wiki repository and which clone URL was used to check.
2015-10-16 14:09:13 +02:00
Enrico Tröger
2d98251992 Add missing auth argument to _get_response()
When running unauthenticated and Github starts rate-limiting the client,
github-backup crashes because the used auth variable in _get_response()
was not available. This change should fix it.
2015-10-16 14:00:56 +02:00
Jose Diaz-Gonzalez
708b377918 Refactor to both simplify codepath as well as follow PEP8 standards 2015-10-10 00:16:30 -04:00
Mathijs Jonker
4b30aaeef3 Retry 3 times when the connection times out 2015-09-04 14:07:45 +02:00
Kirill Grushetsky
a440bc1522 Update github-backup 2015-05-04 19:16:23 +03:00
Kirill Grushetsky
43793c1e5e Update github-backup 2015-05-04 19:15:55 +03:00
Kirill Grushetsky
24fac46459 Made unicode output defalut 2015-05-04 19:12:47 +03:00
Kirill Grushetsky
c9916e28a4 Import alphabetised 2015-05-04 13:45:39 +03:00
Kirill Grushetsky
ab4b28cdd4 Preserve Unicode characters in the output file
Added option to preserve Unicode characters in the output file
2015-05-04 13:38:28 +03:00
aensley
8bdbc2cee2 josegonzales/python-github-backup#12 Added backup of labels and milestones. 2015-04-23 14:05:48 -05:00
Mathijs Jonker
7ce61202e5 Fixed indent 2015-04-15 12:21:58 +02:00
mjonker-embed
3e82d829e4 Update github-backup 2015-04-15 12:14:55 +02:00
mjonker-embed
339ad96876 Skip unitialized repo's
These gave me errors which caused mails from crontab.
2015-04-15 12:10:53 +02:00
Chris Adams
2e7f325475 Retry API requests which failed due to rate-limiting
This allows operation to continue, albeit at a slower pace,
if you have enough data to trigger the API rate limits
2015-03-13 17:37:01 -04:00
Chris Adams
5612e51153 Update repository back up handling for wikis
* Now wikis will follow the same logic as the main repo
  checkout for --prefer-ssh.
* The regular repository and wiki paths both use the same
  function to handle either cloning or updating a local copy
  of the remote repo
* All git updates will now use “git fetch --all --tags”
  to ensure that tags and branches other than master will
  also be backed up
2015-03-13 15:50:30 -04:00
Chris Adams
c81bf98627 logging_subprocess: always log when a command fails
Previously git clones could fail without any indication 
unless you edited the source to change `logger=None` to use
a configured logger.

Now a non-zero return code will always output a message to
stderr and will display the executed command so it can be
rerun for troubleshooting.
2015-03-13 15:50:04 -04:00
Chris Adams
040516325a Switch to using ssh_url
The previous commit used the wrong URL for a private repo. This was
masked by the lack of error loging in logging_subprocess (which will be
in a separate branch)
2015-03-13 15:39:35 -04:00
Chris Adams
3bc23473b8 Add an option to prefer checkouts over SSH
This is really useful with private repos to avoid being nagged
for credentials for every repository
2015-03-12 16:10:46 -04:00
Kevin Laude
e8387f9a7f Add pull request support
Back up reporitory pull requests by passing the --include-pulls
argument. Pull requests are saved to
repositories/<repository name>/pulls/<pull request number>.json. Include
the --pull-request-comments argument to add review comments to the pull
request backup and pass the --pull-request-commits argument to add
commits to the pull request backup.

Pull requests are automatically backed up when the --all argument is
uesd.
2015-01-16 09:57:05 -06:00
Kevin Laude
883c92753d Add GitHub Enterprise support
Pass the -H or --github-host argument with a GitHub Enterprise hostname
to backup from that GitHub enterprise host. If no argument is passed
then back up from github.com.
2015-01-15 20:20:33 -06:00
Jose Diaz-Gonzalez
be2583f340 Release 0.2.0 2014-09-22 01:30:38 -04:00
Jose Diaz-Gonzalez
3c5edb0700 Add support for retrieving repositories. Closes #1 2014-09-22 01:27:19 -04:00
Jose Diaz-Gonzalez
aa4201d102 Fix PEP8 violations 2014-09-22 01:02:09 -04:00
Ioannis Filippidis
deb1955a3e add authorization to header only if specified by user 2014-09-13 14:18:48 -07:00
Jose Diaz-Gonzalez
1e9df5003c Create github-backup 2013-12-02 16:57:09 -05:00