Commit Graph

151 Commits

Author SHA1 Message Date
Shlomi Noach
e9e9d6d9da allowing EOF result for loadJSON 2016-12-28 23:17:01 +02:00
Shlomi Noach
e4874c84bd making sure to dump context before row-copy, so we always have some initial resurrection context 2016-12-28 23:06:18 +02:00
Shlomi Noach
738270aabe more verbose on resurrection 2016-12-28 13:35:56 +02:00
Shlomi Noach
8952e24aba rewinding resurrecting at beginning of known logfile; more verbose 2016-12-28 07:42:14 +02:00
Shlomi Noach
0e8e5de7aa added on-resurrecting hook 2016-12-25 08:53:24 +02:00
Shlomi Noach
45b63f6500 applying IsResurrected flag 2016-12-24 10:07:59 +02:00
Shlomi Noach
6128076485 some cleanup 2016-12-24 10:01:03 +02:00
Shlomi Noach
e50361ab61 at resurrection, pointing streamer back at last known applied coordinates 2016-12-24 09:53:55 +02:00
Shlomi Noach
1080b11d81 binlog event listeners accept coordinates.
StreamerBinlogCoordinates -> AppliedBinlogCoordinates
updating AppliedBinlogCoordinates when truly applied; no longer asking streamer for coordinates (because streamer's events can be queued, but not handled, a crash implies we need to look at the last _handled_ event, not the last _streamed_ event)
2016-12-23 15:24:31 +02:00
Shlomi Noach
89ca346919 instead of loading the entire context, only updating particular fields from the resurrected context 2016-12-21 21:10:04 +02:00
Shlomi Noach
5f25f741ad something that works! True resurrection applied 2016-12-21 17:55:40 +02:00
Shlomi Noach
bad30a8871 sanity checks on --resurrection; skipping some normal-mode operations 2016-12-21 09:42:40 +02:00
Shlomi Noach
c72851e1f6 initial support for --resurrect flag 2016-12-20 22:33:44 +02:00
Shlomi Noach
4c6f42f2f1 passwords not exported in MigrationContext 2016-12-20 22:14:17 +02:00
Shlomi Noach
6f81d62a31 storing and updating streamer binlog coordinates 2016-12-20 16:47:06 +02:00
Shlomi Noach
3223a9389e context dump serialized with table writes; avoiding sync problems 2016-12-20 16:38:58 +02:00
Shlomi Noach
5e0f38cc6f Merge branch 'resurrect' of github.com:github/gh-ost into resurrect 2016-12-20 16:27:14 +02:00
Shlomi Noach
6999b4e8bf exporting to changelog table, not to file 2016-12-20 16:27:05 +02:00
Shlomi Noach
776c8d3b8b Merge branch 'master' into resurrect 2016-12-20 16:26:29 +02:00
Shlomi Noach
75b6f9edf2 encoding range values as base64 2016-12-20 15:48:42 +02:00
Shlomi Noach
66894d3a52 resurrection: dump/restore of migration context cross executions 2016-12-18 09:23:51 +02:00
Shlomi Noach
ba2a9d9e55 support for --master-user and --master-password 2016-12-13 16:09:34 +01:00
Shlomi Noach
5119ea4d31 added tests to verify no false positives rename-column found 2016-11-29 11:08:35 +01:00
Shlomi Noach
7ab6af8f5f never throttling inside cut-over critical section 2016-11-17 17:22:13 +01:00
Shlomi Noach
b00cae11fa retry cut-over 2016-11-17 17:10:17 +01:00
Shlomi Noach
8d987b5aaf extracted parsing of ChangelogState 2016-11-17 15:56:59 +01:00
Shlomi Noach
ef874b8551 AllEventsUpToLockProcessed uses unique signature 2016-11-17 15:50:54 +01:00
Shlomi Noach
ee447ad560 waitForEventsUpToLock timeout
more info on AllEventsUpToLockProcessed, before and after injecting/intercepting
2016-11-17 15:20:44 +01:00
Shlomi Noach
88ffb75b8c reading and reporting replication lag before waiting on initial replication event 2016-11-02 12:48:35 +01:00
Shlomi Noach
034683f482 Merge branch 'master' into close-streamer-connection 2016-11-01 12:22:21 +01:00
Shlomi Noach
7fa5e405d4 avoid writing heartbeat when throttle commanded by user
when throttling on user command there really is no need for injecting heartbeat. The user commanded, therefore gh-ost complies and trusts the reasoning for throttling. What this will allow is complete quiet time. This, in turn, will allow such features as relocating via orchestrator/pseudo-gtid at time of throttling
2016-10-27 14:51:38 +02:00
Shlomi Noach
7b63b4a275 proper cleanup of streamer connection 2016-10-27 13:52:37 +02:00
Shlomi Noach
bf92eec214 validating table structure on applier and migrator
- reading column list on applier
- comparing original table on applier and migrator, expecting exact column list
- or else bailing out
2016-10-20 11:29:30 +02:00
Shlomi Noach
c1a6773c02 better handling of --assume-master-host
separated logic and not even attempting to crawl topology
2016-10-11 16:42:19 +02:00
Shlomi Noach
ef04fa49f5 assume-master-host now applied ImpliedKey 2016-10-06 12:00:34 +02:00
Shlomi Noach
a7627091a7 Merge branch 'master' into named-cut-over 2016-09-13 05:25:16 -07:00
Shlomi Noach
0a8be1dd22 excplicitly breaking on NoPrintStatusRule 2016-09-12 17:39:56 +02:00
Shlomi Noach
1c6f828091 refactored server command into server.go
- added support for cut-over=<tablename>
- refactored more code into context
2016-09-12 12:38:14 +02:00
Shlomi Noach
16fc19b157 rowcount progress at 100% when row-copy completes 2016-09-12 10:25:55 +02:00
Shlomi Noach
88f2af8111 support for --assume-master-host, master-master/tungsten 2016-09-02 13:09:18 +02:00
Shlomi Noach
96f108d3b4 Merge pull request #221 from twotwotwo/override-applier-host
Add -override-applier-host for use with -allow-master-master
2016-09-02 11:32:04 +02:00
Shlomi Noach
75d225353f Merge pull request #220 from Wattpad/exit-on-hook-replication-stop-failure
Fail operation if onStopReplication hook fails
2016-09-02 09:39:43 +02:00
randall
82110fcfcf Add -override-applier-host for use with -allow-master-master
for configurations where writes are meant to go to one master, but gh-ost can't automatically determine which
2016-09-01 20:29:26 -07:00
Paulo Bittencourt
e3662f2398 Fail operation if onStopReplication hook fails 2016-09-01 15:58:20 -04:00
Shlomi Noach
c562df42cd status: State and ETA decoupling 2016-09-01 10:51:40 +02:00
Shlomi Noach
904215e286 Merge pull request #204 from github/reduce-minimum-max-lag
Reduce minimum maxLagMillisecondsThrottleThreshold to 100ms
2016-08-31 09:29:16 +02:00
Shlomi Noach
aef56c55f7 indicating 100% when rowcopy is complete 2016-08-30 17:02:29 +02:00
Shlomi Noach
b2c71931c6 refactored all throttling code into throttler.so 2016-08-30 12:25:45 +02:00
Shlomi Noach
23357d0643 WIP: decoupling general throttling from throttle logic 2016-08-30 11:32:17 +02:00
Shlomi Noach
75b2542f26 Merge branch 'master' into reduce-minimum-max-lag 2016-08-30 09:47:33 +02:00