octoleo/gh-ost
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
689 Commits 51 Branches 51 Tags 24 MiB
0b6d834a2b
Commit Graph

115 Commits

Author SHA1 Message Date
Shlomi Noach
0b6d834a2b Merge branch 'master' into resurrect 2016-12-29 13:12:03 +02:00
Shlomi Noach
7bdfd1bff5 not applying range if nil 2016-12-29 10:26:56 +02:00
Shlomi Noach
24f5c6da62 ght/ghr suffix -> delr suffix 2016-12-29 10:23:48 +02:00
Shlomi Noach
90f61f812d resurrected execution does not apply migration range from terminated context 2016-12-28 14:23:50 +02:00
Cyprian Nosek
2bfc672b03 Add possibility to set serverId as gh-ost argument 
Signed-off-by: Cyprian Nosek <cyprian.nosek@pearson.com>
 2016-12-28 11:49:41 +01:00
Shlomi Noach
7dfb740519 format 2016-12-24 17:44:39 +02:00
Shlomi Noach
fa399e0608 added context test, JSON export/import 2016-12-24 17:10:37 +02:00
Shlomi Noach
45b63f6500 applying IsResurrected flag 2016-12-24 10:07:59 +02:00
Shlomi Noach
1080b11d81 binlog event listeners accept coordinates. 
StreamerBinlogCoordinates -> AppliedBinlogCoordinates
updating AppliedBinlogCoordinates when truly applied; no longer asking streamer for coordinates (because streamer's events can be queued, but not handled, a crash implies we need to look at the last _handled_ event, not the last _streamed_ event)
 2016-12-23 15:24:31 +02:00
Shlomi Noach
89ca346919 instead of loading the entire context, only updating particular fields from the resurrected context 2016-12-21 21:10:04 +02:00
Shlomi Noach
5f25f741ad something that works! True resurrection applied 2016-12-21 17:55:40 +02:00
Shlomi Noach
c72851e1f6 initial support for --resurrect flag 2016-12-20 22:33:44 +02:00
Shlomi Noach
4c6f42f2f1 passwords not exported in MigrationContext 2016-12-20 22:14:17 +02:00
Shlomi Noach
6f81d62a31 storing and updating streamer binlog coordinates 2016-12-20 16:47:06 +02:00
Shlomi Noach
3223a9389e context dump serialized with table writes; avoiding sync problems 2016-12-20 16:38:58 +02:00
Shlomi Noach
5e0f38cc6f Merge branch 'resurrect' of github.com:github/gh-ost into resurrect 2016-12-20 16:27:14 +02:00
Shlomi Noach
6999b4e8bf exporting to changelog table, not to file 2016-12-20 16:27:05 +02:00
Shlomi Noach
776c8d3b8b Merge branch 'master' into resurrect 2016-12-20 16:26:29 +02:00
Shlomi Noach
75b6f9edf2 encoding range values as base64 2016-12-20 15:48:42 +02:00
Shlomi Noach
66894d3a52 resurrection: dump/restore of migration context cross executions 2016-12-18 09:23:51 +02:00
Shlomi Noach
ba2a9d9e55 support for --master-user and --master-password 2016-12-13 16:09:34 +01:00
Shlomi Noach
7126b28169 support for --skip-foreign-key-checks 2016-11-21 09:18:40 +01:00
Shlomi Noach
7ab6af8f5f never throttling inside cut-over critical section 2016-11-17 17:22:13 +01:00
Shlomi Noach
034683f482 Merge branch 'master' into close-streamer-connection 2016-11-01 12:22:21 +01:00
Shlomi Noach
7fa5e405d4 avoid writing heartbeat when throttle commanded by user 
when throttling on user command there really is no need for injecting heartbeat. The user commanded, therefore gh-ost complies and trusts the reasoning for throttling. What this will allow is complete quiet time. This, in turn, will allow such features as relocating via orchestrator/pseudo-gtid at time of throttling
 2016-10-27 14:51:38 +02:00
Shlomi Noach
7b63b4a275 proper cleanup of streamer connection 2016-10-27 13:52:37 +02:00
Shlomi Noach
bf92eec214 validating table structure on applier and migrator 
- reading column list on applier
- comparing original table on applier and migrator, expecting exact column list
- or else bailing out
 2016-10-20 11:29:30 +02:00
Shlomi Noach
f988309800 no need for Inspector timezone; it is irrelevant 2016-10-13 13:08:23 +02:00
Shlomi Noach
184643157b Merge branch 'master' into tz-a-different-approach 2016-10-12 08:33:19 +02:00
Shlomi Noach
c11c611755 Merge pull request #260 from github/hooks-nil-check 
safe access to applier/inspector hostnames for hooks
 2016-10-12 08:16:50 +02:00
Shlomi Noach
4d903d0119 Merge pull request #264 from github/discard-foreign-keys 
Discard foreign keys
 2016-10-12 08:16:27 +02:00
Shlomi Noach
5d92da4a74 Merge branch 'master' into tz-a-different-approach 2016-10-11 17:17:42 +02:00
Shlomi Noach
dbf50afbc7 reading time_zone settings for Inspector and Applier separately. 
--time-zone overrides both of them, if given
 2016-10-11 16:00:26 +02:00
Shlomi Noach
15f4ddfd8a support for --critical-load-interval-millis 
this optional flag gives --critical-load a second chance. When configured to positive value, meeting with critical-load spawns a timer. When this timer expires a second check for critical-load is made; if still met, gh-ost bails out.
By default the interval is zero, in which case gh-ost bails out immediately on meeting critical load.
 2016-10-10 13:21:01 +02:00
Shlomi Noach
6750959e1a configurable time-zone, native time parsing 2016-10-10 11:39:57 +02:00
Shlomi Noach
1f65473e69 support for --discard-foreign-keys 
This flag makes migration silently and happily discard any existing foreign keys on migrated table. This is useful for intentional dropping of foreign keys, as gh-ost does not otherwise have support for foreign key migration.
At some time in the future gh-ost may support foreign key migration, at which time this flag will be removed
 2016-10-07 10:20:50 +02:00
Shlomi Noach
72f63d3042 safe access to applier/inspector hostnames for hooks 2016-10-04 21:18:44 +02:00
Shlomi Noach
e5e0444cc6 supporting --force-named-cut-over 
- when given, user _must_ specify table name
  and of course table name must match migrated table
 2016-09-12 19:17:36 +02:00
Shlomi Noach
1c6f828091 refactored server command into server.go 
- added support for cut-over=<tablename>
- refactored more code into context
 2016-09-12 12:38:14 +02:00
Shlomi Noach
88f2af8111 support for --assume-master-host, master-master/tungsten 2016-09-02 13:09:18 +02:00
randall
82110fcfcf Add -override-applier-host for use with -allow-master-master 
for configurations where writes are meant to go to one master, but gh-ost can't automatically determine which
 2016-09-01 20:29:26 -07:00
Shlomi Noach
b2c71931c6 refactored all throttling code into throttler.so 2016-08-30 12:25:45 +02:00
Shlomi Noach
23357d0643 WIP: decoupling general throttling from throttle logic 2016-08-30 11:32:17 +02:00
Shlomi Noach
75b2542f26 Merge branch 'master' into reduce-minimum-max-lag 2016-08-30 09:47:33 +02:00
Shlomi Noach
2afb86b9e4 support for millisecond throttling 
- `--max-lag-millis` is at least `100ms`
- `--heartbeat-interval-millis` introduced; defaults `500ms`, can range `100ms` - `1s`
- Control replicas lag calculated asynchronously to throttle test
  - aggressive when `max-lag-millis < 1000` and when `replication-lag-query` is given
 2016-08-30 09:41:59 +02:00
Jonah Berquist
10b222bc7b Reduce minimum maxLagMillisecondsThrottleThreshold to 100ms 2016-08-26 16:44:40 -07:00
Shlomi Noach
c70f405d06 Merge branch 'master' into hooks 2016-08-26 08:39:02 +02:00
Shlomi Noach
fad6743150 added hooks hint message 2016-08-25 13:54:42 +02:00
Shlomi Noach
cb1a7e2805 merged master 2016-08-25 12:32:03 +02:00
Shlomi Noach
1773f338c2 keeping track of delta rows 
on concurrent count(*) this means we re-apply delta onto new estimate
 2016-08-24 12:16:34 +02:00