octoleo/syncthing
1
0
Fork 0
mirror of https://github.com/octoleo/syncthing.git synced 2024-12-23 03:18:59 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update DISCOVERY.md

Browse Source 
Correct DISCOVERY.md with the changes proposed in the forum (https://discourse.syncthing.net/t/questions-about-the-discovery-protocol/1586)
This commit is contained in:
marco-m 2014-12-21 22:47:47 +01:00
parent 90101d0269
commit 4b76ec40c0
1 changed files with 84 additions and 34 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

118
protocol/DISCOVERY.md
View File

@ -1,35 +1,61 @@
Device Discovery Protocol v2 Device Discovery Protocol v2
========================== ============================
Mode of Operation Mode of Operation
----------------- -----------------
There are two distinct modes: "local discovery", performed on a LAN There are two distinct modes: **local discovery**, performed on a LAN
segment (broadcast domain) and "global discovery" performed over the segment (broadcast domain) and **global discovery**, performed over the
Internet in general with the support of a well known server. Internet with the support of a well-known server. Both modes are over UDP.
Local discovery does not use Query packets. Instead Announcement packets Local discovery
are sent periodically and each participating device keeps a table of the ---------------
announcements it has seen. On multihomed hosts the announcement packets
should be sent on each interface that syncthing will accept connections.
It is recommended that local discovery Announcement packets are sent on Each participating device sends periodically an Announcement packet and keeps
a 30 to 60 second interval, possibly with forced transmissions when a a table of the announcements it has seen. There is no way to solicit a reply;
the only message type is Announcement.
On multihomed hosts the announcement packets should be sent on each
interface on which syncthing will accept connections.
For IPv4, the Announcement packet is broadcasted either to the link-specific
broadcast address, or to the generic link-local broadcast address
`255.255.255.255`, with source and destination port 21025.
For IPv6, the Announcement packet is multicasted to the transient link-local
multicast address `[ff32::5222]`, with source and destination port 21026.
It is recommended that local discovery Announcement packets be sent on
a 30 to 60 second interval, possibly with immediate transmissions when a
previously unknown device is discovered. previously unknown device is discovered.
Global discovery is made possible by periodically updating a global server Global discovery
using Announcement packets indentical to those transmitted for local ----------------
discovery. The device performing discovery will transmit a Query packet to
the global server and expect an Announcement packet in response. In case
the global server has no knowledge of the queried device ID, there will be
no response. A timeout is to be used to determine lookup failure.
There is no message to unregister from the global server; instead Global discovery is performed in two steps: announcement and discovery.
registrations are forgotten after 60 minutes. It is recommended to
send Announcement packets to the global server on a 30 minute interval.
Packet Formats In the announcement step, a device periodically unicasts an Announcement
-------------- packet to the global server `announce.syncthing.net`, port 22026.
In the discovery step, a device sends a Query packet for a given device ID to
the server. If the server knows the ID, it replies with an Announcement packet.
If the server doesn't know the ID, it will not reply. The device must interpret
a timeout as lookup failure.
There is no message to unregister from the server; instead the server forgets
about an Announcement after 60 minutes.
It is recommended to send Announcement packets to the global server on a 30
minute interval.
Device ID
---------
The device ID is the SHA-256 (32 bytes) of the device X.509 certificate.
See [How device IDs work] in the Syncthing documentation.
Announcement packet
-------------------
The Announcement packet has the following structure: The Announcement packet has the following structure:
@ -49,15 +75,15 @@ The Announcement packet has the following structure:
/ / / /
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Device Structure: Device Structure:
0 1 2 3 0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Length of ID | | Length of Device ID |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
/ / / /
\ ID (variable length) \ \ Device ID \
/ / / /
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Number of Addresses | | Number of Addresses |
@ -67,7 +93,7 @@ The Announcement packet has the following structure:
/ / / /
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Address Structure: Address Structure:
0 1 2 3 0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
@ -78,10 +104,11 @@ The Announcement packet has the following structure:
\ IP (variable length) \ \ IP (variable length) \
/ / / /
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Port | 0x0000 | | Port |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
This is the XDR encoding of: The corresponding XDR representation is as follows (see [RFC4506] for the XDR
format):
struct Announcement { struct Announcement {
unsigned int Magic; unsigned int Magic;
@ -90,25 +117,32 @@ This is the XDR encoding of:
} }
struct Device { struct Device {
string ID<>; opaque DeviceID<32>;
Address Addresses<>; Address Addresses<>;
} }
struct Address { struct Address {
opaque IP<>; opaque IP<>;
unsigned short Port; unsigned int Port;
} }
The first Device structure contains information about the sending device. The first Device structure contains information about the sending device.
The following zero or more Extra devices contain information about other The following zero or more Extra devices contain information about other
devices known to the sending device. devices known to the sending device.
In the Address structure, the IP field can be of three differnt kinds; In the `Device` structure, field `DeviceID` is the SHA-256 (32 bytes) of the
device X.509 certificate, as explained in section _Device ID_.
In the `Address` structure, the IP field can be of three different kinds:
- A zero length indicates that the IP address should be taken from the - A zero length indicates that the IP address should be taken from the
source address of the announcement packet, be it IPv4 or IPv6. The source address of the announcement packet, be it IPv4 or IPv6. The
source address must be a valid unicast address. This is only valid source address must be a valid unicast address. This is only valid
in the first device structure, not in the list of extras. in the first device structure, not in the list of extras. In case of
global discovery, the discovery server will reply to a Query with an
announcement packet containing the expanded address of the queried
device ID as seen from the server, allowing to traverse the majority of
NAT devices.
- A four byte length indicates that the address is an IPv4 unicast - A four byte length indicates that the address is an IPv4 unicast
address. address.
@ -116,6 +150,12 @@ In the Address structure, the IP field can be of three differnt kinds;
- A sixteen byte length indicates that the address is an IPv6 unicast - A sixteen byte length indicates that the address is an IPv6 unicast
address. address.
Although the `port` field is 32-bit, the value should fit in a 16-bit unsigned
integer, since that is the size of a UDP port.
Query packet
------------
The Query packet has the following structure: The Query packet has the following structure:
0 1 2 3 0 1 2 3
@ -126,13 +166,23 @@ The Query packet has the following structure:
| Length of Device ID | | Length of Device ID |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
/ / / /
\ Device ID (variable length) \ \ Device ID \
/ / / /
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
This is the XDR encoding of: This is the XDR encoding of:
struct Announcement { struct Query {
unsigned int MagicNumber; unsigned int MagicNumber;
string DeviceID<>; opaque DeviceID<32>;
} }
Design rationale
----------------
At the beginning, also IPv4 was using multicast. It has been changed to
broadcast after some bugs, especially on Android.
[How device IDs work]: https://discourse.syncthing.net/t/how-device-ids-work/365
[RFC4506]: http://tools.ietf.org/html/rfc4506