Developed by an engineer frustrated with data transfer speeds, the new file copying tool Syq delivers faster transfer performance than rsync through parallel connections and TCP optimization.
Many of us spend our time exchanging vast amounts of data every day or synchronizing files between multiple computers. Server engineers, in particular, often spend a significant amount of time backing up and moving data. For a long time, we have taken it for granted to use a tool called ‘rsync’ (a tool for efficiently synchronizing files over a network) when moving files. However, a developer recently frustrated by the speed of rsync has introduced a new tool called ‘Syq’ that improves upon it [Source 12].
Why is this tool important?
As computer usage increases, the efficiency of file management becomes directly linked to work productivity. While the existing tool, rsync, is very powerful, it has drawbacks such as complex configuration and slower speeds when moving large amounts of data at once [Source 12]. The arrival of Syq provides a new option for users who want to manage their data more intelligently and quickly, going beyond simple file copying. It is especially practical that file transfers can be performed without separate SSH (Secure Shell: a protocol for securely accessing remote computers) server configuration, even in laptop environments where ports are closed for security [Source 8, Source 10].
The principle of Syq through analogy
Simply put, if the existing rsync is a truck carrying items one at a time along a narrow road, Syq is like a ‘highway system’ that divides the same road into multiple dedicated lanes, allowing several trucks to carry items simultaneously [Source 2].
Syq utilizes ‘parallel connections’ and ‘direct encrypted TCP (Transmission Control Protocol: a communication protocol that divides data into small segments for transmission and verification)’ technologies [Source 2]. This is the same principle as when we feel faster downloads by opening multiple browser windows. Another feature is that it goes beyond simple file movement, allowing you to automate file operations as if coding via a Python SDK (Software Development Kit) or JSON API (a method for exchanging data between programs) [Source 9, Source 10].
What is it like currently?
Syq currently demonstrates faster speeds than rsync when performing tasks such as file copying, organizing, and deleting in local environments or between multiple devices [Source 8, Source 10]. Users can preview what operations will occur using the --dry-run command and can achieve precise control with options like --srcs-in [Source 3, Source 10].
Of course, it is not perfect in every aspect. One of the powerful weapons of existing rsync, the ‘delta-merge algorithm’ (a technique that maximizes efficiency by transmitting only the differences when only a portion of a file has changed), has not yet been implemented in Syq [Source 1, Source 15]. Therefore, when file content has changed only slightly, the efficiency may differ from the existing tool in certain situations [Source 1].
Why the future is even more promising
Syq is currently focused on the automation of file operations and speed improvement. The developer has announced plans to implement a delta-merge algorithm or an improved version of it in the future [Source 1]. If this technology is successfully introduced, Syq is expected to become a tool that captures both speed and efficiency. If you are experiencing discomfort with file management, it would be a good idea to keep an eye on the development process of Syq.
MindTickleBytes’ AI Reporter’s Perspective Syq’s journey is promising in that it has made new technical attempts to improve speed, breaking the inertia of existing tools. In particular, the provision of a developer-friendly programming interface will be a great help in building data management systems beyond simple file movement.
References
- Show HN: Syq – copy files between machines fast (better than…)
- Show HN: Syq – copy files between machines fast (better than…)
- Show HN: Syq – 在机器间快速复制文件（比rsync更强）
-
[Syq - Fast programmable file operations · Hacker News Zeli](https://zeli.app/story/49644955) - Show HN: Syq – copy files between machines fast (better than …
- Show HN: Syq – copy files between machines fast (better than …
- I built a faster alternative to cp and rsync — here’s how it…
- GitHub - RsyncProject/rsync: An open source utility that provides fast…
- It uses a delta-merge algorithm
- It utilizes multiple parallel connections and TCP optimization
- It compresses files before transfer
- When moving files from server to server
- When sending files to a laptop or using a remote shell
- When copying large files to a local drive
- It perfectly replaces all features of rsync
- It has not yet implemented rsync's delta-merge algorithm
- You must write scripts using only Python