aboutsummaryrefslogtreecommitdiffstats
path: root/greek/CD/mirroring/index.wml
blob: c8360252ee44b096380d005af8faf63e03ec4b12 (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
#use wml::debian::cdimage title="Becoming a mirror for Debian CD images" BARETITLE=true
#use wml::debian::toc
#use wml::debian::translation-check translation="a2762a4686797f8bd714431c6bc466b37657847b" maintainer="galaxico"

<p>To become a Debian CD Image mirror site, you need a Linux or
Unix-like machine with a permanent, reliable connection to the
Internet. Debian CD mirrors hold <tt>.iso</tt> images for CDs and DVDs
of various sizes, files for <a
href="https://www.einval.com/~steve/software/jigdo/">jigdo</a> (<tt>.jigdo</tt> and
<tt>.template</tt>), <a
href="https://en.wikipedia.org/wiki/BitTorrent">BitTorrent</a> files
(<tt>.torrent</tt>) and verification files for the images
(<tt>SHA512SUMS*</tt> and <tt>SHA256SUMS*</tt>).</p>

<toc-display/>

#______________________________________________________________________

<toc-add-entry name="master">Master site</toc-add-entry>

<p><!-- There are two locations for mirroring, one for stable images and
one for beta/unstable/testing images. -->The URLs of the master site are
shown below - however, <strong>please</strong> consider mirroring from
another nearby mirror (mirror lists: <a
href="../http-ftp/">HTTP/FTP</a>, <a href="rsync-mirrors">rsync</a>)
if possible. Access to the master site may be restricted around
release time.</p>

<p>Also be aware that a <strong>huge</strong> amount of data is stored
in these directories - read the <a href="#exclude">section below</a>
for details on how to cut down the size by excluding certain
files.</p>

<ul>

  <li>Stable images (updated for each stable release):<br>

    <a href="https://cdimage.debian.org/debian-cd/"
    ><tt>https://cdimage.debian.org/debian-cd/</tt></a><br>

    <tt>rsync://cdimage.debian.org/debian-cd/</tt>

  </li>

  <li>Weekly images:<br>

    <a href="https://cdimage.debian.org/cdimage/weekly-builds/"
    ><tt>https://cdimage.debian.org/cdimage/weekly-builds/</tt></a><br>

    <tt>rsync://cdimage.debian.org/cdimage/weekly-builds/</tt>

  </li>

  <li>Daily images:<br>

    <a href="https://cdimage.debian.org/cdimage/daily-builds/"
    ><tt>https://cdimage.debian.org/cdimage/daily-builds/</tt></a><br>

    <tt>rsync://cdimage.debian.org/cdimage/daily-builds/</tt>

  </li>

</ul>
#______________________________________________________________________

<toc-add-entry name="httpftp">Mirroring using HTTP/FTP is
discouraged</toc-add-entry>

<p>You should not use FTP or HTTP to update your mirror. These
transfer methods have a high failure probability because of the
enormous size of the files.</p>

<p>Furthermore, HTTP and FTP do not include integrity checks of the
downloaded data, it is more likely that aborted downloads or data
corruption will go unnoticed.</p>
#______________________________________________________________________

<toc-add-entry name="rsync">Mirroring using rsync is
acceptable</toc-add-entry>

<p>The <a href="https://rsync.samba.org/"><kbd>rsync</kbd></a> program
is a good solution for mirroring. It is less efficient than the other,
Debian-specific mirroring solution below, but may be easier to set
up. Furthermore, it ensures that all files are transferred correctly
and that the metadata (e.g. timestamps) is kept in sync just like the
file data.</p>

<p>See the section <a href="#exclude">Excluding files from
mirroring</a> for examples of <kbd>--include</kbd> and
<kbd>--exclude</kbd> switches. The <a href="rsync-mirrors">list of
rsync mirrors</a> is available on a separate page.</p>

<p>Use at least the options <strong><kbd>--times --links --hard-links --partial
--block-size=8192</kbd></strong>. This will preserve modification time,
symlinks and hardlinks, and use a block size of 8192 bytes (most efficient
for CD images). When modification time and size are the same,
<kbd>rsync</kbd> will just leave the file alone, so <kbd>--times</kbd> is
really obligatory.</p>
#______________________________________________________________________

<toc-add-entry name="jigdolite">Mirroring using jigdo-lite is
discouraged</toc-add-entry>

<p>Recent versions of the <a
href="https://www.einval.com/~steve/software/jigdo/"><kbd>jigdo-lite</kbd></a> program
support batch downloading of multiple images. However, we do not
recommend to use <kbd>jigdo-lite</kbd> to create Debian CD mirrors -
use <kbd>jigdo-mirror</kbd> instead.</p>
#______________________________________________________________________

<toc-add-entry name="jigdomirror">Mirroring using jigdo-mirror is
recommended</toc-add-entry>

<p>Actually, this means: Mirror the <tt>.iso</tt> files using <a
href="https://www.einval.com/~steve/software/jigdo/"><kbd>jigdo-mirror</kbd></a>, then (if
you also want to mirror other types of files, e.g. <tt>.jigdo</tt> and
<tt>.template</tt> files) run rsync over the directory to fetch the
rest. The scripts on <a
href="http://www.acc.umu.se/~maswan/debian-push/cdimage/">this
page</a> might help when setting this up.</p>

<p>A lot of people maintain "regular" Debian mirrors
(<kbd>debian/</kbd>), or just have such a mirror nearby. This means
that they already have the <tt>.deb</tt>s that are included in the
CD/DVD images. The obvious question is -- why can't we use those same
files in the CD/DVD images?</p>

<p><kbd>jigdo-mirror</kbd> is a program that enables one to generate a
set of Debian CD/DVD images using the files from a "normal" mirror,
plus a few extra jigdo template files.</p>
 
<p>Firstly, you need the jigdo template files. See <a
href="../jigdo-cd">the jigdo information page</a> for links. Fetch the
files for each architecture you wish to build images for.</p>

<p>Create <kbd>~/.jigdo-mirror</kbd> file to configure the program.
This is an example:</p>

<pre>
jigdoDir="/where/you/keep/mirrors/debian-cd/current/jigdo"
imageDir="/where/you/keep/mirrors/debian-cd/current/images"
tmpDir="/where/you/keep/mirrors/debian-cd/current/images"
debianMirror="file:/where/you/keep/mirrors/debian"
include='i386/|sparc/|powerpc/|source/'; exclude='-1\.'
</pre>

<p>The <i>include</i> and <i>exclude</i> variables contain the list of
architectures you wish to create images for (regular expressions,
rather). For more information, see the <kbd>jigdo-mirror</kbd> manual
page or the source itself (it's a shell script with a lot of comments).</p>

<p>After you've configured it, simply run <kbd>jigdo-mirror</kbd> and it
will do everything on its own. It will make a lot of output and probably
take a while, so we suggest that you make steps to handle that (run it in
screen, redirect the output into a file etc).</p>
#______________________________________________________________________

<toc-add-entry name="pushmirror">How to become a push
mirror</toc-add-entry>

<p>Whenever new images are available, the master site can send a
message to its mirrors and make them start updating immediately. This
way, the new data is "pushed" out rather than "pulled" by the mirrors
during their next daily update, which leads to faster propagation of
new image releases.</p>

<p>If you want your mirror to be part of this update system, have a
look at <a href="http://www.acc.umu.se/~maswan/debian-push/cdimage/"
>this page</a>.</p>
#______________________________________________________________________

<toc-add-entry name="exclude">Excluding files from
mirroring</toc-add-entry>

<p>To reduce the amount of storage required by your Debian CD mirror,
you can exclude certain files from being mirrored. The following
instructions include command line switches for <kbd>rsync</kbd>, but
might help you even if you use a different tool for mirroring. With
<kbd>rsync</kbd>, <kbd>--include</kbd> and <kbd>--exclude</kbd>
switches are considered in order of appearance, and the first switch
whose file pattern matches determines whether the file is excluded or
included.</p>

<ul>

  <li><strong>Exclude source code:</strong>
  <kbd>--exclude=source/</kbd><br>

  This will prevent images containing source code from being
  mirrored. Note that some people consider it inappropriate to offer
  binaries of GPL-licensed programs on a server without also offering
  the programs' source code <em>on the same server</em>.</li>

  <li><strong>Exclude full images:</strong>
  <kbd>--include='*netinst*.iso'
  --exclude='*.iso'</kbd><br>

  Exclude all full CD/DVD image sets for all architectures,
  <em>but</em> mirror the net-install
  <tt>.iso</tt> images. We recommend always to mirror these small
  images: Relative to their size, they are extremely useful!</li>

  <li><strong>Exclude full images for non-i386 architectures:</strong>
  <kbd>--include='*netinst*.iso'
  --include='i386/**.iso' --exclude='*.iso'</kbd><br>

  As above, but <em>do</em> include all CD/DVD images for the i386
  architecture.</li>

  <li><strong>Exclude full images, except for i386 CDs 1 to
  3:</strong>
  <kbd>--include='*netinst*.iso' --include='i386/**-[1-3].iso'
  --exclude='*.iso'</kbd><br>

  The full set of i386 images may still take too much space for you if
  it includes DVD and dual-layer DVD images. This excludes all
  <tt>.iso</tt> images except for the net-install images and the first
  three i386 DVDs.</li>

  <li><strong>Exclude multiple architectures except i386:</strong>
  <kbd>--exclude=alpha/ --exclude=arm/ --exclude=hppa/ --exclude=hurd/
  --exclude=ia64/ --exclude=m68k/ --exclude=mips/ --exclude=mipsel/
  --exclude=powerpc/ --exclude=s390/ --exclude=sh/
  --exclude=sparc/</kbd><br>

  Only include the full set of files for i386, do not include any
  <tt>.jigdo</tt>, <tt>.iso</tt> etc files whatsoever for the other
  architectures.<br>

  <strong>Check the architecture list before mirroring - the list
  changes and these examples may be out of date!</strong></li>

</ul>
#______________________________________________________________________

<toc-add-entry name="names">Naming conventions and size requirements
for <tt>.iso</tt> images</toc-add-entry>

<p>The different variants of <tt>.iso</tt> images are distinguishable by
their names, allowing you to restrict the types of images you
mirror:</p>

<ul>

  <li><strong><tt>*-netinst.iso</tt></strong>: One image for each
  architecture, up to 500&nbsp;MB</li>

  <li><strong><tt>*-dvd.iso</tt></strong> (single-layer DVDs):
  Multiple images, each up to 4482&nbsp;MB large. For buster, there
  are up to <strong>16</strong> DVD images per architecture. Debian
  servers provide only a small subset of DVD images in .iso form for
  direct download: 3 for amd64, 3 for i386 and 1 each for other
  architectures. The remaining images are only provided in jigdo
  form.</li>

  <li><strong><tt>*-bd.iso</tt></strong> (single-layer Blu-Rays): As
  above, except that individual images are up to 23&nbsp;GB in
  size. These images are only available as jigdo files for a limited
  set of architectures (amd64 and i386) and source.</li>

  <li><strong><tt>*-dlbd.iso</tt></strong> (dual-layer Blu-Rays): As
  above, except that individual images are up to 48&nbsp;GB in
  size. These images are only available as jigdo files for a limited
  set of architectures (amd64 and i386) and source.</li>

  <li><strong><tt>*-STICK16GB*.iso</tt></strong> (16GB USB images): As
  above, except that individual images are up to 16&nbsp;GB in
  size. These images are only available as jigdo files for a limited
  set of architectures (amd64 and i386).</li>

</ul>
#______________________________________________________________________

<toc-add-entry name="register">Registering the mirror</toc-add-entry>

<p>To make your CD image mirror useful to a wider audience,
you can register it in our mirror list such as
<a href="../http-ftp/">this one</a> or <a href="rsync-mirrors">this one</a>.
However, since full images are large files, this might cause you
many gigabytes of network traffic per day.</p>

<p>You can register your mirror either by filling out
<a href="$(HOME)/mirror/submit">the mirror submission form</a>
(note that the CDImage-* fields are the important ones), or by
sending an e-mail to
<a href="&#109;&#97;&#105;&#108;&#116;&#111;&#58;debian-cd&#64;lists.debian.org">\
debian-cd&#64;lists.debian.org</a>.</p>

<p>We appreciate all new CD image mirrors. Thanks in advance!</p>

© 2014-2024 Faster IT GmbH | imprint | privacy policy