]> Lady’s Gitweb - Shushe/blob - README.markdown
Simplify recursive dependency error printing
[Shushe] / README.markdown
1 # ⛩️📰 书社
2
3 <b>An X·S·L·T‐based static site generator.</b>
4
5 <dfn>⛩️📰 书社</dfn> aims to make it easy to generate websites with
6 X·S·L·T and G·N·U Make.
7 It is consequently only a good choice for people who like X·S·L·T and
8 G·N·U Make and wish it were easier to make websites with them.
9
10 It makes things easier by :⁠—
11
12 - Automatically identifying source files and characterizing them by
13 type (X·M·L, text, or asset).
14
15 - Parsing supported text types into X·M·L trees.
16
17 - Enabling easy inclusion of source files within each other.
18
19 It aims to do this with zero dependencies beyond the programs already
20 installed on your computer.
21
22 ## Nomenclature
23
24 <i lang="cmn-Hans">书社</i> is a Chinese word meaning “publishing
25 house”.
26
27 The first character, <i lang="cmn-Hans">书</i>, is the simplified form
28 of “document”.
29
30 The second character, <i lang="cmn-Hans">社</i>, contemporarily means
31 “association”, but historically referred to the god of the soil and
32 related altars or festivities.
33 In Japanese, it is an alternate spelling for <i lang="ja">やしろ</i>,
34 the word for “Shinto shrine”.
35
36 The name <i lang="cmn-Hans">书社</i> was chosen to play on this pun, as
37 it is intended as a publishing program for webshrines.
38
39 In Ascii environments, ⛩️📰 书社 should be written `Shushe`, following
40 the pinyin transliteration.
41
42 ## Basic Usage
43
44 Place source files in `sources/` and run `make install` to compile
45 the result to `public/`.
46 Compilation involves the following steps :⁠—
47
48 1. ⛩️📰 书社 compiles all of the magic files in `magic/` into a single
49 file, `build/magic.mgc`.
50
51 2. ⛩️📰 书社 processes all of the parsers in `parsers/` and determines
52 the list of supported plaintext types.
53
54 3. ⛩️📰 书社 identifies all of the source files and includes and uses
55 `build/magic.mgc` to classify them by media type.
56
57 4. ⛩️📰 书社 parses all plaintext and X·M·L source files and includes
58 and then builds a dependency tree between them.
59
60 5. ⛩️📰 书社 uses the dependency tree to establish prerequisites for
61 each output file.
62
63 6. ⛩️📰 书社 compiles each output file to `build/public`.
64
65 7. ⛩️📰 书社 copies the output files to `public`.
66
67 You can use `make list` to list each identified source file or include
68 alongside its computed type and dependencies.
69 As this is a Make‐based program, steps will only be run if the
70 corresponding buildfile or output file is older than its
71 prerequisites.
72
73 ## Namespaces
74
75 The ⛩️📰 书社 namespace is `urn:fdc:ladys.computer:20231231:Shu1She4`.
76
77 This document uses a few namespace prefixes, with the following
78 meanings :⁠—
79
80 | Prefix | Expansion |
81 | -------: | :----------------------------------------- |
82 | `html:` | `http://www.w3.org/1999/xhtml` |
83 | `xlink:` | `http://www.w3.org/1999/xlink` |
84 | `xslt:` | `http://www.w3.org/1999/XSL/Transform` |
85 | `书社:` | `urn:fdc:ladys.computer:20231231:Shu1She4` |
86
87 ## Setup and Configuration
88
89 ⛩️📰 书社 depends on the following programs to run.
90 In every case, you may supply your own implementation by overriding the
91 corresponding (allcaps) variable (e·g, set `MKDIR` to supply your own
92 `mkdir` implementation).
93
94 - `awk`
95 - `cat`
96 - `cp`
97 - `date`
98 - `echo`
99 - `file`
100 - `find`
101 - `mkdir` (requires support for `-p`)
102 - `mv`
103 - `od` (requires support for `-t x1`)
104 - `printf`
105 - `rm`
106 - `sed`
107 - `sleep`
108 - `stat`
109 - `test`
110 - `touch`
111 - `tr` (requires support for `-d`)
112 - `uuencode` (requires support for `-m` and `-r`)
113 - `xargs` (requires support for `-0`)
114 - `xmlcatalog` (provided by `libxml2`)
115 - `xmllint` (provided by `libxml2`)
116 - `xsltproc` (provided by `libxslt`)
117
118 The following additional variables can be used to control the behaviour
119 of ⛩️📰 书社 :⁠—
120
121 - **`SRCDIR`:**
122 The location of the source files (default: `sources`).
123 Multiple source directories can be provided, so long as the same
124 file subpath doesn’t exist in more than one of them.
125
126 - **`INCLUDEDIR`:**
127 The location of source includes (default: `sources/includes`).
128 This can be inside of `SRCDIR`, but needn’t be.
129 Multiple include directories can be provided, so long as the same
130 file subpath doesn’t exist in more than one of them.
131
132 - **`BUILDDIR`:**
133 The location of the (temporary) build directory (default: `build`).
134 `make clean` will delete this, and it is recommended that it not be
135 used for programs aside from ⛩️📰 书社.
136
137 - **`DESTDIR`:**
138 The location of directory to output files to (default: `public`).
139 `make install` will overwrite files in this directory which
140 correspond to those in `SRCDIR`.
141 It *will not* touch other files, including those generated from files
142 in `SRCDIR` which have since been deleted.
143
144 Files are first compiled to `$(BUILDDIR)/public` before they are
145 copied to `DESTDIR`, so this folder is relatively quick and
146 inexpensive to re·create.
147 It’s reasonable to simply delete it before every `make install` to
148 ensure stale content is removed.
149
150 - **`THISDIR`:**
151 The location of the ⛩️📰 书社 `GNUmakefile`.
152 This should be set automatically when calling Make and shouldn’t ever
153 need to be set manually.
154 This variable is used to find the ⛩️📰 书社 `lib/` folder, which is
155 expected to be in the same location.
156
157 - **`MAGICDIR`:**
158 The location of the magic files to use (default: `$(THISDIR)/magic`).
159
160 - **`FINDRULES`:**
161 Rules to use with `find` when searching for source files.
162 The default ignores hidden files, those that start with a period or
163 hyphen‐minus, and those which contain a pipe, buck, or colon.
164
165 - **`FINDINCLUDERULES`:**
166 Rules to use with `find` when searching for includes (default:
167 `$(FINDRULES)`).
168
169 - **`PARSERS`:**
170 A white·space‐separated list of parsers to use (default:
171 `$(THISDIR)/parsers/*.xslt`).
172
173 - **`TRANSFORMS`:**
174 A white·space‐separated list of transforms to use (default:
175 `$(THISDIR)/transforms/*.xslt`).
176
177 - **`XMLTYPES`:**
178 A white·space‐separated list of media types to consider X·M·L
179 (default: `application/xml text/xml`).
180
181 - **`VERBOSE`:**
182 If this variable has a value, every recipe instruction will be
183 printed when it runs (default: empty).
184 This is helpful for debugging, but typically too noisy for general
185 usage.
186
187 ## Source Files
188
189 Source files may be placed in `SRCDIR` in any manner; the file
190 structure used there will match the output.
191 The type of source files is *not* determined by file extension, but
192 rather by magic number; this means that files **must** begin with
193 something recognizable.
194 Supported magic numbers include :⁠—
195
196 - `<?xml` for `application/xml` files
197 - `#!js` for `text/javascript` files
198 - `@charset "` for `text/css` files
199 - `#!tsv` for `text/tab-separated-values` files
200 - `%%` for `text/record-jar` files (unregistered; see
201 [[draft-phillips-record-jar-01][]])
202
203 Text formats with associated X·S·L·T parsers are wrapped in a H·T·M·L
204 `<script>` element whose `@type` gives its media type, and then
205 passed to the parser to process.
206 Source files whose media type does not have an associated X·S·L·T
207 parser are considered “assets” and will not be transformed.
208
209 **☡ For compatibility with this program, source filenames must not
210 contain Ascii whitespace, colons (`:`), pipes (`|`), bucks (`$`),
211 percents (`%`) or control characters, and must not begin with a
212 hyphen‐minus (`-`).**
213 The former characters have the potential to conflict with make syntax,
214 and a leading hyphen‐minus is confusable for a command‐line argument.
215
216 ## Parsers
217
218 Parsers are used to convert plaintext files into X·M·L trees, as well
219 as convert plaintext formats which are already included inline in
220 existing source X·M·L documents.
221 ⛩️📰 书社 comes with some parsers; namely :⁠—
222
223 - **`parsers/plain.xslt`:**
224 Wraps `text/plain` contents in a `<html:pre class="plain">` element.
225
226 - **`parsers/record-jar.xslt`:**
227 Converts `text/record-jar` contents into a
228 `<html:div class="record-jar">` of `<html:dl>` elements (one for
229 each record).
230
231 - **`parsers/tsv.xslt`:**
232 Converts `text/tab-separated-values` contents into an
233 `<html:table class="tsv">` element.
234
235 New ⛩️📰 书社 parsers which target plaintext formats should have an
236 `<xslt:template>` element with no `@name` or `@mode` and whose
237 `@match` attribute…
238
239 - Starts with an appropriately‐namespaced qualified name for a
240 `<html:script>` element.
241
242 - Follows this with the string `[@type=`.
243
244 - Follows this with a quoted string giving a media type supported by
245 the parser.
246 Media type parameters are *not* supported.
247
248 - Follows this with the string `]`.
249
250 For example, the trivial `text/plain` parser is defined as follows :⁠—
251
252 ```xml
253 <?xml version="1.0"?>
254 <transform
255 xmlns="http://www.w3.org/1999/XSL/Transform"
256 xmlns:html="http://www.w3.org/1999/xhtml"
257 version="1.0"
258 >
259 <template match="html:script[@type='text/plain']">
260 <html:pre><value-of select="."/></html:pre>
261 </template>
262 </transform>
263 ```
264
265 ⛩️📰 书社 will scan the provided parsers for this pattern to determine
266 the set of allowed plaintext file types.
267 Multiple such `<xslt:template>` elements may be provided in a single
268 parser, for example if the parser supports multiple media types.
269 Alternatively, you can set the `@书社:supported-media-types` attribute
270 on the root element of the parser to override media type support
271 detection.
272
273 Parsers can also target specific dialects of X·M·L, in which case they
274 operate on the same basic principles as transforms (described below).
275 The major distinction between X·M·L parsers and transforms is where in
276 the process the transformation happens:
277 Parsers are applied *prior* to embedding (and can be used to generate
278 embeds); transforms are applied *after*.
279
280 It is **strongly recommended** that auxillary templates in parsers be
281 namespaced (by `@name` or `@mode`) whenever possible, to avoid
282 conflicts between parsers.
283
284 ## Embedding
285
286 Documents can be embedded in other documents using a `<书社:link>`
287 element with `@xlink:show="embed"`.
288 The `@xlink:href`s of these elements should have the format
289 `about:shushe?source=<path>`, where `<path>` provides the path to the
290 file within `SRCDIR`.
291 Includes, which do not generate outputs of their own but may still be
292 freely embedded, instead use the format
293 `about:shushe?include=<path>`, where `<path>` provides the path
294 within `INCLUDEDIR`.
295
296 Embeds are replaced with the parsed contents of a file, unless the file
297 is an asset, in which case an `<html:object>` element is produced
298 instead (with the contents of the asset file provided as a base64
299 `data:` u·r·i).
300
301 Embedding takes place after parsing but before transformation, so
302 parsers are able to generate their own embeds.
303 ⛩️📰 书社 is able to detect the transitive embed dependencies of files
304 and update them accordingly; it will signal an error if the
305 dependencies are recursive.
306
307 ## Transforms
308
309 Transforms are used to convert X·M·L files into their final output,
310 after all necessary parsing and embedding has taken place.
311 ⛩️📰 书社 comes with some transforms; namely :⁠—
312
313 - **`transforms/attributes.xslt`:**
314 Applies transforms to the children of any `<书社:apply-attributes>`
315 elements, and then applies the attributes of the
316 `<书社:apply-attributes>` to each result child, replacing the
317 element with the result.
318 This is useful in combination with image embeds to apply alt‐text to
319 the resulting `<html:img>`.
320
321 - **`transforms/asset.xslt`:**
322 Converts `<html:object>` elements which correspond to recognized
323 media types into the appropriate H·T·M·L elements, and deletes
324 `<html:style>` elements from the body of the document and moves
325 them to the head.
326
327 - **`transforms/metadata.xslt`:**
328 Provides basic `<html:head>` metadata.
329 This metadata is generated from `<html:meta>` elements with one of
330 the following `@itemprop` attributes :⁠—
331
332 - **`urn:fdc:ladys.computer:20231231:Shu1She4:title`:**
333 Provides the title of the page.
334
335 ⛩️📰 书社 automatically encapsulates embeds so that their metadata
336 does not propogate up to the embedding document.
337 To undo this behaviour, remove the `@itemscope` and `@itemtype`
338 attributes from the embed during the transformation phase.
339
340 The following are recommendations on effective creation of
341 transforms :⁠—
342
343 - Make template matchers as specific as possible.
344 It is likely an error if two transforms have templates which match
345 the same element (unless the templates have different priority).
346
347 - Namespace templates (with `@name` or `@mode`) whenever possible.
348
349 - Set `@exclude-result-prefixes` on the root `xslt:transform` element
350 to reduce the number of declared namespaces in the final result.
351
352 The params `$buildtime`, `$srctime`, and `$path` are available within
353 transforms and are initialized to the current time, the time that the
354 source file was last modified, and the path of the output file within
355 $(DESTDIR).
356
357 ## Output Wrapping
358
359 ⛩️📰 书社 will wrap the final output of the transforms in appropriate
360 `<html:html>` and `<html:body>` elements, so it is not necessary for
361 transforms to do this explicitly.
362 After performing the initial transform, ⛩️📰 书社 will match the root
363 node of the result in the following modes to fill in areas of the
364 wrapper :⁠—
365
366 - **`书社:header`:**
367 The result of matching in this mode is prepended into the
368 `<html:body>` of the output (before the transformation result).
369
370 - **`书社:footer`:**
371 The result of matching in this mode is appended into the
372 `<html:body>` of the output (after the transformation result).
373
374 - **`书社:metadata`:**
375 The result of matching in this mode is inserted into the
376 `<html:head>` of the output.
377
378 In addition to being called with the transform result, each of these
379 modes will additionally be called with a `<xslt:include>` element
380 corresponding to each transform.
381 If a transform has a `<书社:id>` top‐level element whose value is an
382 i·r·i, its `<xslt:include>` element will have a corresponding
383 `@书社:id` attribute.
384 This mechanism can be used to allow transforms to insert content
385 without matching any elements in the result; for example, the
386 following transform adds a link to a stylesheet to the `<html:head>`
387 of every page :⁠—
388
389 ```xml
390 <?xml version="1.0"?>
391 <transform
392 xmlns="http://www.w3.org/1999/XSL/Transform"
393 xmlns:html="http://www.w3.org/1999/xhtml"
394 xmlns:xslt="http://www.w3.org/1999/XSL/Transform"
395 xmlns:书社="urn:fdc:ladys.computer:20231231:Shu1She4"
396 exclude-result-prefixes="书社"
397 version="1.0"
398 >
399 <书社:id>example:add-stylesheet-links.xslt</书社:id>
400 <template match="xslt:include[@书社:id='example:add-stylesheet-links.xslt']" mode="书社:metadata">
401 <html:link rel="stylesheet" type="text/css" href="/style.css"/>
402 </template>
403 </transform>
404 ```
405
406 Output wrapping can be entirely disabled by adding a
407 `@书社:disable-output-wrapping` attribute to the top‐level element in
408 the result tree.
409
410 ## License
411
412 Source files are licensed under the terms of the <cite>Mozilla Public
413 License, version 2.0</cite>.
414 For more information, see [LICENSE](./LICENSE).
415
416 [draft-phillips-record-jar-01]: <https://datatracker.ietf.org/doc/html/draft-phillips-record-jar-01>
This page took 0.065208 seconds and 5 git commands to generate.