v0.10.5

This maintenance release fixes a number of small bugs that have cropped up in production use of the v0.10 series. Using the frametricks package no longer causes crashes, your table of contents justification won't be wonky, and passing functions as content is working as expected again. As an added bonus it is possible to process the content passed to functions / macros more than once if desired.

One minor new feature slipped in as well. In addition to the letter-space system that added glue nodes between every glyph there is now a setting for true tracking (that won't break hyphenation or other features). Packages might also appreciate the improved dependency detection and quick self-check that verifies everything is in working order without running the whole test suite.

Note that while Lua 5.4.0 was released a couple days ago, this release officially only supports Lua through the latest 5.3 release. It may or may not work on Lua 5.4 yet, we haven't tested.

Features

• build: Add make check fast self-check target, fixes #835 (89cefef)
• shaper: Add tracking setting and implement for harfbuzz (9e1dec7)

Bug Fixes

• build: Check for luarocks if not configured --with-system-luarocks (e8770ce)
• core: Account for possibility that there are no working fallbacks (391f44e)
• core: Gracefully do nothing when SILE.process() passed nothing (1085049)
• core: Revamp macro system to fix #535 (47a0af8)
• frames: Avoid possible infinite loop when looking for a frame (157dfc8)
• frames: Rely on __tostring() meta method, toString() is no more (77b8956)
• nodes: Fix calling non-existent nodefactory function (#864) (9580a15)
• packages: Center dotfill in the event only one dot fits (95181d2)
• packages: Don't let dotfill content be stretchy (079ff97)

v0.10.4

Most of the changes in this release are either related to the tooling to build and package it smoothly or minor. Some English users might appreciate that their Table of Contents headers for otherwise English books aren't localized in Turkish, and Japanese users will have an easier time with their Tate layouts because they cooperate with the new measurement systems introduced in v0.10.

Not properly mentioned in the ChangeLog is a tweak that allows Glues to be cast to Lengths. This makes it much easier to create measurements based on existing nodes as references.

Bug Fixes

• build: Fix version detection in sparse git checkouts (#803) (#818) (dcd0023)
• core: Return correct length from icu.bidi_runs with surrogate pairs (000515f), closes #839
• docker: Work around fresh GNU coreutils bombing Docker Hub (#851) (ed49fbb)
• languages: Localize TOC title functions (#849) (1ab4345)
• packages: Update PDF package to use correct measurement types (79e24ca)
• packages: Update Tate package to use correct measurement types (180024f)
• tooling: Add missing lua-cosmo dependency for Markdown class (#822) (ea81598)
• typesetter: Make typesetter.breakwidth a measurement (721280d)

v0.10.3

This release is essentially the same as v0.10.2, but with all the Lua module dependencies bundled again. The previous release would only build either with system provided Lua dependencies or with internet access to download them via luarocks; it was not fully self contained and hence could not be built on some systems.

Bug Fixes

• tooling: Make sure Lua modules get included in source tarball (ef5bb53)
• tooling: Unblock standard-version release number bumping (7b18cd5), closes #816

v0.10.2

This release primarily fixes minor packaging issues. The biggest change is this will be the first release with an officially supported Ubuntu PPA!

• build: Don't include build *.so modules in dist (4eb2a73)
• build: Fix version detection in sparse git checkouts (#803) (e46091f)
• build: Include modules for all supported Lua versions in dist (a4e9f03)
• build: Look for Lua 5.3 executables with the version in their name (3952bf8)

v0.10.1

See the included CHANGELOG.md or review the commit history for more explicit details.

Summary of Improvements

This is a small follow up to the v0.10.0 release last week to fix a regression that cropped up and add deprecation warning messages. The last release went out with several major changes, particularly to the node and length APIs. Compatibility shims are in place so that old code still works for now, but this adds warning messages to make it easier to find and track down things that need updating.

Additionally since the last release cycle Docker images have been made available, and now support mapping system fonts into the Docker image.

Notable Bug Fixes

• backends: Implement cursor tracking to roughly simulate glues (26afcec)
• core: Actually deprecate old nodefactory instantiators (774f0fc)
• measurements: Actually deprecate old constructors (bfdb1b8)
• nodes: Fix pushHbox() regression, recognize zerohoxes (#789) (dae51f1)

New Features

• backends: Approximate space and break in text output to PDF (9577ae4)
• docker: Add dockerfile and setup to build an image (4424d44)
• docker: Add method to inject fonts into Docker container (104124a)

v0.10.0

See the included CHANGELOG.md or review the commit history for more explicit details.

Summary of Improvements

Most of the many, many improvements in this release are under the hood.
The build and test systems have been significantly overhauled, the release process has been streamlined and partially automated, continuous integration now tests code quality and commit messages, and there has been an enormous amount of code refactoring.
All of these things make for a more readable code base and a more reliable and maintainable development environment, which we hope will facilitate SILE development in the future.
Creating installers should be easier for most platforms than in previous releases, and we hope future releases will come with more pre-built packages.

There are also some user-facing improvements:

• Installation is made easier, as SILE will now download and bundle the Lua modules that it requires.
  For those who have their own Lua installation and wish to make use of dependent modules installed with luarocks or their system's package manager, use the --with-system-luarocks argument to ./configure.
• Error and warning reporting has been improved; SILE will now tell you where in the document any errors occurred and (with the --trace option) the stack of commands it took to get there.
• Language support:
  • Fixes to hyphenation in Danish, Greek, Finnish, and Ukrainian.
  • French punctuation conventions are followed, with (optional) non-breaking spaces before high punctuation marks.
  • Numbers can now be formatted as ordinals (at least for English and Turkish), by using the counter display type nth, and as words using the string display type.
• A new text backend is available to dump a text-only version of the rendering process.
  This can much more accurate that extracting text versions from a PDF later for search indexing or similar purposes.
• Improvements to tracking & letter spacing.
• Dependency system: sile -m will output a Makefile snippet showing all the files required to build a SILE document.
• Adding the toc=false option to a book section or subsection will cause it not to be added to the table of contents.
• Added a man page for quick reference of CLI options.

Notable Bug Fixes

• Boustrophedon, grid, and simpletable packages now work again.
• Temporarily switching away from fonts specified by filename into a verbatim environment won't crash any more.

⚠ BREAKING CHANGE

This removes the auto-guessing file extension mechanism that allowed *.sil files to be loaded without specifying the full file name with extensions.

A command like sile test will no longer find and build sile.sil, you must run sile test.sil.
The mechanism that was doing this was a hack than only worked in some scenarios anyway, and dropping it instead of trying to cover all the edge cases will make it that much easier to use and document.
Importantly it avoids edge cases where both *.xml, *.sil, and/or *.lua files all have the same name and the loader really has so idea which one you mean.

Note that packages may still be loaded with no file extension, this does not affect the require() mechanism that looks for *.lua and various other incantations by default.

Scheduled Deprecations

This release renames and deprecates many internal functions and classes.
Most notably the default library used for class models has changed from std to penlight.
Old methods are still available for now, but those developing external Lua packages and classes will want to check the wiki for instructions on how to update their code.
The next release cycle will start throwing warnings when these deprecated functions are called, and the following cycle will remove them entirely.

v0.9.5.1

No code changes. Fix tarball. Some unrelated files (including some binaries) crept into the release.

v0.9.5

New in v0.9.5:

• Experimental package manager.

• The "smart" bare percent unit (where SILE guessed whether you meant height or width) has now moved from deprecated to error. Replace with %pw etc.

• Language support: variable spaces in Amharic (and other languages if enabled with the shaper.variablespaces setting), improvements to Japanese Ruby processing, Uyghur hyphenation revisited and improved, Armenian hyphenation added.

• You can now set the stretch and shrink values of a space using the shaper.spaceenlargementfactor, shaper.spaceshrinkfactor and shaper.spacestretchfactor settings.

• You can use - as input filename to pipe in from standard input, and - as output filename to pipe generated PDF to standard output.

• New letter class.

• New commands: \neverindent and \cr

• New units: ps (parskip) and bs (baselineskip)

• Links generated via the url package are hyperlinked in the PDF.

• You can now style folios (page numbers) by overriding the \foliostyle macro.

• Languages may define their own counting functions by providing a counter function; you may also lean on ICU's number formatting to format numbers.

• ICU is now required for correct Unicode processing.

• Experimental support for SVG graphics and fonts. (see tests/simplesvg.sil)

• Users may select the Harfbuzz subshaping system used (coretext, graphite, fallback etc.) by setting the harfbuzz.subshapers setting.

• Fix typos in documentation (Thanks to Sean Leather, David Rowe).

Most other changes in this release are internal and non-user-visible, including:

• Introduced vertical kern nodes.

• Various fixes to pushback (end of page) logic, bidi implementation. ICU is now used for bidi.

• Updated various examples to work with current internals.

• Many and varied internal fixes and speedups, and improved coding style.

v0.9.4

Nearly 600 changes, including:

• New packages include: letter spacing, multiple line spacing methods, Japanese Ruby, font specimen generator, crop marks, font fallback, set PDF background color.
• Fixed handling of font weight and style.
• Hyphenation: Correct hyphenation of Indic scripts, words with non-alphabetic characters in them, and allow setting hyphen character and defining hyphenation exceptions.
• Relative dimensions ("1.2em") are converted to absolute dimensions at point of use, not point of declaration. So you can set linespacing to 1.2em, change font size, and it'll still work.
• Default paper size to A4.
• Changes to semantics of percent-of-page and percent-of-frame length specifications. (width=50% etc.)
• Much improved handling of footnotes, especially in multicolumn layouts.
• Support for: the libthai line breaking library, color fonts, querying the system font library on OS X, multiple Amharic justification conventions.
• Added explicit kern nodes.
• Changed to using Harfbuzz for the text processing pipeline; much faster, and much more accurate text shaping.
• Rewritten and more accurate bidirectional handling.
• Removed dependency on FreeType; use Harfbuzz for font metrics.
• Fixed the definition of an em. (It's not the width of a letter "m".)

and much more besides.

v0.9.3

Version 0.9.3 (2015-10-09)

• Support for typesetting Japanese according to the JIS X 4051 standard, both horizontally and vertically.
• Unicode line-breaking support; scripts now line-break correctly even if they don't have specific language support. Optionally uses the ICU library if installed.
• Font designers rejoice: you can now say \font[filename=...] to use uninstalled fonts.
• Pango/Cairo support is now officially deprecated. Stop using it!
• Improvements to USX Bible processing.
• Experimental support for Structured PDF generation.
• Support for Opentype kerning.
• Support for custom frame direction (e.g. "TTB-LTR" for Mongolian).
• Support for many-way parallel texts across pages or spreads.
• Line breaking support for Myanmar, Javanese and Uyghur.
• Support for boustrophedon Greek. No, really.
• Various fixes to bidirectionality, discretionary hyphens, insertions, footnotes, grid typesetting, alignment.
• Under-the-hood advancements for Harfbuzz.