Tissevert/pandoc
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
14374 commits 2 branches 0 tags 65 MiB
Commit graph

14374 commits

This branch
This branch
All branches
Author SHA1 Message Date
John MacFarlane
564c39beef Move setDefaultLanguage to T.P.Readers.LaTeX.Lang. 2021-02-28 09:49:34 -08:00
John MacFarlane
5e571d9635 LaTeX reader: remove two unnecessary parsers in inline. 
These are handled anyway by regularSymbol.
 2021-02-28 09:39:01 -08:00
John MacFarlane
7e83686d31 trypandoc: add 2 second timeout. 2021-02-28 09:24:37 -08:00
John MacFarlane
2faa57e8e9 Factor out T.P.Readers.LaTeX.Citation. 2021-02-28 09:12:09 -08:00
John MacFarlane
08231f5cdd Factor out T.P.Readers.LaTeX.Table. 2021-02-27 21:40:56 -08:00
John MacFarlane
925815bb33 Split off T.P.Readers.LaTeX.Accent. 
To help reduce memory demands compiling the main LaTeX reader.
 2021-02-27 17:02:44 -08:00
John MacFarlane
63123db22f Add xml-conduit to stack.yaml extra-deps. 2021-02-27 14:26:10 -08:00
John MacFarlane
cbc3f034ad Use skylighting 0.10.4. 
This version of skylighting uses xml-conduit rather than hxt.
This speeds up parsing of XML syntax definitions fourfold, and
removes four packages from pandoc's dependency graph:

hxt-charproperties
hxt-unicode
hxt-regex-xmlschema
hxt
 2021-02-27 14:26:10 -08:00
Albert Krewinkel
3327b225a1
Lua: use strict evaluation when retrieving AST value from the stack 
Fixes: #6674
 2021-02-27 21:57:12 +01:00
John MacFarlane
e798db14e8 Add tools/parseTimings.pl. 
A script to help pin down which modules take the most time
and memory to compile.
 2021-02-26 23:52:28 -08:00
John MacFarlane
c072b7cb59 CI: hide successes in linux test output. 2021-02-26 18:02:22 -08:00
John MacFarlane
a9cc5d2616 Update tests for changes to https URLs. 2021-02-26 18:00:45 -08:00
Salim B
fae6a204f1
Fix/update URLs and use HTTP**S** where possible (#7122) 2021-02-26 17:56:04 -08:00
Loïc Grobol
8123571e8e
Wrap url colours in braces in the default LaTeX template (#7121) 2021-02-26 10:05:30 -08:00
John MacFarlane
938f402dec CI: Add 'benchmark' to benchmark cache key. 
For benchmark we build with optimizations, so the regular
cache is useless.
 2021-02-22 23:24:13 -08:00
John MacFarlane
9767386676 Use latest skylighting. 2021-02-22 22:25:10 -08:00
John MacFarlane
d7cfa0ef4c Remove weigh-pandoc. 
It's not really useful any more, now that our regular
benchmarks include data on allocation.
 2021-02-22 22:10:20 -08:00
John MacFarlane
21d0b4745b benchmark CI improvements. 
- don't build tests, just benchmarks.
- get allocation info.
 2021-02-22 22:09:32 -08:00
John MacFarlane
15bf01cd63 Rename benchmark in CI. 2021-02-22 21:38:58 -08:00
John MacFarlane
56a6478a40 Add linux benchmark to CI. 2021-02-22 21:36:31 -08:00
John MacFarlane
f0a991a22b T.P.CSV: fix parsing of unquoted values. 
Previously we didn't allow unescaped quotes in unquoted values,
but they are allowed. Closes #7112.
 2021-02-22 21:18:04 -08:00
Albert Krewinkel
00e4bb51e4
tests: print accurate location if a test fails 
Ensures that tasty-hunit reports the location of the failing test
instead of the location of the helper `test` function.
 2021-02-22 23:56:04 +01:00
John MacFarlane
d30791a381 Fall back to latin1 if UTF-8 decoding fails... 
...when handling URL argument served with no charset in the mime type.
The assumption is that most pages that don't specify a charset
in the mime type are either UTF-8 or latin1.  I think that's a good
assumption, though I'm not sure.
 2021-02-22 14:17:22 -08:00
John MacFarlane
5a73c5d3f8 When downloading content from URL arguments, be sensitive to... 
the character encoding.  We can properly handle UTF-8 and
latin1 (ISO-8859-1); for others we raise an error.
See #5600.
 2021-02-22 14:01:10 -08:00
John MacFarlane
bafccd5aa2 T.P.Error: Add PandocUnsupportedCharsetError constructor... 
...for PandocError.  [API change]
 2021-02-22 14:01:04 -08:00
John MacFarlane
4617f229ea Text.Pandoc.MIME: add exported function getCharset. 
[API change]
 2021-02-22 13:28:47 -08:00
John MacFarlane
80fde18fb1 Text.Pandoc.UTF8: change IO functions to return Text, not String. 
[API change] This affects `readFile`, `getContents`, `writeFileWith`,
`writeFile`, `putStrWith`, `putStr`, `putStrLnWith`, `putStrLn`.
`hPutStrWith`, `hPutStr`, `hPutStrLnWith`, `hPutStrLn`, `hGetContents`.

This avoids the need to uselessly create a linked list of characters
when emiting output.
 2021-02-22 11:30:07 -08:00
John MacFarlane
607c014e9d Update changelog. 2021-02-21 22:05:50 -08:00
John MacFarlane
aae1e617a6 Fix changelog-helper.sh 2021-02-21 19:02:28 -08:00
John MacFarlane
2b37ed9f21 LaTeX reader: further optimizations in satisfyTok. 
Benchmarks show 2/3 of the run time and 2/3 of the allocation
of the Feb. 10 benchmarks.
 2021-02-21 11:30:17 -08:00
John MacFarlane
db4f882315 LaTeX reader: removed sExpanded in state. 
This isn't actually needed and checking it doesn't change
anything.

Also remove an unnecessary `doMacros` before `satisfyTok`,
which does it anyway.
 2021-02-21 11:24:04 -08:00
John MacFarlane
f43cb5ddcf LaTeX reader: further performance optimization. 
Avoid unnecessary 'doMacros'.
 2021-02-21 10:58:42 -08:00
John MacFarlane
c0c8865eaa HTML reader: small performance tweak. 2021-02-20 23:40:02 -08:00
John MacFarlane
d8ef383692 T.P.Shared: remove some obsolete functions [API change]. 
Removed:

- `splitByIndices`
- `splitStringByIndicies`
- `substitute`
- `underlineSpan`

None of these are used elsewhere in the code base.
 2021-02-20 23:02:10 -08:00
John MacFarlane
321343b2cf HTML reader: small efficiency improvements. 
Also, remove exported class NamedTag(..) [API change].
This was just intended to smooth over the transition from String to Text
and is no longer needed.

The functions isInlineTag and isBlockTag are no longer
polymorphic.
 2021-02-20 22:49:20 -08:00
John MacFarlane
cec541e54c LaTeX reader: Another small improvement to macro handling. 2021-02-20 22:14:31 -08:00
John MacFarlane
31b8f60ea8 LaTeX reader: avoid macro resolution code if no macros defined. 2021-02-20 22:03:29 -08:00
John MacFarlane
0f955b10b4 T.P.Readers.LaTeX.Parsing: improve braced'. 
Remove the parameter, have it parse the opening brace,
and make it more efficient.
 2021-02-20 18:57:46 -08:00
maurerle
6b7d614888
revealjs writer: add 'center' option for vertical slide centering. 
Closes #7104.
 2021-02-20 10:17:31 -08:00
John MacFarlane
36e745c678 Benchmark improvements. 
+ Run writer benchmarks for binary formats too.
+ Alphabetize benchmarks.
+ Don't run benchmarks for bibliography formats
  (yet; we need a special input for them).
 2021-02-20 00:28:10 -08:00
John MacFarlane
13847267e9 HTML reader: efficiency improvements. 
Do a lookahead to find the right parser to use.

Benchmarks from 34ms to 23ms, with less allocation.
Also speeds up the epub reader.
 2021-02-20 00:07:38 -08:00
John MacFarlane
fc335801ef MANUAL: block-level formatting is not allowed in line blocks. 
Closes #7107.
 2021-02-19 10:22:54 -08:00
John MacFarlane
b745bf3938 make bench: compare against a baseline, use datestamps for bench results. 2021-02-19 10:22:54 -08:00
Lorenzo
d68bbae552 Update default ODT style 
As of now, the default style for ODT documents has a "First paragraph" style that inherits from "Standard" style and has no top or bottom margin. All subsequent paragraphs have "Text_20_body" style that inherits from "Standard" and add "0.0598in" margins on top and bottom. This makes the final document a bit ugly since the first paragraph has a small gap ("0.0598in") towards the second one, and all subsequent have double that.

The proposed fix makes "First paragraph" inherit from "Text_20_body" instead so that it also has a consistent margin.

Another approach would be to inherit "Text_20_body" and add a 0 margin on top.
 2021-02-19 10:18:49 -08:00
John MacFarlane
5eedbb6e8e Clarify tex_math_dollars extension. 
Note that no blank lines are allowed between the delimiters
in display math.
 2021-02-19 09:22:17 -08:00
John MacFarlane
b2b32d9bb2 'make bench': Create csv files for comparison. 2021-02-18 23:22:18 -08:00
John MacFarlane
98d26c2345 DocBook, JATS, OPML readers: performance optimization. 
With the new XML parser, we can avoid the expensive tree
normalization step we used to do.

This gives a significant speed boost in docbook and JATS
parsing (e.g. 9.7 to 6 ms).
 2021-02-18 21:24:31 -08:00
John MacFarlane
ef642e2bbc T.P.XML Improve fromEntities. 2021-02-18 18:11:27 -08:00
John MacFarlane
0f5c56dfb1 T.P.PDF: disable smart when building PDF via LaTeX. 
This is to prevent accidental creation of ligatures like
`` ?` `` and `` !` `` (especially in languages with quotations
like German), and similar ligature issues.

See jgm/citeproc#54.
 2021-02-18 17:11:53 -08:00
John MacFarlane
005344fb18 Revert "LaTeX template: disable ` ? ` and ! `` ligatures." 
This reverts commit 24d7cd539b.
 2021-02-18 17:03:11 -08:00