Prof. Riehle's Industry and Research Publications

Wiki Creole Grammar, Schema, and Transformations

Please find below an EBNF grammar, XML schema, and XSLT transformations for Wiki Creole, currently in version 1.0. Wiki Creole is the first (and only) community standard for wiki markup.

These specifications were taken from the following two technical reports:

Wiki Creole EBNF grammar

Wiki Creole XML schema definition

Wiki Creole to XHTML transformation

XML to Wiki Creole transformation

It is pretty likely that despite our test suites, some bugs remain. So, if you find some, please let us know!

The best way to get in contact with us is to address Martin Junghans through the SourceForge WikiCreole project and cc: Dirk Riehle.

Comments

  1. 【整理】ANTLR应用案例 | 在路上

    […] Wiki Creole Grammar, Schema, and Transformations […]

    Reply
  2. tmont Avatar
    tmont

    I’m having trouble compiling this with ANTLR 3.2 (from the command line as recommended with increased heap size).
    The repeated error I’m seeing (in addition to about a hundred warnings) is “error(201): creole10.g:61:2: The following alternatives can never be matched: 2”.
    Is there a previous verson of ANTLR that will compile this without errors? Or am I barking up a dead tree?

    Reply
    1. Dirk Riehle Avatar
      Dirk Riehle

      Sorry, we are not actively using ANTLR any longer. We hope to have something much better out for WikiCreole though soon…

      Reply
  3. Martin Avatar
    Martin

    Hi Dave,
    we recommend not to use ANTLRworks for generating the scanner/parser. I do not remember why, but using ANTLR from command line is the proper way to go. Maybe you will also have to increase the size of memory for generation.
    Cheers, Martin

    Reply
  4. Dave Pawson Avatar
    Dave Pawson

    Processing the ‘without extensions’ .g file,
    using antlrworks 1.2.3 I’m getting 5 errors and 180 warnings.
    that’s from the command line.
    Has something changed?
    TIA DaveP

    Reply
  5. Luke Avatar
    Luke

    ok.. there’s n other thing i wanted to know..
    when i look past those warnings and try to compile the .java files in the directory, i get 13 errors, every single one about:
    Cannot find symbol
    Symbol: input
    What do I have to do to avoid this one?
    Why doesn’t
    input.LA(1)==DASH
    or sth. work?
    thanks
    luke

    Reply
  6. Luke Avatar
    Luke

    Hey people, great work..
    .. but:
    I’ve a problem with ANTLR and this grammar. When I try to generate the code via ANTLR 2.7.7 there’s always a nondeterminism between a huge amount of rules..
    which lookahead (k) should i take to wipe these out, but keep the efficiency high?
    thanks!
    luke

    Reply
  7. Dirk Riehle Avatar
    Dirk Riehle

    The difference between with_extension and without_extension is that the latter is a grammar (and related files) for the plain original Wiki Creole while with_extension is prepared by way of an additional token to be extended with new syntactic elements. So if all you want is what Wiki Creole 1.0 can give you, use without_extension, if you are thinking about adding your own new syntactic elements try using with_extension. The differences are minimal, just the hook for the extended syntax.
    As to the files, I’ll ask Martin, I think we might have to clean up this page; maybe you can already find what you are looking for at sf.net/projects/wikicreole?

    Reply
  8. Varun Avatar
    Varun

    Hello all,
    I had one question, might sound trivial to you. I would like to know whats the different between “with_extension” and “without_extension” in above files..?
    Second, Martin you had mailed (see above comments) Greg some XML documents he asked for, can you mail me the same, please?
    Thanks!

    Reply
  9. Martin Avatar
    Martin

    Hi Jose and everyone,
    The SourceForge Project Wiki Creole Parser is available. It generates scanner and parser from an ANTLR grammar file, parses a wiki page and transforms the parse tree to the XML interchange format.
    Please don’t hesitate to contact me with any questions or comments.

    Reply
  10. Jose Chillan Avatar
    Jose Chillan

    Hi,
    I am very interested in your work. I went to the sourceforge project and I saw no file was committed. Is there anywhere I could get the
    Tree Walker for the ANTLR grammar that produces the XML.
    Regards

    Reply
  11. Dirk Riehle Avatar
    Dirk Riehle

    Greg, Martin: I had been wondering about this for a while—we knew that the tree walker is missing from our publications, but then you can’t really publish some Java code.
    What you can do, of course, is create an open source project. So for that reason I created a SourceForge project called wikicreole a while back. Is there any interest on writing Tree Walker code for that project?

    Reply
  12. Martin Avatar
    Martin

    Hi Greg, you are right. We do rely on some code to transform a representation of the wiki after parsing to the XML representation. I’m not sure whether you can transform the parse tree (or AST) to XML by ANTLR’s domain specific language. We implemented a Java DFS parse tree walker that generates the XML file simultaneously. Regards, and I mail some files to you.

    Reply
  13. Greg Avatar
    Greg

    Hi guys. I’m interested in using this XML format as my intermediate (stored) stage. However, it seems that I’ll have to write the code (Java) to translate from Creole to ‘X-Creole’. I realise there’s an XSD, but would some of you have some example XML files for me to test with? Thanks!

    Reply
  14. Martin Avatar
    Martin

    V, first you have to consider that ANTLR generates LL(*) parsers, in contrast to your LR(1).
    We had to use the explicit input.LA statements since ANTLR chooses a derivation too early, i.e. even if other derivations are not wrong in respect to the current look-ahead. It does not increase the look-ahead as long as necessary to identify the only applicable derivation. Thus using the wrong derivation will result in an exception, even though the grammar is correct.
    The _grammar_ does not need these explicit queries to the look-ahead. But the _ANTLR grammar specification_ seems to need it auxiliary.
    If I recall LR(1)-parsers correctly, you can’t rely on the grammar specification for your parser generator only, because the WikiCreole language specification needs more look-ahead than 1.
    Nevertheless, good luck for your work!

    Reply
  15. V Avatar
    V

    Im trying to implement wikicreole using ocamlyacc or menhir (an LR1 parser for OCaml). But Wikicreole’s EBNF is using some ANTLR specific features (I think only this input.LA thing) that makes difficult to adapt to another parser generator … Does somebody have an idea about that?

    Reply
  16. Martien Avatar
    Martien

    Thanks Martin
    Problem solved when generating from the command line using org.antlr.tool.

    Reply
  17. Martin Avatar
    Martin

    @Martien
    ANTLRWorks does not always show the same behavior as ANTLR does. I couldn’t use ANTLRWorks for development as the grammar size magnified. Further you’ll probably have to scale up the size of heap memory for code generation, e.g. use the JVM option -Xmx1024M.

    Reply
  18. Martien Avatar
    Martien

    Generating code using ANTLRWorks 1.1.7 results in errors in rule text_bolditalcontent.
    I am a absolute novice on the subject and appreciate your help.

    Reply
  19. Dirk Riehle Avatar
    Dirk Riehle

    @marko: Fixed, thank you.

    Reply
  20. marko Avatar
    marko

    The EBNF links are broken: From the first one “wiki-creole/” must be removed, from the latter the quotation marks at the end.

    Reply

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.