On GitHub, facebook/duckling has picked up 4.3k stars, Haskell. Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
Duckling is a Haskell library that parses text into structured data.
"the first Tuesday of October"
=> {"value":"2017-10-03T00:00:00.000-07:00","grain":"day"}
Requirements
A Haskell environment is required. We recommend using
stack.
On Linux and MacOS you'll need to install PCRE development headers. On Linux,
use your package manager to install them. On MacOS, the easiest way to install
them is with Homebrew:
brew install pcre
If that doesn't help, try running brew doctor and fix the issues it finds.
Quickstart
To compile and run the binary:
stack build
stack exec duckling-example-exe
The first time you run it, it will download all required packages.
This runs a basic HTTP server. Example request:
curl -XPOST http://0.0.0.0:8000/parse --data 'locale=en_GB&text=tomorrow at eight'
In the example application, all dimensions are enabled by default. Provide the
parameter dims to specify which ones you want. Examples:
Identify credit card numbers only:
$ curl -XPOST http://0.0.0.0:8000/parse --data 'locale=en_US&text="4111-1111-1111-1111"&dims="["credit-card-number"]"'
If you want multiple dimensions, comma-separate them in the array:
$ curl -XPOST http://0.0.0.0:8000/parse --data 'locale=en_US&text="3 cups of sugar"&dims="["quantity","numeral"]"'
See exe/ExampleMain.hs for an example on how to integrate Duckling in your
project. If your backend doesn't run Haskell or if you don't want to spin your
own Duckling server, you can directly use wit.ai's built-in
entities.
Supported dimensions
Duckling supports many languages, but most don't support all dimensions yet
(we need your help!). Please look into
this directory
for language-specific support.
To regenerate the classifiers and run the test suite:
stack build :duckling-regen-exe && stack exec duckling-regen-exe && stack test
It's important to regenerate the classifiers after updating the code and before
running the test suite.
To extend Duckling's support for a dimension in a given language, typically 4
files need to be updated:
Duckling/<Dimension>/<Lang>/Rules.hs
Duckling/<Dimension>/<Lang>/Corpus.hs
Duckling/Dimensions/<Lang>.hs (if not already present in
Duckling/Dimensions/Common.hs)
Duckling/Rules/<Lang>.hs
To add a new language:
Make sure that the language code used follows the
ISO-639-1 standard.
The first dimension to implement is Numeral.
Follow
this example.
To add a new locale:
There should be a need for diverging rules between the locale and the
language.
Make sure that the locale code is a valid
ISO3166 alpha2 country code.
Follow
this example.
Rules have a name, a pattern and a production. Patterns are used to perform
character-level matching (regexes on input) and concept-level matching
(predicates on tokens). Productions are arbitrary functions that take a list of
tokens and return a new token.
The corpus (resp. negative corpus) is a list of examples that should (resp.
shouldn't) parse. The reference time for the corpus is Tuesday Feb 12, 2013 at
4:30am.
Duckling.Debug provides a few debugging tools:
$ stack repl --no-load
> :l Duckling.Debug
> debug (makeLocale EN $ Just US) "in two minutes" [Seal Time]
in|within|after <duration> (in two minutes)
-- regex (in)
-- <integer> <unit-of-duration> (two minutes)
-- -- integer (0..19) (two)
-- -- -- regex (two)
-- -- minute (grain) (minutes)
-- -- -- regex (minutes)
[Entity {dim = "time", body = "in two minutes", value = RVal Time (TimeValue (SimpleValue (InstantValue {vValue = 2013-02-12 04:32:00 -0200, vGrain = Second})) [SimpleValue (InstantValue {vValue = 2013-02-12 04:32:00 -0200, vGrain = Second})] Nothing), start = 0, end = 14}]
TopGit's metadata for facebook/duckling does not record a license. Most public repositories on GitHub ARE open source, but the exact terms vary — verify by opening the LICENSE file directly.
What is facebook/duckling?
facebook/duckling (facebook/duckling) is a Haskell project on GitHub. From the project's own README: Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
Where do I read more about facebook/duckling?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/facebook/duckling is the definitive source.
Read full README in the tab above.
Want a second opinion on duckling?
Ask an AI that can read this page — one click and you get its take on duckling.