Library
Module
Module type
Parameter
Class
Class type
Asynchronous programming with promises.
A promise is a placeholder for a single value which might take a long time to compute. Speaking roughly, a promise is a ref
that can be filled in later. To make that precise, here is how promises differ from ref
s:
So, promises are optional, write-once references, and when they don't yet have a value, they store a list of callbacks that are waiting for the value.
The waiting callbacks make promises a natural data type for asynchronous programming. For example, you can ask Lwt to read
a file. Lwt immediately returns you only a promise for the data.
You can neglect this promise for a while. You can do some other computation, request more I/O, etc. At some point, you might decide to attach a callback to the read
promise, maybe several callbacks.
In the meantime, the read
operation is running in the background. Once it finishes, Lwt resolves the read
promise by putting the data into it. Lwt then runs the callbacks you attached.
One of those might take the data, and ask Lwt to write
it to STDOUT. Lwt gives you a promise for that, too, and the process repeats.
Lwt has a small amount of syntactic sugar to make this look as natural as possible:
let () =
Lwt_main.run begin
let%lwt data = Lwt_io.(read_line stdin) in
let%lwt () = Lwt_io.printl data in
Lwt.return ()
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix echo.ml && ./a.out *)
This is all explained in the next sections:
After that is the reference proper, which goes into painful levels of detail on every single type and value in this module, Lwt
. Please be safe, and read only what you need from it :)
Happy asynchronous programming!
All of Lwt is variations on:
'a
Lwt.t
are placeholders for values of type 'a
.Lwt.bind
attaches callbacks to promises. When a promise gets a value, its callbacks are called.'a
Lwt.u
are used to write values into promises, through Lwt.wakeup_later
.Lwt.task
. Lwt I/O functions call Lwt.task
internally, but return only the promise.Lwt_main.run
is used to wait on one “top-level” promise. When that promise gets a value, the program terminates.Let's read from STDIN. The first version is written using ordinary values from the OCaml standard library. This makes the program block until the user enters a line:
let () =
let line : string =
Pervasives.read_line () in
print_endline "Now unblocked!";
ignore line
(* ocamlfind opt -linkpkg code.ml && ./a.out *)
If we use a promise instead, execution continues immediately:
let () =
let line_promise : string Lwt.t =
Lwt_io.(read_line stdin) in
print_endline "Execution just continues...";
ignore line_promise
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
Indeed, this program is a little too asynchronous – it exits right away! Let's force it to wait for line_promise
at the end by calling Lwt_main.run
:
let () =
let line_promise : string Lwt.t =
Lwt_io.(read_line stdin) in
print_endline "Execution just continues...";
let line : string =
Lwt_main.run line_promise in
ignore line
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
Lwt_main.run
should only be called once, on one promise, at the top level of your program. Most of the time, waiting for promises is done using let%lwt
. That is the recommended syntactic sugar for Lwt.bind
, and is pronounced “bind”:
let () =
let p : unit Lwt.t =
let%lwt line_1 = Lwt_io.(read_line stdin) in
let%lwt line_2 = Lwt_io.(read_line stdin) in
Lwt_io.printf "%s and %s\n" line_1 line_2
in
Lwt_main.run p
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
The way that works is everything in scope after the “in
” in “let%lwt x =
... in
...” goes into a callback, and “x
” is that callback's argument. So, we could have been very explicit, and written the code like this:
let () =
let p : unit Lwt.t =
let line_1_promise : string Lwt.t = Lwt_io.(read_line stdin) in
Lwt.bind line_1_promise (fun (line_1 : string) ->
let line_2_promise : string Lwt.t = Lwt_io.(read_line stdin) in
Lwt.bind line_2_promise (fun (line_2 : string) ->
Lwt_io.printf "%s and %s\n" line_1 line_2))
in
Lwt_main.run p
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
But, as you can see, this is verbose, and the indentation gets a bit crazy. So, we will always use let%lwt
.
The code above reads two lines in sequence, because we ask Lwt to wait for line_1
, before calling the second Lwt_io.read_line
in the callback, to start the second I/O.
We could also run I/O concurrently. All we have to do is not start the second I/O in a callback of the first. Because it doesn't make sense to read two lines from STDIN concurrently, let's start two waits instead:
let () =
Lwt_main.run begin
let three_seconds : unit Lwt.t = Lwt_unix.sleep 3. in
let five_seconds : unit Lwt.t = Lwt_unix.sleep 5. in
let%lwt () = three_seconds in
let%lwt () = Lwt_io.printl "3 seconds passed" in
let%lwt () = five_seconds in
Lwt_io.printl "Only 2 more seconds passed"
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
This program takes about five seconds to run. We are still new to let%lwt
, so let's desugar it:
let () =
Lwt_main.run begin
let three_seconds : unit Lwt.t = Lwt_unix.sleep 3. in
let five_seconds : unit Lwt.t = Lwt_unix.sleep 5. in
(* Both waits have already been started at this point! *)
Lwt.bind three_seconds (fun () ->
(* This is 3 seconds later. *)
Lwt.bind (Lwt_io.printl "3 seconds passed") (fun () ->
Lwt.bind five_seconds (fun () ->
(* Only 2 seconds were left in the 5-second wait, so
this callback runs 2 seconds after the first callback. *)
Lwt_io.printl "Only 2 more seconds passed")))
end
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
And that's it! Concurrency in Lwt is simply a matter of whether you start an operation in the callback of another one or not. As a convenience, Lwt provides a few helpers for common concurrency patterns.
It's important to understand that promises are a pure-OCaml data type. They don't do any fancy scheduling or I/O. They are just lists of callbacks (if pending), or containers for one value (if resolved).
The interesting function is Lwt_main.run
. It's a wrapper around select(2)
, epoll(7)
, kqueue(2)
, or whatever asynchronous I/O API your system provides. On browsers, the work of Lwt_main.run
is done by the surrouding JavaScript engine, so you don't call Lwt_main.run
from inside your program. But the execution model is still the same, and the description below applies!
To avoid writing out “underlying asynchronous I/O API,” we'll assume, in this section, that the API is select(2)
. That's just for the sake of abbreviation. It doesn't actually matter, for most purposes, what the underlying I/O API is.
Let's use the program from the tutorial that reads two lines as an example. Here it is, again, in its desugared form:
let () =
let p : unit Lwt.t =
let line_1_promise : string Lwt.t = Lwt_io.(read_line stdin) in
Lwt.bind line_1_promise (fun (line_1 : string) ->
let line_2_promise : string Lwt.t = Lwt_io.(read_line stdin) in
Lwt.bind line_2_promise (fun (line_2 : string) ->
Lwt_io.printf "%s and %s\n" line_1 line_2))
in
Lwt_main.run p
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
Lwt_main.run
is your program's main I/O loop. You pass it a single promise, and it:
select(2)
to put your process to sleep until the next I/O completes.line_1
. Lwt_main.run
knows that I/O is supposed to resolve line_1_promise
, so it puts line_1
into the promise and resolves it.line_1_promise
to run, one after another. Each callback is also ordinary OCaml code. In our case, there is only one callback, but in general, there might be several, and they might also resolve additional promises. So, promise resolution triggers a “cascade” of callbacks. Eventually, however, we should run out of callbacks, and control will return to Lwt_main.run
.Lwt_main.run
– the one that will read line_2
. There are no callbacks left to run after that, so control returns to Lwt_main.run
.Lwt_main.run
goes back to sleep again by calling select(2)
, now waiting for the second I/O that we just registered. The loop repeats itself from step 1.This has two major implications, one good and one bad. Let's start with the bad one.
(1) If one of your callbacks enters an infinite loop, calls an Lwt-unfriendly blocking I/O, or just runs for a really long time, it won't return control to Lwt_main.run
anytime soon. That means Lwt_main.run
won't get a chance to resolve any other Lwt I/O promises, even if the underlying I/O operations complete.
In case your callback is just using the CPU for a really long time, you can insert a few calls to Lwt_main.yield
into it, and resume your computation in callbacks of yield
. This is basically the same as Lwt_unix.sleep
0.
– it's a promise that will be resolved by Lwt_main.run
after any other I/O resolutions that are already in its queue.
(2) The good implication is that all your callbacks run in a single thread. This means that in most situations, you don't have to worry about locks, synchronization, etc. Anything that is in the same callback is guaranteed to run without interruption. Lwt programs are often much easier to write and refactor, than equivalent programs written with threads – but both are concurrent!
This module Lwt
is the pure-OCaml definition of promises and callback-calling. It has a few extras on top of what's described above:
Lwt.Canceled
. It has extra helpers in the Lwt API.Lwt.bind
. As we saw, Lwt concurrency requires only deciding whether to run something inside a callback, or outside it. These functions just implement common patterns, and make intent explicit.The next layer above module Lwt
is the pure-OCaml Lwt “core” library, which provides some promise-friendly patterns, like streams and mvars. This consists of the modules Lwt_list
, Lwt_stream
, Lwt_result
, Lwt_mutex
, Lwt_condition
, Lwt_mvar
, Lwt_pool
, and Lwt_switch
.
Above that is the Lwt Unix binding, where I/O begins. This includes the module Lwt_main
, including the all-important Lwt_main.run
. The rest of the Unix binding consists of functions, each one of which...
Lwt_main.run
, so if you attach callbacks to the promise, they will be called when the I/O operation completes.The functions are grouped into modules:
Lwt_unix
for Unix system calls.Lwt_bytes
for Unix system calls on bigarrays.Lwt_io
for Pervasives
-like high-level channels, TCP servers, etc.Lwt_process
for managing subprocesses.Lwt_preemptive
for spawning system threads.Lwt_daemon
, Lwt_gc
, Lwt_log
, Lwt_engine
, Lwt_throttle
, Lwt_timeout
, Lwt_sys
.Warning! Introductory material ends and detailed reference begins!
Promises for values of type 'a
.
A promise is a memory cell that is always in one of three states:
'a
,A resolved promise is one that is either fulfilled or rejected, i.e. not pending. Once a promise is resolved, its content cannot change. So, promises are write-once references. The only possible state changes are (1) from pending to fulfilled and (2) from pending to rejected.
Promises are typically “read” by attaching callbacks to them. The most basic functions for that are Lwt.bind
, which attaches a callback that is called when a promise becomes fulfilled, and Lwt.catch
, for rejection.
Promise variables of this type, 'a Lwt.t
, are actually read-only in Lwt. Separate resolvers of type 'a
Lwt.u
are used to write to them. Promises and their resolvers are created together by calling Lwt.task
. There is one exception to this: most promises can be canceled by calling Lwt.cancel
, without going through a resolver.
Resolvers for promises of type 'a
Lwt.t
.
Each resolver can be thought of as the write end of one promise. It can be passed to Lwt.wakeup_later
, Lwt.wakeup_later_exn
, or Lwt.wakeup_later_result
to resolve that promise.
Creates a new pending promise, paired with its resolver.
It is rare to use this function directly. Many helpers in Lwt, and Lwt-aware libraries, call it internally, and return only the promise. You then chain the promises together using Lwt.bind
.
However, it is important to understand Lwt.task
as the fundamental promise “constructor.” All other functions that evaluate to a promise can be, or are, eventually implemented in terms of it.
val wakeup_later : 'a u -> 'a -> unit
Lwt.wakeup_later r v
fulfills, with value v
, the pending promise associated with resolver r
. This triggers callbacks attached to the promise.
If the promise is not pending, Lwt.wakeup_later
raises Pervasives.Invalid_argument
, unless the promise is canceled. If the promise is canceled, Lwt.wakeup_later
has no effect.
val wakeup_later_exn : _ u -> exn -> unit
Lwt.wakeup_later_exn r exn
is like Lwt.wakeup_later
, except, if the associated promise is pending, it is rejected with exn
.
val return : 'a -> 'a t
Lwt.return v
creates a new promise that is already fulfilled with value v
.
This is needed to satisfy the type system in some cases. For example, in a match
expression where one case evaluates to a promise, the other cases have to evaluate to promises as well:
match need_input with
| true -> Lwt_io.(read_line stdin) (* Has type string Lwt.t... *)
| false -> Lwt.return "" (* ...so wrap empty string in a promise. *)
Another typical usage is in let%lwt
. The expression after the “in
” has to evaluate to a promise. So, if you compute an ordinary value instead, you have to wrap it:
let%lwt line = Lwt_io.(read_line stdin) in
Lwt.return (line ^ ".")
val fail : exn -> _ t
Lwt.fail exn
is like Lwt.return
, except the new promise that is already rejected with exn
.
Lwt.bind p_1 f
makes it so that f
will run when p_1
is fulfilled.
When p_1
is fulfilled with value v_1
, the callback f
is called with that same value v_1
. Eventually, after perhaps starting some I/O or other computation, f
returns promise p_2
.
Lwt.bind
itself returns immediately. It only attaches the callback f
to p_1
– it does not wait for p_2
. What Lwt.bind
returns is yet a third promise, p_3
. Roughly speaking, fulfillment of p_3
represents both p_1
and p_2
becoming fulfilled, one after the other.
A minimal example of this is an echo program:
let () =
let p_3 =
Lwt.bind
Lwt_io.(read_line stdin)
(fun line -> Lwt_io.printl line)
in
Lwt_main.run p_3
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
Rejection of p_1
and p_2
, and raising an exception in f
, are all forwarded to rejection of p_3
.
Precise behavior
Lwt.bind
returns a promise p_3
immediately. p_3
starts out pending, and is resolved as follows:
p_1
becomes resolved. It does not matter whether p_1
is already resolved when Lwt.bind
is called, or becomes resolved later – the rest of the behavior is the same.p_1
becomes resolved, it will, by definition, be either fulfilled or rejected.p_1
is rejected, p_3
is rejected with the same exception.p_1
is fulfilled, with value v
, f
is applied to v
.f
may finish by returning the promise p_2
, or raising an exception.f
raises an exception, p_3
is rejected with that exception.f
returns p_2
. From that point on, p_3
is effectively made into a reference to p_2
. This means they have the same state, undergo the same state changes, and performing any operation on one is equivalent to performing it on the other.Syntactic sugar
Lwt.bind
is almost never written directly, because sequences of Lwt.bind
result in growing indentation and many parentheses:
let () =
Lwt_main.run begin
Lwt.bind Lwt_io.(read_line stdin) (fun line ->
Lwt.bind (Lwt_unix.sleep 1.) (fun () ->
Lwt_io.printf "One second ago, you entered %s\n" line))
end
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
The recommended way to write Lwt.bind
is using the let%lwt
syntactic sugar:
let () =
Lwt_main.run begin
let%lwt line = Lwt_io.(read_line stdin) in
let%lwt () = Lwt_unix.sleep 1. in
Lwt_io.printf "One second ago, you entered %s\n" line
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
This uses the Lwt PPX (preprocessor). Note that we had to add package lwt.ppx
to the command line for building this program. We will do that throughout this manual.
Another way to write Lwt.bind
, that you may encounter while reading code, is with the >>=
operator:
open Lwt.Infix
let () =
Lwt_main.run begin
Lwt_io.(read_line stdin) >>= fun line ->
Lwt_unix.sleep 1. >>= fun () ->
Lwt_io.printf "One second ago, you entered %s\n" line
end
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
The >>=
operator comes from the module Lwt.Infix
, which is why we opened it at the beginning of the program.
See also Lwt.map
.
Lwt.catch f h
applies f ()
, which returns a promise, and then makes it so that h
(“handler”) will run when that promise is rejected.
let () =
Lwt_main.run begin
Lwt.catch
(fun () -> Lwt.fail Pervasives.Exit)
(function
| Pervasives.Exit -> Lwt_io.printl "Got Pervasives.Exit"
| exn -> Lwt.fail exn)
end
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
Despite the above code, the recommended way to write Lwt.catch
is using the try%lwt
syntactic sugar from the PPX. Here is an equivalent example:
let () =
Lwt_main.run begin
try%lwt Lwt.fail Pervasives.Exit
with Pervasives.Exit -> Lwt_io.printl "Got Pervasives.Exit"
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
A particular advantage of the PPX syntax is that it is not necessary to artificially insert a catch-all exn -> Lwt.fail exn
case. Like in the core language's try
expression, the catch-all case is implied in try%lwt
.
Lwt.catch
is a counterpart to Lwt.bind
– Lwt.bind
is for fulfillment, and Lwt.catch
is for rejection.
As with Lwt.bind
, three promises are involved:
p_1
, the promise returned from applying f ()
.p_2
, the promise returned from applying h exn
.p_3
, the promise returned by Lwt.catch
itself.The remainder is (1) a precise description of how p_3
is resolved, and (2) a warning about accidentally using ordinary try
for exception handling in asynchronous code.
(1) Lwt.catch
first applies f ()
. It then returns p_3
immediately. p_3
starts out pending. It is resolved as follows:
f ()
returned a promise p_1
, and p_1
becomes fulfilled, p_3
is fulfilled with the same value.p_1
can instead become rejected. There is one other possibility: f ()
itself raised an exception, instead of returning a promise. The behavior of Lwt.catch
is the same whether f ()
raised an exception, or returned a promise that is later rejected with an exception. Let's call the exception exn
.h exn
is applied.h exn
may return a promise, or might itself raise an exception. The first case is the interesting one, but the exception case is simple, so we cover the exception case first.h exn
raises another exception exn'
, p_3
is rejected with exn'
.h exn
instead returns the promise p_2
, p_3
is effectively made into a reference to p_2
. This means p_3
and p_2
have the same state, undergo the same state changes, and performing any operation one is equivalent to performing it on the other.(2) Warning: it may be tempting to write this code, which differs from the second example above only in that try
is used instead of try%lwt
:
let () =
Lwt_main.run begin
try Lwt.fail Pervasives.Exit
with Pervasives.Exit -> Lwt_io.printl "Got Pervasives.Exit"
end
(* ocamlfind opt -linkpkg -package lwt.unix code.ml && ./a.out *)
This does not handle the exception and does not print the message. Instead, it terminates the program with an unhandled Pervasives.Exit
.
This is because the call to Lwt.fail
creates a rejected promise. The promise is still an ordinary OCaml value, though, and not a raised exception. So, try
considers that code to have succeeded, and doesn't run the handler. When that rejected promise reaches Lwt_main.run
, it is Lwt_main.run
that raises the exception.
Basically, the rule is: if the code inside try
evaluates to a promise (has type _ Lwt.t
), replace try
by try%lwt
.
Lwt.finalize f c
applies f ()
, which returns a promise, and then makes it so c
(“cleanup”) will run when that promise is resolved.
In other words, c
runs no matter whether promise f ()
is fulfilled or rejected. As the names suggest, Lwt.finalize
corresponds to the finally
construct found in many programming languages, and c
is typically used for cleaning up resources:
let () =
Lwt_main.run begin
let%lwt file = Lwt_io.(open_file Input "code.ml") in
Lwt.finalize
(fun () ->
let%lwt content = Lwt_io.read file in
Lwt_io.print content)
(fun () ->
Lwt_io.close file)
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
As with Lwt.bind
and Lwt.catch
, there is a syntactic sugar for Lwt.finalize
, though it is not as often used:
let () =
Lwt_main.run begin
let%lwt file = Lwt_io.(open_file Input "code.ml") in
begin
let%lwt content = Lwt_io.read file in
Lwt_io.print content
end
[%lwt.finally
Lwt_io.close file]
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
Also as with Lwt.bind
and Lwt.catch
, three promises are involved:
p_1
, the promise returned from applying f ()
.p_2
, the promise returned from applying c ()
.p_3
, the promise returned by Lwt.finalize
itself.p_3
is returned immediately. It starts out pending, and is resolved as follows:
f ()
is applied. If it finishes, it will either return a promise p_1
, or raise an exception.f ()
raises an exception, p_1
is created artificially as a promise rejected with that exception. So, no matter how f ()
finishes, there is a promise p_1
representing the outcome.p_1
is resolved (fulfilled or rejected), c ()
is applied. This is meant to be the cleanup code.c ()
finishes, it will also either return a promise, p_2
, or raise an exception.c ()
raises an exception, p_2
is created artificially as a promise rejected with that exception. Again, no matter how c ()
finishes, there is a promise p_2
representing the outcome of cleanup.p_2
is fulfilled, p_3
is resolved the same way p_1
had been resolved. In other words, p_1
is forwarded to p_2
when cleanup is successful.p_2
is rejected, p_3
is rejected with the same exception. In other words, when cleanup fails, p_3
is rejected. Note this means that if both the protected code and the cleanup fail, the cleanup exception has precedence.Lwt.try_bind f g h
applies f ()
, and then makes it so that:
Lwt.try_bind
is a generalized Lwt.finalize
. The difference is that Lwt.try_bind
runs different callbacks depending on how f ()
is resolved. This has two main implications:
g
and h
each “know” whether f ()
was fulfilled or rejected.g
and h
are passed the value f ()
was fulfilled with, and, respectively, the exception f ()
was rejected with.The rest is a detailed description of the promises involved.
As with Lwt.finalize
and the several preceding functions, three promises are involved.
p_1
is the promise returned from applying f ()
.p_2
is the promise returned from applying h
or g
, depending on which one is chosen.p_3
is the promise returned by Lwt.try_bind
itself.Lwt.try_bind
returns p_3
immediately. p_3
starts out pending, and is resolved as follows:
f ()
is applied. If it finishes, it either returns p_1
, or raises an exception.f ()
raises an exception, p_1
is created artificially as a promise rejected with that exception. So, no matter how f ()
finishes, there is a promise p_1
representing the outcome.p_1
is fulfilled, g
is applied to the value p_1
is fulfilled with.p_1
is rejected, h
is applied to the exception p_1
is rejected with.p_2
, or raises an exception.p_3
is rejected with that exception.p_2
, p_3
is effectively made into an reference to p_2
. They have the same state, including any state changes, and performing any operation on one is equivalent to performing it on the other.val async : (unit -> _ t) -> unit
Lwt.async f
applies f ()
, which returns a promise, and then makes it so that if the promise is rejected, the exception is passed to !
Lwt.async_exception_hook
.
In addition, if f ()
raises an exception, it is also passed to !
Lwt.async_exception_hook
.
!
Lwt.async_exception_hook
typically prints an error message and terminates the program.
Lwt.async
is misleadingly named. Itself, it has nothing to do with asynchronous execution. It's actually a safety function for making Lwt programs more debuggable.
For example, take this program, which prints messages in a loop, while waiting for one line of user input:
let () =
let rec show_nag () : _ Lwt.t =
let%lwt () = Lwt_io.printl "Please enter a line" in
let%lwt () = Lwt_unix.sleep 1. in
show_nag ()
in
ignore (show_nag ()); (* Bad – see note for (1)! *)
Lwt_main.run begin
let%lwt line = Lwt_io.(read_line stdin) in
Lwt_io.printl line
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
If one of the I/O operations in show_nag
were to fail, the promise representing the whole loop would get rejected. However, since we are ignoring that promise at (1), we never find out about the rejection. If this failure and resulting rejection represents a bug in the program, we have a harder time finding out about the bug.
A safer version differs only in using Lwt.async
instead of Pervasives.ignore
:
let () =
let rec show_nag () : _ Lwt.t =
let%lwt () = Lwt_io.printl "Please enter a line" in
let%lwt () = Lwt_unix.sleep 1. in
show_nag ()
in
Lwt.async (fun () -> show_nag ());
Lwt_main.run begin
let%lwt line = Lwt_io.(read_line stdin) in
Lwt_io.printl line
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
In this version, if I/O in show_nag
fails with an exception, the exception is printed by Lwt.async
, and then the program exits.
The general rule for when to use Lwt.async
is:
Lwt.bind
, Lwt.catch
, Lwt.join
, etc., are top-level promises.Lwt_main.run
, as can be seen in most examples in this manual.Lwt.async
.val async_exception_hook : (exn -> unit) Pervasives.ref
Reference to a function, to be called on an "unhandled" exception.
This reference is used by Lwt.async
, Lwt.on_cancel
, Lwt.on_success
, Lwt.on_failure
, Lwt.on_termination
, Lwt.on_any
, and the deprecated Lwt.ignore_result
.
The initial, default implementation prints the exception, then terminates the process with non-zero exit status, as if the exception had reached the top level of the program:
let () = Lwt.async (fun () -> Lwt.fail Pervasives.Exit)
(* ocamlfind opt -linkpkg -package lwt code.ml && ./a.out *)
produces in the output:
Fatal error: exception Pervasives.Exit
If you are writing an application, you are welcome to reassign the reference, and replace the function with something more appropriate for your needs.
If you are writing a library, you should leave this reference alone. Its behavior should be determined by the application.
Lwt.join ps
returns a promise that is pending until all promises in the list ps
become resolved.
let () =
let p_1 =
let%lwt () = Lwt_unix.sleep 3. in
Lwt_io.printl "Three seconds elapsed"
in
let p_2 =
let%lwt () = Lwt_unix.sleep 5. in
Lwt_io.printl "Five seconds elapsed"
in
let p_3 = Lwt.join [p_1; p_2] in
Lwt_main.run p_3
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
If all of the promises in ps
become fulfilled, Lwt.join ps
is also fulfilled. Otherwise, if at least one promise in ps
becomes rejected, Lwt.join ps
is rejected with the same exception as one such promise, chosen arbitrarily. Note that this occurs only after all the promises are resolved, not immediately when the first promise is rejected.
Lwt.pick ps
returns a promise that is pending until one promise in the list ps
becomes resolved.
When at least one promise in ps
is resolved, Lwt.pick
tries to cancel all other promises that are still pending, using Lwt.cancel
.
let () =
let echo =
let%lwt line = Lwt_io.(read_line stdin) in
Lwt_io.printl line
in
let timeout = Lwt_unix.sleep 5. in
Lwt_main.run (Lwt.pick [echo; timeout])
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
If the first promise in ps
to become resolved is fulfilled, the result promise p
is also fulfilled, with the same value. Likewise, if the first promise in ps
to become resolved is rejected, p
is rejected with the same exception.
If ps
has no promises (if it is the empty list), Lwt.pick ps
returns a promise that is pending forever, and cannot be canceled.
It's possible for multiple promises in ps
to become resolved simultaneously. This happens most often when some promises ps
are already resolved at the time Lwt.pick
is called.
In that case, if at least one of the promises is rejected, the result promise p
is rejected with the same exception as one such promise, chosen arbitrarily. If all promises are fulfilled, p
is fulfilled with the value of one of the promises, also chosen arbitrarily.
The remaining functions in this section are variations on Lwt.pick
.
Lwt.choose ps
is the same as Lwt.pick
ps
, except that it does not try to cancel pending promises in ps
.
Lwt.npick ps
is similar to Lwt.pick
ps
, the difference being that when multiple promises in ps
are fulfilled simultaneously (and none are rejected), the result promise is fulfilled with the list of values the promises were fulfilled with.
When at least one promise is rejected, Lwt.npick
still rejects the result promise with the same exception.
Lwt.nchoose ps
is the same as Lwt.npick
ps
, except that it does not try to cancel pending promises in ps
.
Lwt.nchoose_split ps
is the same as Lwt.nchoose
ps
, except that when multiple promises in ps
are fulfilled simultaneously (and none are rejected), the result promise is fulfilled with both the list of values of the fulfilled promises, and the list of promises that are still pending.
Canceled promises are those rejected with this exception, Lwt.Canceled
. See Lwt.cancel
.
val cancel : _ t -> unit
Lwt.cancel p
attempts to cancel the pending promise p
, without needing access to its resolver.
A canceled promise is one that has been rejected with exception Lwt.Canceled
.
There are straightforward ways to make promises canceled. One could create a promise that starts out canceled, with Lwt.fail
Lwt.Canceled
. It's also possible to make a promise canceled through its resolver, by calling Lwt.wakeup_later_exn
r Lwt.Canceled
.
This function, Lwt.cancel
, provides another method, which can cancel pending promises without going through their resolvers – it acts directly on promises.
Like any other promise rejection, the canceled state of a promise is propagated “forwards” by Lwt.bind
, Lwt.join
, etc., as described in the documentation of those functions.
Cancelation is a separate phase, triggered only by Lwt.cancel
, that searches backwards, strating from p
, for promises to reject with Lwt.Canceled
. Once those promises are found, they are canceled, and then ordinary, forwards rejection propagation takes over.
All of this will be made precise, but first let's have an example:
let () =
let p =
let%lwt () = Lwt_unix.sleep 5. in
Lwt_io.printl "Slept five seconds"
in
Lwt.cancel p;
Lwt_main.run p
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
At the time Lwt.cancel
is called, p
“depends” on the sleep
promise (the printl
is not yet called, so its promise hasn't been created).
So, Lwt.cancel
recursively tries to cancel the sleep
promise. That is an example of the backwards search. The sleep
promise is a pending promise that doesn't depend on anything, so backwards search stops at it. The state of the sleep
promise is set to rejected with Lwt.Canceled
.
Lwt.bind
then propagates the rejection forwards to p
, so p
also becomes canceled.
Eventually, this rejection reaches Lwt_main.run
, which raises the Lwt.Canceled
as an ordinary exception. The sleep
does not complete, and the printl
is never started.
Promises, like the sleep
promise above, that can be rejected by Lwt.cancel
are cancelable. Most promises in Lwt are either cancelable, or depend on cancelable promises. The functions Lwt.wait
and Lwt.no_cancel
create promises that are not cancelable.
The rest is a detailed description of how the Lwt.cancel
backwards search works.
p
is already resolved, Lwt.cancel
does nothing.p
was created by Lwt.wait
or Lwt.no_cancel
, Lwt.cancel
does nothing.p
was created by Lwt.task
or Lwt.protected
, Lwt.cancel
rejects it with Lwt.Canceled
. This rejection then propagates normally through any Lwt calls that depend on p
. Most I/O promises are internally created by calling Lwt.task
.p_3
was returned by Lwt.bind
, Lwt.map
, Lwt.catch
, Lwt.finalize
, or Lwt.try_bind
. Then, see those functions for the naming of the other promises involved. If p_3
is pending, then either p_1
is pending, or p_2
is pending. Lwt.cancel p_3
then tries recursively to cancel whichever of these two is still pending. If that succeeds, p_3
may be canceled later by the normal propagation of rejection.p
was returned by Lwt.join
, Lwt.pick
, or similar function, which was applied to the promise list ps
. Lwt.cancel
then recursively tries to cancel each promise in ps
. If one of those cancelations succeeds, p
may be canceled later by the normal propagation of rejection.val on_cancel : _ t -> (unit -> unit) -> unit
Lwt.on_cancel p f
makes it so that f
will run when p
becomes canceled.
Callbacks scheduled with on_cancel
are guaranteed to run before any other callbacks that are triggered by rejection, such as those added by Lwt.catch
.
Note that this does not interact directly with the cancelation mechanism, the backwards search described in Lwt.cancel
. For example, manually rejecting a promise with Lwt.Canceled
is sufficient to trigger f
.
f
should not raise exceptions. If it does, they are passed to !
Lwt.async_exception_hook
, which terminates the process by default.
Lwt.protected p
creates a cancelable promise p'
with the same state as p
. However, cancelation, the backwards search described in Lwt.cancel
, stops at p'
, and does not continue to p
.
Lwt.no_cancel p
creates a non-cancelable promise p'
, with the same state as p
. Cancelation, the backwards search described in Lwt.cancel
, stops at p'
, and does not continue to p
.
Note that p'
can still be canceled if p
is canceled. Lwt.no_cancel
only prevents cancelation of p
and p'
through p'
.
Lwt.wait
is the same as Lwt.task
, except the resulting promise p
is not cancelable.
This is significant, because it means p
created by Lwt.wait
can only be resolved through its paired resolver.
In contrast, promises returned by Lwt.task
can additionally be resolved by canceling them directly with Lwt.cancel
.
Lwt.map f p_1
is similar to Lwt.bind
p_1 f
, but f
is not expected to return a promise.
This function is more convenient that Lwt.bind
when f
inherently does not return a promise. An example is Pervasives.int_of_string
:
let read_int : unit -> int Lwt.t = fun () ->
Lwt.map
int_of_string
Lwt_io.(read_line stdin)
let () =
Lwt_main.run begin
let%lwt number = read_int () in
Lwt_io.printf "%i\n" number
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
By comparison, the Lwt.bind
version is more awkward:
let read_int : unit -> int Lwt.t = fun () ->
Lwt.bind
Lwt_io.(read_line stdin)
(fun line -> Lwt.return (int_of_string line))
As with Lwt.bind
, sequences of calls to Lwt.map
result in excessive indentation and parentheses. The recommended syntactic sugar for avoiding this is the >|=
operator, which comes from module Lwt.Infix
:
open Lwt.Infix
let read_int : unit -> int Lwt.t = fun () ->
Lwt_io.(read_line stdin) >|= int_of_string
The detailed operation follows. For consistency with the promises in Lwt.bind
, the two promises involved are named p_1
and p_3
:
p_1
is the promise passed to Lwt.map
.p_3
is the promise returned by Lwt.map
.Lwt.map
returns a promise p_3
. p_3
starts out pending. It is resolved as follows:
p_1
may be, or become, resolved. In that case, by definition, it will become fulfilled or rejected. Fulfillment is the interesting case, but the behavior on rejection is simpler, so we focus on rejection first.p_1
becomes rejected, p_3
is rejected with the same exception.p_1
instead becomes fulfilled, call the value it is fulfilled with v
.f v
is applied. If this finishes, it may either return another value, or raise an exception.f v
returns another value v'
, p_3
is fulfilled with v'
.f v
raises exception exn
, p_3
is rejected with exn
.val on_success : 'a t -> ('a -> unit) -> unit
Lwt.on_success p f
makes it so that f
will run when p
is fulfilled.
It is similar to Lwt.bind
, except no new promises are created. f
is a plain, arbitrary function attached to p
, to perform some side effect.
If f
raises an exception, it is passed to !
Lwt.async_exception_hook
. By default, this will terminate the process.
val on_failure : _ t -> (exn -> unit) -> unit
Lwt.on_failure p f
makes it so that f
will run when p
is rejected.
It is similar to Lwt.catch
, except no new promises are created.
If f
raises an exception, it is passed to !
Lwt.async_exception_hook
. By default, this will terminate the process.
val on_termination : _ t -> (unit -> unit) -> unit
Lwt.on_termination p f
makes it so that f
will run when p
is resolved – that is, fulfilled or rejected.
It is similar to Lwt.finalize
, except no new promises are created.
If f
raises an exception, it is passed to !
Lwt.async_exception_hook
. By default, this will terminate the process.
val on_any : 'a t -> ('a -> unit) -> (exn -> unit) -> unit
Lwt.on_any p f g
makes it so that:
It is similar to Lwt.try_bind
, except no new promises are created.
If f
or g
raise an exception, the exception is passed to !
Lwt.async_exception_hook
. By default, this will terminate the process.
module Infix : sig ... end
This module provides several infix operators for making programming with Lwt more convenient.
val return_unit : unit t
Lwt.return_unit
is defined as Lwt.return
()
, but this definition is evaluated only once, during initialization of module Lwt
, at the beginning of your program.
This means the promise is allocated only once. By contrast, each time Lwt.return
()
is evaluated, it allocates a new promise.
It is recommended to use Lwt.return_unit
only where you know the allocations caused by an instance of Lwt.return
()
are a performance bottleneck. Generally, the cost of I/O tends to dominate the cost of Lwt.return
()
anyway.
In future Lwt, we hope to perform this optimization, of using a single, pre-allocated promise, automatically, wherever Lwt.return
()
is written.
val return_none : _ option t
Lwt.return_none
is like Lwt.return_unit
, but for Lwt.return
None
.
val return_nil : _ list t
Lwt.return_nil
is like Lwt.return_unit
, but for Lwt.return
[]
.
val return_true : bool t
Lwt.return_true
is like Lwt.return_unit
, but for Lwt.return
true
.
val return_false : bool t
Lwt.return_false
is like Lwt.return_unit
, but for Lwt.return
false
.
type +'a result = ('a, exn) Result.result
Representation of the content of a resolved promise of type 'a
Lwt.t
.
This type is effectively
type +'a Lwt.result =
| Ok of 'a
| Error of exn
or, on OCaml 4.02:
type +'a Lwt.result =
| Result.Ok of 'a
| Result.Error of exn
A resolved promise of type 'a
Lwt.t
is either fulfilled with a value of type 'a
, or rejected with an exception.
This corresponds to the cases of a ('a, exn)
Pervasives.result
: fulfilled corresponds to Ok of 'a
, and rejected corresponds to Error of exn
.
It's important to note that this type constructor, Lwt.result
, is different from Pervasives.result
. It is a specialization of Pervasives.result
so that the Error
constructor always carries exn
.
For Lwt programming with result
where the Error
constructor can carry arbitrary error types, see module Lwt_result
.
The naming conflict between Lwt.result
and Pervasives.result
is an unfortunate historical accident. Pervasives.result
did not exist when Lwt.result
was created.
The type Result.result
is equivalent to Pervasives.result
starting from OCaml 4.03. If you need compatibility with OCaml 4.02, refer to Pervasives.result
as Result.result
, and prefix the constructor names with Result
, as shown in the second example.
Lwt.of_result r
converts an r to a resolved promise.
r
is Ok v
, Lwt.of_result r
is Lwt.return v
, i.e. a promise fulfilled with v
.r
is Error exn
, Lwt.of_result r
is Lwt.fail exn
, i.e. a promise rejected with exn
.Lwt.wakeup_later_result r result
resolves the pending promise p
associated to resolver r
, according to result
:
result
is Ok v
, p
is fulfilled with v
.result
is Error exn
, p
is rejected with exn
.If p
is not pending, Lwt.wakeup_later_result
raises Pervasives.Invalid_argument _
, except if p
is canceled. If p
is canceled, Lwt.wakeup_later_result
has no effect.
Keys into the implicit callback argument map, for implicit arguments of type 'a option
.
The keys are abstract, but they are basically integers that are all distinct from each other.
See Lwt.with_value
.
val new_key : unit -> 'a key
Creates a fresh implicit callback argument key.
The key is distinct from any other key created by the current process. The value None
of type 'a option
is immediately associated with the key.
See Lwt.with_value
.
val get : 'a key -> 'a option
Retrieves the value currently associated with the given implicit callback argument key.
See Lwt.with_value
.
val with_value : 'a key -> 'a option -> (unit -> 'b) -> 'b
Lwt.with_value k v f
sets k
to v
in Lwt's internal implicit callback argument map, then runs f ()
, then restores the previous value associated with k
.
Lwt maintains a single, global map, that can be used to “pass” extra arguments to callbacks:
let () =
let k : string Lwt.key = Lwt.new_key () in
let say_hello () =
match Lwt.get k with
| None -> assert false
| Some s -> Lwt_io.printl s
in
Lwt_main.run begin
Lwt.with_value k (Some "Hello world!") begin fun () ->
Lwt.bind
(Lwt_unix.sleep 1.)
(fun () -> say_hello ())
end
end
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
Note that the string Hello world!
was passed to say_hello
through the key k
. Meanwhile, the only explicit argument of the callback say_hello
is ()
.
The way this works is functions like Lwt.bind
take a snapshot of the implicit argument map. Later, right before the callback is run, the map is restored to that snapshot. In other words, the map has the same state inside the callback as it did at the time the callback was registered.
To be more precise:
Lwt.with_value
associates Some "Hello world!"
with k
, and runs the function passed to it.Lwt.bind
.Lwt_unix.sleep 1.
promise is created.Lwt.bind
then attaches the callback in its second argument, the one which calls say_hello
, to that sleep
promise.Lwt.bind
also takes a snapshot of the current state of the implicit argument map, and pairs the callback with that snapshot.sleep
promise will be resolved.Lwt.bind
returns its result promise p_3
. This causes Lwt.with_value
to also return p_3
, first restoring k
to be associated with None
.Lwt_main.run
gets the pending p_3
, and blocks the whole process, with k
associated with None
.sleep
I/O completes, resolving the sleep
promise.say_hello
callback. Right before the callback is called, the implicit argument map is restored to its snapshot, so k
is associated with Some "Hello world!"
.k
to be associated with None
.The Lwt functions that take snapshots of the implicit callback argument map are exactly those which attach callbacks to promises: Lwt.bind
and its variants >>=
and let%lwt
, Lwt.map
and its variant >|=
, Lwt.catch
and its variant try%lwt
, Lwt.finalize
and its variant %lwt.finally
, Lwt.try_bind
, Lwt.on_success
, Lwt.on_failure
, Lwt.on_termination
, and Lwt.on_any
.
Using this mechanism is discouraged, because it is non-syntactic, and because it manipulates hidden state in module Lwt
. It is recommended instead to pass additional values explicitly in tuples, or maintain explicit associative maps for them.
val wakeup : 'a u -> 'a -> unit
Lwt.wakeup r v
is like Lwt.wakeup_later
r v
, except it guarantees that callbacks associated with r
will be called immediately, deeper on the current stack.
In contrast, Lwt.wakeup_later
may call callbacks immediately, or may queue them for execution on a shallower stack – though still before the next time Lwt blocks the process on I/O.
Using this function is discouraged, because calling it in a loop can exhaust the stack. The loop might be difficult to detect or predict, due to combined mutually-recursive calls between multiple modules and libraries.
Also, trying to use this function to guarantee the timing of callback calls for synchronization purposes is discouraged. This synchronization effect is obscure to readers. It is better to use explicit promises, or Lwt_mutex
, Lwt_condition
, and/or Lwt_mvar
.
val wakeup_exn : _ u -> exn -> unit
Lwt.wakeup_exn r exn
is like Lwt.wakeup_later_exn
r exn
, but has the same problems as Lwt.wakeup
.
Lwt.wakeup_result r result
is like Lwt.wakeup_later_result
r result
, but has the same problems as Lwt.wakeup
.
val make_value : 'a -> 'a result
val make_error : exn -> _ result
Lwt.waiter_of_wakener r
evaluates to the promise associated with resolver r
.
It is recommended to explicitly keep the reference to the promise instead.
val add_task_r : 'a u Lwt_sequence.t -> 'a t
Lwt.add_task_r sequence
is equivalent to
let p, r = Lwt.task () in
let node = Lwt_sequence.add_r r sequence in
Lwt.on_cancel p (fun () -> Lwt_sequence.remove node);
p
Use of this function is discouraged for two reasons:
Lwt_sequence
should not be used outside Lwt.val add_task_l : 'a u Lwt_sequence.t -> 'a t
Like Lwt.add_task_r
, but the equivalent code calls Lwt_sequence.add_l
instead.
val pause : unit -> unit t
Lwt.pause ()
creates a pending promise that is fulfilled after Lwt finishes calling all currently ready callbacks, i.e. it is fulfilled on the next “tick.”
Putting the rest of your computation into a callback of Lwt.pause ()
creates a “yield” that gives other callbacks a chance to run first.
For example, to break up a long-running computation, allowing I/O to be handled between chunks:
let () =
let rec handle_io () =
let%lwt () = Lwt_io.printl "Handling I/O" in
let%lwt () = Lwt_unix.sleep 0.1 in
handle_io ()
in
let rec compute n =
if n = 0 then
Lwt.return ()
else
let%lwt () =
if n mod 1_000_000 = 0 then
Lwt.pause ()
else
Lwt.return ()
in
compute (n - 1)
in
Lwt.async handle_io;
Lwt_main.run (compute 100_000_000)
(* ocamlfind opt -linkpkg -package lwt.ppx,lwt.unix code.ml && ./a.out *)
If you replace the call to Lwt.pause
by Lwt.return
in the program above, "Handling I/O"
is printed only once. With Lwt.pause
, it is printed several times, depending on the speed of your machine.
An alternative way to handle long-running computations is to detach them to preemptive threads using Lwt_preemptive
.
val wrap : (unit -> 'a) -> 'a t
Lwt.wrap f
applies f ()
. If f ()
returns a value v
, Lwt.wrap
returns Lwt.return
v
. If f ()
raises an exception exn, Lwt.wrap
returns Lwt.fail
exn
.
val wrap1 : ('a -> 'b) -> 'a -> 'b t
val wrap2 : ('a -> 'b -> 'c) -> 'a -> 'b -> 'c t
val wrap3 : ('a -> 'b -> 'c -> 'd) -> 'a -> 'b -> 'c -> 'd t
val wrap4 : ('a -> 'b -> 'c -> 'd -> 'e) -> 'a -> 'b -> 'c -> 'd -> 'e t
val wrap5 :
('a -> 'b -> 'c -> 'd -> 'e -> 'f) ->
'a ->
'b ->
'c ->
'd ->
'e ->
'f t
val wrap6 :
('a -> 'b -> 'c -> 'd -> 'e -> 'f -> 'g) ->
'a ->
'b ->
'c ->
'd ->
'e ->
'f ->
'g t
val wrap7 :
('a -> 'b -> 'c -> 'd -> 'e -> 'f -> 'g -> 'h) ->
'a ->
'b ->
'c ->
'd ->
'e ->
'f ->
'g ->
'h t
As a “prototype,” Lwt_wrap1 f
creates a promise-valued function g
:
let g v =
try
let v' = f v in
Lwt.return v'
with exn ->
Lwt.fail exn
The remainder of the functions work analogously – they just work on f
with larger numbers of arguments.
Note that there is an important difference to Lwt.wrap
. These functions don't run f
, nor create the final promise, immediately. In contrast, Lwt.wrap
runs its argument f
eagerly.
To get a suspended function instead of the eager execution of Lwt.wrap
, use Lwt.wrap1
.
val return_some : 'a -> 'a option t
Counterpart to Lwt.return_none
. However, unlike Lwt.return_none
, this function performs no optimization. This is because it takes an argument, so it cannot be evaluated at initialization time, at which time the argument is not yet available.
val return_ok : 'a -> ('a, _) Result.result t
Like Lwt.return_some
, this function performs no optimization.
val return_error : 'e -> (_, 'e) Result.result t
Like Lwt.return_some
, this function performs no optimization.
val fail_with : string -> _ t
Lwt.fail_with s
is an abbreviation for
Lwt.fail (Pervasives.Failure s)
val fail_invalid_arg : string -> _ t
Lwt.invalid_arg s
is an abbreviation for
Lwt.fail (Pervasives.Invalid_argument s)
Use the operators in module Lwt.Infix
instead. Using these instances of the operators directly requires opening module Lwt
, which brings an excessive number of other names into scope.
val ignore_result : _ t -> unit
An obsolete variant of Lwt.async
.
Lwt.ignore_result p
behaves as follows:
p
is already fulfilled, Lwt.ignore_result p
does nothing.p
is already rejected with exn
, Lwt.ignore_result p
raises exn
immedaitely.p
is pending, Lwt.ignore_result p
does nothing, but if p
becomes rejected later, the exception is passed to !
Lwt.async_exception_hook
.Use of this function is discouraged for two reasons:
p
is rejected now or later.Pervasives.ignore
, i.e. that it waits for p
to become resolved, completing any associated side effects along the way. In fact, the function that does that is ordinary Lwt.bind
.