[new release] riot (4 packages) (0.0.8)
CHANGES:
## 0.0.8
This is the largest Riot release yet, and we are splitting the package into 4 sub-packages:
* the Riot runtime+library
* Bytestring – efficient and ergonomic bytestring manipulation
* Gluon – a low-level, efficient async I/O engine
* Rio – composable I/O streams for vectored operations
### Riot Runtime
* Improved performance and memory usage by creating 95% smaller processes,
ensuring fibers are always properly discontinued to release their resources,
and moving to Weak references for processes to ensure they get garbage
collected timely.
* Introduce Process Priorities – the scheduler has been improved to support
processes with different priorities (High, Normal, and Low). Thanks
@LeedsJohn for the contribution! 👏
* Introduce `receive` Timeouts – you can now call `receive ~after:10L ()` and
if there are messages fetched in 10 microseconds `receive` will raise a
`Receive_timeout` exception that you can match on.
* Introduce `syscall` Timeouts – any syscall being made now can specify a
timeout for an answer. If the syscall isn't ready to retry within the timeout
period, a `Syscall_timeout` exception will be raised.
* Improve `Timer_wheel` with support for clearing timers, iterating timers
in the order in which they were created, and a MinHeap backend.
### Riot Lib
* New `Dynamic_supervisor` to dynamically allocate pools of processes up to a
maximum.
* New `Runtime.Stats` server can be started to periodically print out
statistics about the runtime and the garbage collector.
* The `Net.Socket` module is now split into a `Tcp_listener` and a
`Tcp_stream`, with their corresponding functions for listening, connecting,
sending, and receiving. These also include support for timeouts.
* New File and File Descriptor operations for seeking. Thanks to @diogomqbm! 👏
* Introduce SSL module to turn sockets into SSL-backed Reader/Writer streams.
This includes making a `Net.Socket.stream_socket` into a client or a server
SSL-backed stream pair.
* Introduce `Task` to quickly spin up processes that we can await. This is the
closest we have to a future. A `Task` is typed, executes a single function,
and MUST be awaited with `Task.await ?timeout task`.
* Introduce `Crypto.Random` module with high-level utilities for creating
random data of different types, including integers of different sizes,
strings, bytestrings, bytes, characters, and ASCII strings.
* Introduce new named pid functions `Process.where_is` and `Porcess.await_name`
to make it easier to find pids by name, and await a name to be registered.
* New `Process.is_alive` predicate to check if a process is alive
* Improve logging on most modules with namespaces
* Initializing the Riot runtime twice results in a runtime exception – thanks
@julien-leclercq for the contribution! 👏
* Introduce `Ref.cast` to do type-safe type-casting based on runtime
information of a Ref at its instantiation time.
* Introduce a `Stream` module that extends the stdlib Seq with a `reduce_while` combinator.
* Introduce inmemory key-value `Store` that works in a process-friendly
fashion, similar to Erlang's ETS.
### Bytestring
* First implementation of efficient immutable byte strings with cheap view and
concat operations. Thanks to @felipecrv for contributing! 👏
* Iterators and Transient builders for efficiently examining, destructuring,
and constructing byte strings from different sources.
* Preliminary Bytestrings syntax support (via a ppx) for constructions and
efficient pattern matching using the `%b` sigil.
### Gluon
* First implementation of an efficient, low-level async I/O engine inspired by
Rust's Mio. Gluon uses an opaque Token based approach that lets you directly
reference an OCaml value as part of the polled events from the underlying
async engine. Thanks to @diogomqbm and @emilpriver for contributing! 👏
* Preliminary support for epoll on Linux and kqueue on macOS with conditional
compilation via the `config` package.
### Rio
* First implementation of composable I/O streams via a Read/Write interface
inspired by Rust's Read/Write traits.
## 0.0.7
* Introduce IO module with low-level IO operations such as performing direct
vectorized (or regular) reads/writes. New operations include:
* `read`, `write`
* `single_read`, `single_write` (vectorized)
* `await_readable`, `await_writeable`, `await`
* `write_all`
* `copy` and `copy_buffered`
* Introduce Buffer module with support for converting from and to CStruct and
String, including position tracking.
* Introduce Read/Reader interface for creating buffered and unbuffered readers
of arbitrary sources.
* Introduce Write/Writer interfaces for creating unbuffered writers into
arbitrary destinations/sinks.
* Introduce File module with Reader and Writer implementations
* Implment Reader and Writer interfaces for Net.Socket
* Dropped dependency on Bigstringaf and moved to Cstruct
* Fix max number of domains to always be under the recommended domain count
* Fix issue with tests where the runtime idled after the main would die. Now
the main process finishing with an exception is considered reason enough to
shutdown the system.
* Refactor tests to always output `test_name: OK` when everything is fine and
all modules to end in `_test`.
* Add several IO tests.
* Fix log levels for writing to sockets
* Include proper license for C Stubs copied from `lib_eio_posix` for vectorized i/o.
* Split test suite into io/non-io so io tests are left outside opam ci
* Improved IO polling that removes heavy iterations over process/fds tables
* Rewrite Dashmap internals to use a Hashtbl
## 0.0.6
* Redo packaging to expose a single public library: `riot`
* Fix issue with schedulers busy-waiting
* Introduce separate IO Schedulers for polling
* Switch to `poll` to support kqueue on macOS
* Reuse read-buffers on Rio.read loops
* Broaden IO socket types to file descriptors
* Improved polling with shorter poll timeouts and safety checks
* Add `Dashmap.iter` to iterate over a collection
* Add `net_test` with an echo tcp server/client
* Fix bugs with syscall suspension that was introduced with reduction counting
## 0.0.5
* Add `register name pid`
* Add `unregister name`
* Add `send_by_name ~name msg`
* Fix timer wheel making it remove timers correctly
* Add better test for `Timer.send_after`
## 0.0.4
* Internally immediately suspend (bypassing reduction counts) when on a receive expression
* Fix reads from closed Unix sockets
* Fix writes to closed Unix sockets
* Ignore SIGPIPEs on setup
* Fix always mark connected sockets as nonblocking
* Fix GC i/o process table
* Surface pretty-printing of socket values
## 0.0.3
* Big namespace refactor. `Riot.Runtime` includes the lower-level runtime
blocks, and everything else that is more user-friendly lives at the `Riot.*`
level.
* Introduce reduction counting, so processes will run up to N iterations unless
they finish, or they execute an unhandled effect.
* Introduce the `Application` interface for managing the lifecycle of the system
* Fix `Riot.Logger` to fit the `Application` interface
* Add a new `Riot.Telemetry` backend for doing async telemetry
## 0.0.2
* New `Riot.random ()` API to expose current scheduler's random state
* Better logging in the `Net` module
* Fix a bug where `Net.Socket` operations where hanging on I/O polling when they could have been eager
## 0.0.1
First release, including:
* First working version of the scheduler
* Support for process spawning, message passing, monitoring, and linking
* Rudimentary supervisors
* Basic (and incomplete) GenServer
* Scheduling-aware I/O primitives
* Scheduling-aware Logger
* Timers