Here's the big idea (how you use it):
import asyncio
from aiorun import run
async def main():
# Put your application code here
await asyncio.sleep(1.0)
if __name__ == '__main__':
run(main())
This package provides a run()
function as the starting point
of your asyncio
-based application. The run()
function will
run forever. If you want to shut down when main()
completes, just
call loop.stop()
inside it: that will initiate shutdown.
The run()
function will handle everything that normally needs
to be done during the shutdown sequence of the application. All you
need to do is write your coroutines and run them.
So what the heck does run()
do exactly?? It does these standard,
idiomatic actions for asyncio apps:
- creates a
Task
for the given coroutine (schedules it on the event loop), - calls
loop.run_forever()
, - adds default (and smart) signal handlers for both
SIGINT
andSIGTERM
that will stop the loop; - and when the loop stops (either by signal or called directly), then it will...
- ...gather all outstanding tasks,
- cancel them using
task.cancel()
, - resume running the loop until all those tasks are done,
- wait for the executor to complete shutdown, and
- finally close the loop.
All of this stuff is boilerplate that you will never have to write
again. So, if you use aiorun
this is what you need to remember:
- Spawn all your work from a single, starting coroutine
- When a shutdown signal is received, all currently-pending tasks
will have
CancelledError
raised internally. It's up to you whether you want to handle this inside each coroutine with atry/except
or not. - If you want to protect coros from cancellation, see shutdown_waits_for() further down.
- Try to have executor jobs be shortish, since the shutdown process will wait
for them to finish. If you need a long-running thread or process tasks, use
a dedicated thread/subprocess and set
daemon=True
instead.
There's not much else to know for general use. aiorun has a few special tools that you might need in unusual circumstances. These are discussed next.
💨 Do you like uvloop?
import asyncio, aiorun
async def main():
<snip>
if __name__ == '__main__':
run(main(), use_uvloop=true)
Note that you have to pip install uvloop
yourself.
It's unusual, but sometimes you're going to want a coroutine to not get
interrupted by cancellation during the shutdown sequence. You'll look in
the official docs and find asyncio.shield()
.
Unfortunately, shield()
doesn't work in shutdown scenarios because
the protection offered by shield()
only applies if the specific coroutine
inside which the shield()
is used, gets cancelled directly.
Let me explain: if you do a conventional shutdown sequence (like aiorun
is doing internally), this is the sequence of steps:
tasks = all_tasks()
, followed bygroup = gather(*tasks)
, and thengroup.cancel()
The way shield()
works internally is it creates a secret, inner
task—which also gets included in the all_tasks()
call above! Thus
it also receives a cancellation signal just like everything else.
Therefore, we have an alternative version of shield()
that works better for
us: shutdown_waits_for()
. If you've got a coroutine that must not be
cancelled during the shutdown sequence, just wrap it in
shutdown_waits_for()
!
Here's an example:
import asyncio
from aiorun import run, shutdown_waits_for
async def corofn():
await asyncio.sleep(60)
print('done!')
async def main():
try:
await shutdown_waits_for(corofn())
except asyncio.CancelledError
print('oh noes!')
run(main())
If you hit CTRL-C
before 60 seconds has passed, you will see
oh noes!
printed immediately, and then after 60 seconds (since start),
done!
is printed, and thereafter the program exits.
Behind the scenes, all_tasks()
would have been cancelled by CTRL-C
,
except ones wrapped in shutdown_waits_for()
calls. In this respect, it
is loosely similar to asyncio.shield()
, but with special applicability
to our shutdown scenario in aiorun()
.
Be careful with this: the coroutine should still finish up at some point. The main use case for this is short-lived tasks that you don't want to write explicit cancellation handling.
Oh, and you can use shutdown_waits_for()
as if it were asyncio.shield()
too. For that use-case it works the same. If you're using aiorun
, there
is no reason to use shield()
.