Show HN: FastWorker – Task queue for Python with no external dependencies
Mood
supportive
Sentiment
positive
Category
tech
Key topics
task queue
Python
distributed systems
FastAPI
FastWorker is a brokerless task queue requiring only Python processes. No Redis, no RabbitMQ – just 2-3 Python services instead of 4-6+.
Quick example:
# tasks.py from fastworker import task
@task def send_email(to: str, subject: str): return {"sent": True}
# FastAPI app from fastworker import Client
client = Client()
@app.post("/send/") async def send_notification(email: str): task_id = await client.delay("send_email", email, "Welcome!") return {"task_id": task_id}
Start workers: fastworker control-plane --task-modules tasks fastworker subworker --task-modules tasks # optional
Architecture: Uses NNG messaging for direct peer-to-peer communication. Control plane coordinates task distribution via priority heap and tracks worker load. Workers auto-discover via discovery socket. Results cached in-memory with LRU/TTL.
Designed for: Moderate-scale Python apps (1K-10K tasks/min) doing background processing – image resizing, report generation, emails, webhooks. Great for FastAPI/Flask/Django.
NOT for: Extreme scale (100K+ tasks/min), multi-language stacks, or systems requiring persistent task storage. For those, use Celery/RabbitMQ/Kafka.
Try it: pip install fastworker
Repo: https://github.com/neul-labs/fastworker FastAPI integration docs: https://github.com/neul-labs/fastworker/blob/main/docs/fasta...
Would love feedback on whether this fills a useful niche or if the limitations make it too narrow.
The author introduces FastWorker, a Python task queue with no external dependencies, designed for moderate-scale background processing in FastAPI apps, and shares its architecture and usage.
Snapshot generated from the HN discussion
Discussion Activity
No activity data yet
We're still syncing comments from Hacker News.
Generating AI Summary...
Analyzing up to 500 comments to identify key contributors and discussion patterns
Discussion hasn't started yet.
Want the full context?
Jump to the original sources
Read the primary article or dive into the live Hacker News thread when you're ready.