48 words
1 minute
Running pyspider on Windows 11 with Docker
When installing pyspider on Windows 11, I encountered several errors.
I found that the official website provides a Docker-based installation method.
Run directly with Docker
# mysqldocker run --name mysql -d -v /data/mysql:/var/lib/mysql -e MYSQL_ALLOW_EMPTY_PASSWORD=yes mysql:latest# rabbitmqdocker run --name rabbitmq -d rabbitmq:latest
# phantomjsdocker run --name phantomjs -d binux/pyspider:latest phantomjs
# result workerdocker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker# processor, run multiple instance if needed.docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor# fetcher, run multiple instance if needed.docker run --name fetcher -m 256m -d --link phantomjs:phantomjs --link rabbitmq:rabbitmq binux/pyspider:latest fetcher --no-xmlrpc# schedulerdocker run --name scheduler -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest scheduler# webuidocker run --name webui -m 256m -d -p 5000:5000 --link mysql:mysql --link rabbitmq:rabbitmq --link scheduler:scheduler --link phantomjs:phantomjs binux/pyspider:latest webuiUse docker-compose
services: phantomjs: image: binux/pyspider:latest command: phantomjs result: image: binux/pyspider:latest external_links: - mysql - rabbitmq command: result_worker processor: image: binux/pyspider:latest external_links: - mysql - rabbitmq command: processor fetcher: image: binux/pyspider:latest external_links: - rabbitmq links: - phantomjs command : fetcher scheduler: image: binux/pyspider:latest external_links: - mysql - rabbitmq command: scheduler webui: image: binux/pyspider:latest external_links: - mysql - rabbitmq links: - scheduler - phantomjs command: webui ports: - "5000:5000"Then run it with:docker-compose up -d
Once it starts successfully, visit http://localhost<5000>5000>/. If the following page appears, pyspider is running successfully.

Share
If this article helped you, please share it with others!
Running pyspider on Windows 11 with Docker
https://dreaife.tokyo/en/posts/docker-pyspider-win/ Some information may be outdated
Sunflower: A Coming-of-Age Story from Childhood to Adulthood
Errors When Using pandas.to_datetime with Different Date and Time Formats
Related Posts Smart
1
Python Web Scraping Environment Setup
Troubleshooting Set up a Python web-scraping environment with requests, Selenium, lxml, Beautiful Soup, databases, mitmproxy, Appium, pyspider, and Scrapy.
2
Getting Started with Docker
Study A practical Docker introduction covering containers vs. VMs, images, Docker Hub, core commands, persistent volumes, and Docker Compose.
3
Configure Docker + code-server on Alibaba Cloud to Build an Online IDE
Troubleshooting Build a C/C++ development environment on Alibaba Cloud with Docker, Nginx, and code-server, from mirror setup to compiling and running test code.
4
Automatically Deploy an Angular Page with GitHub Actions
Troubleshooting Deploy Angular to GitHub Pages with GitHub Actions, covering outputPath, angular-cli-ghpages, workflow setup, tokens, and the gh-pages branch.
5
Installing Oh My Zsh and Its Plugins on Ubuntu
Troubleshooting Install and configure Oh My Zsh on Ubuntu with Zsh, Git, Powerlevel10k, useful plugins, and .zshrc settings for a productive terminal.
Random Posts Random
1
Angular-Based Animation Showcase Website with Login and Registration (Cognito)
Exploration 2024-11-12
2
Sunflower: A Coming-of-Age Story from Childhood to Adulthood
Perspectives 2024-07-04
3
EOA Wallet Signature Verification and Related Topics
Exploration 2026-06-10
4
Blog Migration – Mizuki Configuration Notes
Exploration 2026-02-22
5
Some of My Thoughts on the Market on X
Notes 2026-08-10





