New to airflow. I have tried for hours to figure this out and think I have come to the correct process up until Celery Executor. Please see below
When running Airflow in cluster mode, we have workers on various machines that connect back to the scheduler. Airflow uses RabbitMQ to get the messages in a Queue from which the workers can retrieve the message. I just don’t completely understand why we need celery? Does it act as a load balancer?
Any help would be really appreciated.
No tags for this post.
more link ADS
Smart Retail, Smart Agriculture, Smart supply Chain, Smart Health, Smart energy, Smart City
Blockchain, bitcoin, ethereum, blockchain technology, cryptocurrencies
Information Security, latest Hacking News, Cyber Security, Network Sec
Information Security, latest Hacking News, Cyber Security, Network Security
Blog! Development Software and Application Mobile
Development apps, Android, Ios anh Tranning IT, data center, hacking
Car News, Reviews, Pricing for New & Used Cars, car reviews and news, concept cars
Travel Blog is a unique free online travel diary for travellers across the world.