Dropbox's engineering team wrote about their network and server provisioning and validation automation tool called Pirlo. Pirlo has a pluggable architecture based on a MySQL backed custom job queue implementation.
Dropbox runs its own datacenters. The Pirlo set of tools consists of a TOR (top of rack) switch initializer and a server configurator and validator. It runs as worker processes on a generic distributed job queue, built-in house on top of MySQL, with a UI to track the progress of running jobs and visualize past data. Pirlo is built as pluggable modules with plenty of logging at every stage to debug and analyze automation runs. Dropbox has an NRE (Network Reliability Engineering) team, that works on building, automating and monitoring its production network. Most of Dropbox's code is in Python, although it is unclear if Pirlo is written in Python ...
Server and Network Operations Automation at Dropbox
https://www.infoq.com/news/2019/01/dropbox-datacenter-automationSee More From: infoq.com
Jan 26, 2019 10:00 AM 2+ mon ago
Search Builder
(Click to add to search box)
Other engineering teams server provisioner use job handler implementation Hardware Engineering team Network Reliability Engineering Zero Touch Provisioning validation automation tool job queues work job queue job handler network switch switch configuration queue manager Switch validation network design service discovery Debian systems validation process server machine OS image starter client stress tests firmware components Repaired machines use playbooks InfoQ account TOR switch ML QCon TOR starter worker processes switch provisioner production network client request pluggable architecture Queue Manager status codes database log engineering team Pirlo service server configurator
**Content contained on this site is provided on an “as is” basis. 4Internet, LLC makes no commitments regarding the content and does not review it, so don't assume that it's been reviewed. What you see here may not be accurate and should not be relied upon. The content does not necessarily represent the views and opinions of 4Internet, LLC. You use this service and everything you see here at your own risk. Content displayed may be subject to copyright. Content is removed on a case by case basis. To request that content be removed, contact us using the following form: Contact Us.