Data is at the heart of Bloomberg’s technologies, which produce, distribute and protect some of the most critical and valuable data in global business. The Storage Engineering teams design and maintain the systems which store, process and protect that data.
This is not a traditional storage team: we expect our engineers to design and build a highly available, scalable, and durable storage platform. Our platform is a unique mix of commodity hardware, open source software-defined storage, and appliance-based storage solutions. In addition to shepherding our core storage systems, our team is modernizing our automation software for provisioning and management of both appliance-based storage and software defined storage inside of the Bloomberg ecosystem. The Storage Engineering team works closely with the industry and our engineering users to stay at the forefront of both evolving hardware technologies, open source storage platforms and software engineering practices.
Storage Distributed Downstream is a newly created software engineering team within Storage Engineering with a mandate to integrate Ceph, an open source distributed storage platform, into the Bloomberg ecosystem, providing visibility and transparency into its operation while ensuring its availability and performance meets our customers needs.
We’re looking for strong Software Engineers with great coding, problem solving, and communication skills. Domain knowledge in storage is a plus but absolutely not required, we’ll teach you everything you need to know about storing bits’n’bytes.
What’s in it for you:
This is a unique opportunity to help build robust, petabyte-scale systems which will power the future of Bloomberg's automated storage infrastructure. We’ll trust you to design and implement telemetry to monitor the health of our clusters and customers’ data, as well as implement automation for efficiently managing the lifecycle and performance of our hardware while ensuring our systems are behaving consistently.
We utilize a myriad of open-source technologies to build our systems, such as S3, Ceph, Celery, RabbitMQ, Kafka, Docker, Apache Airflow and many more.
We'll trust you to:
-
Own the performance and availability of our storage products, innovating to continuously mature our product offerings.
-
Build automation around all phases of the storage lifecycle, eliminating toil, automating responses to failures, and generally eliminating as much operational work as possible
-
Develop technical solutions which combine hardware and software to achieve required service levels, performance, and economics
You’ll need to have:
-
Software development experience in Python or C/C++
-
Proficiency in software engineering principles with an interest in infrastructure
-
A degree in Computer Science, Engineering or similar field of study or equivalent work experience
We'd love to see:
- Experience with Ceph
- Experience working with scalable distributed systems including deep dives into code, networking and operating systems
- Contributions to Open Source projects especially related to Storage, Automation, or Performance Monitoring
- Knowledge and experience with data storage algorithms, technologies such as erasure coding, and complex production troubleshooting
- A keen interest in keeping abreast of technological advances and proven success at incorporating new technology into existing systems
