Guides, Open Source Projects, Podcasts, Videos and Notes to Build Reliable Large-Scale Distributed Systems.
An analytical performance modeling tool for deep neural networks.
DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks
Python implementation of 'Scalable Recommendation with Hierarchical Poisson Factorization'.
Extremely fast and scalable Python FTP server library
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
Always sparse. Never dense. But never say never. A repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).