Ad

fbcunn: GPU Acceleration for Torch Deep Learning

fbcunn provides optimized CUDA extensions for Torch, accelerating deep learning workloads with fast convolution, lookup table, and parallelization modules.
Screenshot of facebookarchive/fbcunn homepage

fbcunn delivers high-performance deep learning modules specifically engineered for GPUs, complementing the Torch framework. It accelerates convolutional neural networks and other neural network architectures. fbcunn offers optimized implementations for spatial and temporal convolutions, data parallelism, and lookup tables, streamlining the development of large-scale deep learning systems. The project is built on top of Torch and leverages CUDA for significant speedups.

fbcunn offers significant performance improvements for deep learning operations. It provides simple-to-use API wrappers for optimized convolution, data parallelism, and lookup table functionalities. The project includes comprehensive documentation, unit tests, and examples to facilitate integration into existing Torch projects. It supports efficient training on multiple GPUs, enabling faster model development and experimentation.

  • Convolution Modules: Fast spatial and temporal convolution implementations using techniques like FFT, significantly improving performance over standard Torch convolutions.
  • DataParallel & ModelParallel: Containers for efficient model parallelism across multiple GPUs, simplifying distributed training workflows.
  • LookupTable GPU: High-performance lookup table module optimized for neural language models and word embeddings, offering substantial speedups.
  • Hierarchical SoftMax: Module enabling efficient classification of large numbers of classes, a critical capability for many applications.
  • API Compatibility: Seamless integration with Torch's existing nn module, minimizing code changes for existing users.
  • FFT Wrappers: Wrappers to enable the use of FFT/IFFT as neural network modules, providing greater flexibility in network design.
  • Max/LP Pooling: Implementation of Max and L1-based Pooling operations suitable for MaxOut layers, enhancing network capabilities.

fbcunn is a mature project with a history of development and active maintenance, last updated in 2017. It has a solid foundation of unit tests, examples, and documentation making it reliable for production use. The project's popularity suggests a strong community interest and ongoing relevance within the deep learning research landscape. The archived status does not indicate inactivity, but rather a transition to a stable state.

fbcunn benefits researchers and developers working with deep learning models, particularly those using the Torch framework. It enables faster training and inference, facilitating the development of complex models for image recognition, NLP, and other applications. It offers a practical alternative to implementing custom GPU acceleration techniques, and simplifies distributed training workflows, allowing users to focus on model design rather than low-level optimization.

Summarize:
Share:
Stars
1,059
Forks
242
Issues
38
Created
11 years ago
Commit
9 years ago
License
OTHER
Archived
Yes
Updated 15 days ago

Similar Repositories