Ad

cell2sentence: LLMs for Single-Cell Analysis

Cell2Sentence applies Large Language Models to single-cell data by transforming gene expression into natural language descriptions. This framework enables advanced analysis tasks like cell type prediction and perturbation prediction using LLMs.

Cell2Sentence (C2S) translates single-cell transcriptomic data into 'cell sentences,' which are ordered lists of gene names representing cell identities. This enables large language models (LLMs) to understand and analyze scRNA-seq data using natural language processing techniques. The core problem addressed is leveraging the power of LLMs for more intuitive and flexible single-cell analysis compared to traditional methods, using a rank-ordering transformation of expression vectors.

C2S introduces a novel approach to integrate single-cell data with LLMs, enabling tasks like perturbation prediction, dataset summarization, and cell type classification. The framework supports various LLM architectures, including Pythia and Gemma. Flexibility in prompt engineering and finetuning on custom datasets is also a key strength. The availability of pre-trained models on HuggingFace streamlines adoption and experimentation.

  • Cell Type Prediction: Predicts cell types directly from the generated cell sentences.
  • Data Summarization: Generates concise summaries of single-cell datasets.
  • Perturbation Prediction: Predicts the effect of perturbations on cell populations.
  • Cell Generation: Generates realistic cell sentences with specified cell types.
  • Customizable Prompts: Allows for the definition of custom prompt templates.
  • Multi-Task Learning: Supports multiple tasks like cell type prediction and generation.
  • Ease of Use: Provides easy-to-use tutorials and documentation.

The project has a robust development history with regular updates, new model releases (including C2S-Scale models), and active community engagement signaled by ICML 2024 acceptance. The presence of numerous tutorials and a comprehensive documentation page indicates a well-maintained and reliable codebase. Recent releases focus on scalability and improved model capabilities.

Cell2Sentence benefits researchers and developers working with single-cell data by providing a framework to leverage the power of LLMs for analysis. It is valuable for understanding complex biological datasets, predicting cellular responses to perturbations, and automating tasks like cell type annotation. By bridging the gap between computational models and biological understanding, C2S offers a powerful alternative to traditional single-cell analysis methods and manual interpretation.

Summarize:
Share:
Stars
873
Forks
130
Issues
12
Created
1 year ago
Commit
8 months ago
License
APACHE-2.0
Archived
No
Updated 16 days ago

Similar Repositories