Project details for gensim

Logo gensim 0.8.0

by Radim - June 21, 2011, 01:20:53 CET [ Project Homepage BibTeX BibTeX for corresponding Paper Download ]

view ( today), download ( today ), 0 subscriptions


Gensim - Python Framework for Vector Space Modelling

Gensim is a Python library for Vector Space Modelling with very large corpora. Target audience is the Natural Language Processing (NLP) community.


  • All algorithms are memory-independent w.r.t. the corpus size (can process input larger than RAM),

  • Intuitive interfaces

  • easy to plug in your own input corpus/datastream (trivial streaming API)

  • easy to extend with other Vector Space algorithms (trivial transformation API)

  • Efficient implementations of popular algorithms, such as online Latent Semantic Analysis, Latent Dirichlet Allocation or Random Projections

  • Distributed computing: can run Latent Semantic Analysis and Latent Dirichlet Allocation on a cluster of computers.

  • extensive documentation and tutorials

Reference example

>>> from gensim import corpora, models, similarities
>>> # load corpus iterator from a Matrix Market file on disk
>>> corpus = corpora.MmCorpus('/path/to/')
>>> # initialize a transformation (Latent Semantic Indexing with 200 latent dimensions)
>>> lsi = models.LsiModel(corpus, num_topics=200)
>>> # convert the same corpus to latent space and index it
>>> index = similarities.MatrixSimilarity(lsi[corpus])
>>> # perform similarity query of another vector in LSI space against the whole corpus
>>> sims = index[query]
Changes to previous version:
  • faster document similarity queries
  • more optimizations to Latent Dirichlet Allocation (online LDA) and Latent Semantic Analysis (single pass online SVD) (Wikipedia experiments )
  • full change set here
BibTeX Entry: Download
Corresponding Paper BibTeX Entry: Download
Supported Operating Systems: Platform Independent
Data Formats: Agnostic
Tags: Latent Semantic Analysis, Latent Dirichlet Allocation, Svd, Random Projections, Tfidf
Archive: download here


No one has posted any comments yet. Perhaps you'd like to be the first?

Leave a comment

You must be logged in to post comments.