Context:

• Debian Code Search: Bachelor Thesis (2012)
• Announcing the new Debian Code Search Instant (2014)
  • Debian Code Search: taming the latency tail (2014)
• Debian Code Search: improving client-side latency (2016)
• Debian Code Search: positional index, TurboPFor-compressed (2019)
  • TurboPFor: an analysis (2019)
• Debian Code Search: OpenAPI now available (2021)

Documentation:

• Setting up a small instance of DCS for hacking
• Debian Code Search Index format

Guide to this repository:

• cmd/dcs is the swiss-army knife tool for Debian Code Search, displaying index files in a variety of ways.
• cmd/dcs-localdcs runs a local development instance of Debian Code Search.

The service itself consists of the following services / jobs:

• cmd/dcs-compute-ranking generates ranking.json based on the Debian Popularity Contest (popcon).
• cmd/dcs-feeder feeds packages to multiple dcs-package-importer shards.
• cmd/dcs-web is the web server which runs searches on multiple dcs-source-backend shards.

Each shard (codesearch.debian.net uses 6 shards) runs:

• A cmd/dcs-package-importer to receive, unpack and index Debian packages for this shard.
• A cmd/dcs-source-backend to run actual searches over imported source code.