forgejo-federation/modules/indexer/code
zeripath ba526ceffe
Multiple Queue improvements: LevelDB Wait on empty, shutdown empty shadow level queue, reduce goroutines etc (#15693)
* move shutdownfns, terminatefns and hammerfns out of separate goroutines

Coalesce the shutdownfns etc into a list of functions that get run at shutdown
rather then have them run at goroutines blocked on selects.

This may help reduce the background select/poll load in certain
configurations.

* The LevelDB queues can actually wait on empty instead of polling

Slight refactor to cause leveldb queues to wait on empty instead of polling.

* Shutdown the shadow level queue once it is empty

* Remove bytefifo additional goroutine for readToChan as it can just be run in run

* Remove additional removeWorkers goroutine for workers

* Simplify the AtShutdown and AtTerminate functions and add Channel Flusher

* Add shutdown flusher to CUQ

* move persistable channel shutdown stuff to Shutdown Fn

* Ensure that UPCQ has the correct config

* handle shutdown during the flushing

* reduce risk of race between zeroBoost and addWorkers

* prevent double shutdown

Signed-off-by: Andrew Thornton <art27@cantab.net>
2021-05-15 16:22:26 +02:00
..
bleve.go On open repository open common cat file batch and batch-check (#15667) 2021-05-10 03:27:03 +02:00
bleve_test.go Support elastic search for code search (#10273) 2020-08-30 19:08:01 +03:00
elastic_search.go On open repository open common cat file batch and batch-check (#15667) 2021-05-10 03:27:03 +02:00
elastic_search_test.go Fix bug on elastic search (#12811) 2020-09-12 20:31:52 +08:00
git.go Reduce calls to git cat-file -s (#14682) 2021-02-17 22:32:25 +01:00
indexer.go Multiple Queue improvements: LevelDB Wait on empty, shutdown empty shadow level queue, reduce goroutines etc (#15693) 2021-05-15 16:22:26 +02:00
indexer_test.go [Feature] add precise search type for Elastic Search (#12869) 2021-01-27 12:00:35 +02:00
search.go [Feature] add precise search type for Elastic Search (#12869) 2021-01-27 12:00:35 +02:00
wrapped.go [Feature] add precise search type for Elastic Search (#12869) 2021-01-27 12:00:35 +02:00