Pause queues (#15928)

* Start adding mechanism to return unhandled data

Signed-off-by: Andrew Thornton <[email protected]>

* Create pushback interface

Signed-off-by: Andrew Thornton <[email protected]>

* Add Pausable interface to WorkerPool and Manager

Signed-off-by: Andrew Thornton <[email protected]>

* Implement Pausable and PushBack for the bytefifos

Signed-off-by: Andrew Thornton <[email protected]>

* Implement Pausable and Pushback for ChannelQueues and ChannelUniqueQueues

Signed-off-by: Andrew Thornton <[email protected]>

* Wire in UI for pausing

Signed-off-by: Andrew Thornton <[email protected]>

* add testcases and fix a few issues

Signed-off-by: Andrew Thornton <[email protected]>

* fix build

Signed-off-by: Andrew Thornton <[email protected]>

* prevent "race" in the test

Signed-off-by: Andrew Thornton <[email protected]>

* fix jsoniter mismerge

Signed-off-by: Andrew Thornton <[email protected]>

* fix conflicts

Signed-off-by: Andrew Thornton <[email protected]>

* fix format

Signed-off-by: Andrew Thornton <[email protected]>

* Add warnings for no worker configurations and prevent data-loss with redis/levelqueue

Signed-off-by: Andrew Thornton <[email protected]>

* Use StopTimer

Signed-off-by: Andrew Thornton <[email protected]>

Co-authored-by: Lauris BH <[email protected]>
Co-authored-by: 6543 <[email protected]>
Co-authored-by: techknowlogick <[email protected]>
Co-authored-by: wxiaoguang <[email protected]>

This commit is contained in:

zeripath

2022-01-22 21:22:14 +00:00

committed by

GitHub

co-authored by

Lauris BH

6543

techknowlogick

wxiaoguang

parent 27ee01e1e8

commit a82fd98d53

34 changed files with 1389 additions and 122 deletions

									
										modules/queue/queue_disk_test.go
									
		+2
		-1
	
												View File
												
				@@ -17,12 +17,13 @@ import (

				func TestLevelQueue(t *testing.T) {

					handleChan := make(chan *testData)

					handle := func(data ...Data) {

					handle := func(data ...Data) []Data {

						assert.True(t, len(data) == 2)

						for _, datum := range data {

							testDatum := datum.(*testData)

							handleChan <- testDatum

						}

						return nil

					}

					var lock sync.Mutex