getJobCounts include only active and prioritized jobs

[batchor]

My completed jobs seem to be automatically remove even with removeOnComplete: { age: 3600 }.

The results of getJobCounts include only active and prioritized jobs.

I print the results of getJobCounts() immediately after adding the job into a Queue,
and the results only include numbers active and prioritized jobs. The number of all other kind of jobs are zero.

Here is my code:

Worker

// worker.ts
export const compileWorker = new Worker(
    "compile",
    // processors/compile.js is a sandbox worker that actually executes the task
    path.join(__dirname, "processors/compile.js"),
    {
        connection: redis,
        concurrency: 10,
    },
)

Queue

// queue configuration
const compileQueue = new Queue("compile", { connection: redis })

...

job = await compileQueue.add("compile", {
    ...job_data
}, {
    priority: 1,
    jobId: uuid,
    removeOnComplete: {
        age: 3600, // keep up to 1 hour
    },
    removeOnFail: {
        age: 3600,
    },
})
logger.debug(`Add job: ${JSON.stringify(job.asJSON())}.`)
console.log(`!!!!!!!!!!!!!!!!`)
const count = await compileQueue.getJobCounts()
console.log(count)
console.log(`!!!!!!!!!!!!!!!!`)

I keep adding jobs to the Queue and printing the results of getJobCounts.
The results include ONLY prioritized and active jobs with non-zero counts, all other jobs are zero.

[roggervalf]

hey @batchor, we migth need a reproducible or a complete test case. Queue and worker configuration would help too

[batchor]

Hi @roggervalf , thanks for your response.

I updated my post to include more details.

My case is relatively simple. Could you provide some hints or possible reasons to my problem before I providing a minimal reproduction?

[manast]

We cannot see anything obvious in that code. Unfortunately without reproducible code we cannot dig deeper in the issue.