Support enqueue with custom priority

[MercusChan]

While enqueue to a name queue, this is practical need to have custom priority on-demand.
Function call with custom high priority, so that critical or premium-tier user / feature can start sooner

[guibeira]

We currently do not support priority at the queue level today, another way to do this is using two queues, and leave the caller to decide which queue you should use.:
at your config.yaml

workers:
    - name: iii-queue
      config:
        queue_configs:
          orders-high:
            type: standard
            concurrency: 20
            max_retries: 5
            backoff_ms: 500

          orders-default:
            type: standard
            concurrency: 5
            max_retries: 3
            backoff_ms: 1000

 import { registerWorker, TriggerAction } from "iii-sdk";

  const iii = registerWorker("ws://127.0.0.1:49134", {
    workerName: "orders-worker",
  });

  iii.registerFunction("orders::process", async (order: any) => {
    // real process of the order.
    return { ok: true, order_id: order.id };
  });

  iii.registerFunction("orders::submit", async (order: any) => {
    const queue =
      order.customer_tier === "premium" || order.critical === true
        ? "orders-high"
        : "orders-default";

    const receipt = await iii.trigger({
      function_id: "orders::process",
      payload: order,
      action: TriggerAction.Enqueue({ queue }),
    });

    return {
      queued: true,
      queue,
      receipt,
    };
  });

[MercusChan]

Thank for your idea.
It is using another larger concurrency queue for serve high priority task.

This is cannot utilize on shared same set of hardware resources.
For example, a process requires 1 GPU.
Default queue is served by 5 GPUs
Priority queue is served by 20 GPUs
Assume, the amount of priority tasks are 25% default tasks
Then, does 20 GPUs are usually idle?

[anthonyiscoding]

@MercusChan This is an interesting usecase and we'll flag for the team to review possible solutions. Also are you using the built-in queue adapter or one of the external adapters (ie. redis, or rabbitmq)?

[MercusChan]

It is named queue, type: standard, builtin adapter, file_based.