Job stuck being a processing job

[bleepsandblops]

Description

Hello,

Got a job that's stuck being a processing one, and no way to delete the processing one. There was a job 'pending' in the queue which I had to kill, but the Shopify table still shows that job as 'processing'. This is on Craft Cloud.

Steps to reproduce

Additional info

• Craft version: 5.8.19
• PHP version:
• Database driver & version:
• Plugins & versions: Shopify 6.1.1

[linear]

PT-2984

[nfourtythree]

Hi @bleepsandblops

Thank you for your message.

This sounds like an issue that we believe was solved in version 6.1.1. Can you see any errors in the logs? Are you seeing the same behaviour locally or only on cloud?

Thanks!

[plcdnl]

Hi,
not on craft cloud but same problem. Is there any way to clean the queue?

[nfourtythree]

Hi

If there is a bulk operation stuck in processing this usually means that the queue job failed at some point.

Did you see any errors in the queue?

If you need to you can remove the row from the database table shopify_bulkoperations

We are obviously keen to trying and figure out what could be happening to prevent this in the future.

Thanks!

[plcdnl]

Hi @nfourtythree, I tried to remove the row and noticed that after performing a new sync, the queue manager shows this row and it increases steadily without finishing and continue to show "processing" inside the plugin. What i can do?

[nfourtythree]

Hi @plcdnl

Thank you for your response. This does indeed look like a strange one.

A few questions on this:

• Is this on your local development environment?
• How do you have your queue set up?
• If you look in the shopify_bulkoperations table in the database and download the file in the url column. How many rows does the file have?

Hopefully we can get to the bottom of what is going on here, thanks!

[plcdnl]

Hi @nfourtythree,

it's on a remote development environment.

Regarding the queue setup, we're currently using the default configuration without any custom workers or supervisors. If needed, I can share the specific queue settings we have in place.

this is the query i did in mysql to check

mysql> SELECT id, url FROM shopify_bulkoperations ORDER BY id DESC LIMIT 1;
+----+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| id | url                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
+----+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 42 | https://storage.googleapis.com/shopify-tiers-assets-prod-us-east1/bulk-operation-outputs/gmrmbvobitdgzmzk0x3hvr41hafl-final?GoogleAccessId=assets-us-prod%40shopify-tiers.iam.gserviceaccount.com&Expires=1764929456&Signature=TcQKe%2BNEILBGvbnmpCkXMfjyAKe%2BnFZ%2BF36yzZ6581n2fi54eyviGSiOfGQBv1nWwcCVRCTmqboA5NLt0voj8vT84N0HPvQctoDrfZZmziV1cw244EeN63rNbX1ZCd30QLdbRFi3L4k%2BlB7haZnWfnMfU7aTXzLlMOAOA98w1VVJK5Vth%2Fc2KMv6Sl05egvNgkOxQTLrwtiAN3ByCh2wqn67q%2FizHZ1kprXiNPv0nui%2Fox1iU1b3t%2BUJXgps%2FsES3Lmc8bpVGdJaF%2B4ImbnH8IRrHii2Ur1on9Eup367UWGFhkLSxi%2B8JqCbqfHSseVy6AfFO8eGt18OpT8fuE89Hg%3D%3D&response-content-disposition=attachment%3B+filename%3D%22bulk-8644139352413.jsonl%22%3B+filename%2A%3DUTF-8%27%27bulk-8644139352413.jsonl&response-content-type=application%2Fjsonl |
+----+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.001 sec)

mysql> 

Let me know if you'd like me to run any additional checks — happy to help debug this further.

[dammerp]

Hello,

We have the same issue. Starting the first Sync leads us into endless bulk operation jobs.
At the moment it is "Processing bulk operation data (batch 395,259 of 74)" and going higher.

We are also using the default configuration.

We do not work on local environment.

The file referenced in the "url" column has 7,000 rows on my setup.

Let me know if we can provide any more information.

[jderdock]

@dammerp I have the same issue at the moment (""Processing bulk operation data (batch xxx,xxx of xx)"

Edit: I should add that I'm setting this integration up for the first time.

[nfourtythree]

Thank you all for adding information to this thread.

This is something we are investigating now, at the moment we are trying to find a way to replicate this issue.

A few questions that could potentially lead us to figuring out what is happening:

• For those that have had projects running, had these queue jobs worked before? Has it just started happening?
• Do you see the same behaviour locally as on staging/production servers?
• Do you have multiple queue workers?

Thanks!

[jderdock]

I haven't been able to find a clean way to test locally. Mine is running on a staging server.