Custom Vision AI training has been stuck for hours

Nadia Ardian 35 Reputation points
2025-09-08T18:00:22.64+00:00

Hi, I recently ran Quick Training on my object detection project and it's been stuck for hours, whereas the previous iterations only took minutes. I tried to stop/delete the iteration but there seems to be no way to do so. How should I troubleshoot this?

PS: I have the standard tier custom vision resource.

image

Azure AI Custom Vision
Azure AI Custom Vision
An Azure artificial intelligence service and end-to-end platform for applying computer vision to specific domains.
{count} votes

Answer accepted by question author
  1. Anshika Varshney 2,075 Reputation points Microsoft External Staff Moderator
    2025-09-10T07:06:08.7+00:00

    Hello Nadia Ardian,

    Thank you for reaching out on the Microsoft Q&A.

    If your Custom Vision training has been stuck for hours, it’s usually related to high training traffic or resource availability. During busy periods, many customers might be running training jobs at the same time, which can cause delays in the queue. While earlier iterations may have finished in minutes, later ones can take longer if the system is under heavy load.

    It’s also important to note that once training has started, there’s currently no option to manually stop or cancel it. The system will eventually finish the job or stop automatically when your training budget is reached. You also won’t be billed beyond the set budget, so even if it looks like it’s running indefinitely, the charges remain capped.

    If this continues to happen often, it’s worth double-checking your training budget and resource tier. For larger datasets or advanced training options, you may need to allocate more training hours. Quick Training is usually faster but depending on the image volume and complexity of the project, training time can vary.

    In most cases, the best approach is to give it more time and let the system handle the queue. Once the training completes, you should see the results reflected in the iteration list.

    Please find the attached document for your reference:

    If you feel that your quires have been resolved, please accept the answer by clicking the "Upvote" and "Accept Answer" on the post.

    Thank you!

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Marko Novaković 0 Reputation points
    2025-09-13T15:39:34.3933333+00:00

    I'm facing a same issue.
    My model is stuck in "Training..." for weeks.
    Usually it takes 5-6 hours but now it's "Training..." literally for weeks.
    I've added new images for training but I can't train a new model while I have model in training, but this one just won't complete.
    I did set a training limit of 24 hours, so it should've been terminated either way.


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.