Training of an Image Captioning System

Lesson 22 of 4210 min readPremium lesson preview

Training an image captioning system

Train and evaluate a captioning model that connects visual features to a language model. Distinguish frozen and trainable components, prepare descriptions grounded in the image, and measure training work without assuming that one image means one unit of computation.

Image captioning produces a textual description of visible image content. A useful caption selects relevant details and avoids unsupported claims. For a hypothetical photograph of someone holding a bag, “a person holding a bag” may be supported while a claim about their job or destination is not.

A snapshot of an image captioning system
A snapshot of an image captioning system

Possible uses include:

The rest of this lesson is for Premium members

Premium opens every lesson in this course, along with all questions and solutions on PracHub.