As we continue our experiments in video description using Google's Gemini 1.5 Pro, let's ask Gemini for help in crafting some more interesting prompts. Here we ask Gemini to recommend some prompts to visually describe each frame, with mixed results, though our final prompt that combines all of the recommendations and includes an explicit length requirement yields some intriguing results.

Here we'll use our surrogate video of our 6 minute clip, sampled at 1/4fps and reassembled into a 1fps surrogate flipbook, same as we've used in our past experiments.

Let's try the trivial:

Suggest some prompts that would describe this video frame-by-frame.

This yields:

Here are some prompts that would describe this video frame-by-frame in the same way that I do:
Describe what is happening in this video frame by frame.
Summarize the main events and themes of the video frame-by-frame, focusing on the most important and interesting information.
Describe what is happening in the video frame-by-frame, focusing on the most important and interesting visual elements.
What is happening in this frame of the video? What are the people doing? What is the setting?
What are the most important and interesting things to notice in this frame of the video?
What emotions are being expressed in this frame of the video?
What is the overall tone of this frame of the video?
By focusing on the most important and interesting visual elements, these prompts will help to create a detailed and engaging description of the video.

Let's try the first one:

Describe what is happening in this video frame by frame.

This yields:

00:00 A woman with blonde hair and glasses is sitting at a desk with a microphone and laptop. She is looking at the laptop and appears to be speaking.
00:01 A grid of podcast covers is shown.
00:02 A red and blue graphic with the text "SMOTRIM" is shown.
00:03 A clock with Roman numerals is shown against a blue background with digital lines.
00:04 The clock's hands move forward one minute.
00:05 The clock's hands move forward another minute.
00:06 The clock's hands move forward another minute.
00:07 A man in a suit is standing behind a desk in a news studio. He is looking at the camera and appears to be speaking.
00:08 The man is still speaking and gesturing with his hands.
00:09 A blue graphic with the number "4" is shown.
00:10 Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is looking at the camera and appears to be speaking.
00:11 Putin continues speaking.
00:12 Putin continues speaking.
00:13 A man in a military uniform is walking down a hallway carrying a bouquet of flowers.
00:14 The man is presenting the flowers to a woman in a military uniform.
00:15 A fire is burning in a building.
00:16 A drone is flying over a field. A white object is falling from the drone.
00:17 A man is walking down a road in a rural area.
00:18 Joe Biden is standing at a podium in the US Capitol Building. He is waving to the crowd.
00:19 Biden is speaking at the podium. Kamala Harris and another man are seated behind him.
00:20 Biden continues speaking.
00:21 Biden is shaking hands with a woman.
00:22 Biden is shaking hands with another woman.
00:23 A blue graphic with the number "4" is shown.
00:24 A group of people are holding signs and protesting.
00:25 A military vehicle is driving down a road.
00:26 A crowd of people are gathered in a village.
00:27 A man is working in a factory. He is pouring molten metal into a mold.
00:28 A man is standing on a boat in a harbor. He is speaking to the camera.
00:29 A herd of deer is standing in a snowy forest.
00:30 A man is standing in the forest with the deer. He is speaking to the camera.
00:31 A baby panda is lying on its back.
00:32 Three women in traditional Russian clothing are dancing on a game show.
00:33 A blue graphic with the number "4" is shown.
00:34 A blue graphic with a map of the world is shown.
00:35 The graphic zooms in on the word "VESTI".
00:36 A man in a suit is standing behind a desk in a news studio. A bouquet of pink tulips is shown on a screen behind him.
00:37 The man is speaking to the camera.
00:38 The man continues speaking.
00:39 The man continues speaking.
00:40 The man continues speaking.
00:41 The man continues speaking.
00:42 Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is looking at the camera and appears to be speaking.
00:43 Putin continues speaking.
00:44 Putin continues speaking.
00:45 Putin continues speaking.
00:46 Putin continues speaking.
00:47 Putin continues speaking.
00:48 Putin continues speaking.
00:49 Putin continues speaking.
00:50 Putin continues speaking.
00:51 Putin continues speaking.
00:52 Putin continues speaking.
00:53 Putin continues speaking.
00:54 Putin continues speaking.
00:55 Putin continues speaking.
00:56 Putin continues speaking.
00:57 Putin continues speaking.
00:58 Putin continues speaking.
00:59 Putin continues speaking.
01:00 Putin continues speaking.
01:01 Putin continues speaking.
01:02 Putin continues speaking.
01:03 Putin continues speaking.
01:04 Putin continues speaking.
01:05 Putin continues speaking.
01:06 Putin continues speaking.
01:07 Putin continues speaking.
01:08 Putin continues speaking.
01:09 Putin continues speaking.
01:10 Putin continues speaking.
01:11 A man in a suit is standing behind a desk in a news studio. A bouquet of white tulips is shown on a screen behind him.
01:12 The man is speaking to the camera.
01:13 The man continues speaking. A variety of colorful tulips are shown on a screen behind him.
01:14 The man continues speaking.
01:15 A soldier is handing a tulip to a woman on the street.
01:16 The soldier is holding a basket of tulips.
01:17 The soldier is speaking to the camera.
01:18 Two women are holding tulips and smiling.
01:19 A woman is hugging the soldier.
01:20 The soldier is handing a tulip to a woman.
01:21 The soldier is handing a tulip to a young girl.
01:22 The soldier is holding a basket of tulips.
01:23 Two women are holding tulips and smiling.
01:24 A woman in a headscarf is receiving a tulip from the soldier.
01:25 A woman is holding a white tulip and smiling.
01:26 The soldier is speaking to the camera.
01:27 A mime is handing a rose to a woman.
01:28 The mime is handing a rose to a young woman.
01:29 The mime is handing a bouquet of flowers to a woman.

How about?

Summarize the main events and themes of the video frame-by-frame, focusing on the most important and interesting information.

The first time it deviates from the prompt to yield:

The video begins with a woman speaking on a podcast about the importance of family. It then cuts to a news segment about Vladimir Putin's International Women's Day address, in which he praises the strength and resilience of Russian women, particularly those who are serving in the military or supporting their loved ones who are. The video then shows footage of soldiers giving flowers to women on the street, as well as Putin's address to the nation. The video ends with a montage of women smiling and receiving flowers.
The main events and themes of the video are:
The importance of family
The strength and resilience of Russian women
The role of women in the Russian military
Vladimir Putin's International Women's Day address
The celebration of International Women's Day in Russia
The most important and interesting information in the video is Putin's praise for Russian women and his call for the nation to support families. This is significant because it shows that the Russian government is aware of the challenges that families are facing and is committed to providing them with support.

The second time it yields similar results:

Main Events and Themes of the Video Frame-by-Frame:
Frames 00:00-00:02: Introduction to the video, with a focus on the importance of family.
Frames 00:03-00:06: Transition to a news segment.
Frames 00:07-00:09: News anchor introduces Vladimir Putin's International Women's Day address.
Frames 00:10-01:10: Putin praises the strength and resilience of Russian women, particularly those who are serving in the military or supporting their loved ones who are. He also calls for the nation to support families.
Frames 01:11-01:14: News anchor discusses the celebration of International Women's Day in Russia.
Frames 01:15-01:29: Montage of soldiers giving flowers to women on the street, as well as women smiling and receiving flowers.
Most Important and Interesting Information:
The most important and interesting information in the video is Putin's praise for Russian women and his call for the nation to support families. This is significant because it shows that the Russian government is aware of the challenges that families are facing and is committed to providing them with support.
Additionally, the montage of soldiers giving flowers to women on the street is a powerful reminder of the sacrifices that Russian women are making for their country. It also shows that the Russian people are united in their support for the military and their families.

How about?

Describe what is happening in the video frame-by-frame, focusing on the most important and interesting visual elements.

This yields:

Description of the Video Frame-by-Frame, Focusing on the Most Important and Interesting Visual Elements:
Frame 00:00: A woman with blonde hair and glasses is speaking into a microphone. She is wearing a blue shirt and has a serious expression on her face. Behind her is a black wall with a red and white logo.
Frame 00:01: A grid of podcast covers is shown. The covers are colorful and feature a variety of images and text.
Frame 00:02: A red and blue graphic with the text "SMOTRIM" is shown. The graphic is abstract and modern.
Frames 00:03-00:06: A clock with Roman numerals is shown against a blue background with digital lines. The clock's hands move forward one minute at a time.
Frame 00:07: A man in a suit is standing behind a desk in a news studio. He is looking at the camera and appears to be speaking. Behind him is a large screen with a map of the world.
Frame 00:08: The man is still speaking and gesturing with his hands. The map of the world behind him is now focused on Russia.
Frame 00:09: A blue graphic with the number "4" is shown.
Frame 00:10: Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is looking at the camera and appears to be speaking. He is wearing a dark suit and tie and has a serious expression on his face.
Frames 00:11-01:10: Putin continues speaking. The camera zooms in on his face and shows him gesturing with his hands.
Frame 01:11: A man in a suit is standing behind a desk in a news studio. A bouquet of white tulips is shown on a screen behind him.
Frames 01:12-01:14: The man is speaking to the camera. The screen behind him shows footage of people celebrating International Women's Day in Russia.
Frame 01:15: A soldier is handing a tulip to a woman on the street. The woman is smiling and appears to be grateful.
Frame 01:16: The soldier is holding a basket of tulips. The tulips are colorful and vibrant.
Frames 01:17-01:20: The soldier is speaking to the camera and handing out tulips to women on the street. The women are all smiling and appear to be happy to receive the flowers.
Frame 01:21: The soldier is handing a tulip to a young girl. The girl is smiling and looking at the soldier with admiration.
Frame 01:22: The soldier is holding a basket of tulips. The basket is almost empty, indicating that he has given out most of the flowers.
Frames 01:23-01:25: More footage of women smiling and receiving flowers from the soldier.
Frame 01:26: The soldier is speaking to the camera. He says that he is happy to be able to give flowers to women on International Women's Day.
Frames 01:27-01:29: A mime is handing out roses to women on the street. The women are all smiling and appear to be enjoying the performance.
The most important and interesting visual elements in the video are the footage of Putin speaking and the montage of women receiving flowers. Putin's address is significant because it shows the Russian government's support for families and women. The montage of women receiving flowers is a powerful reminder of the importance of women in Russian society.

Finally, what if we combine all of Gemini's recommendations together into a single prompt and add some additional clarifying instructions?

Summarize the main events and themes of the video frame-by-frame, focusing on the most important and interesting information. Describe what is happening in the frame. What are the people doing? What is the setting? What are the most important and interesting things to notice in this frame of the video? What emotions are being expressed in this frame of the video? What is the overall tone of this frame of the video? Provide your output as a table, where each row is one second of airtime, with the first column being the time from the start of the video and the second column being your description of that second of airtime.

This yields a result similar to our earlier results – combining all of the prompts together did not yield significantly better results:

Time Description
00:00 A woman with blonde hair and glasses is sitting at a desk with a microphone and laptop. She is looking at the laptop and appears to be recording a podcast.
00:01 A montage of podcast covers is shown, featuring a variety of topics and hosts.
00:02 The logo for the Russian streaming service "Smotrim" is displayed.
00:03 A clock with Roman numerals is shown against a blue background with digital lines. The clock is ticking.
00:04 The clock continues to tick.
00:05 The clock continues to tick.
00:06 The clock continues to tick.
00:07 A news anchor is sitting at a desk in a studio with a large screen behind him showing a map of the world.
00:08 The news anchor is speaking and gesturing with his hands.
00:09 A graphic with the number "4" is shown.
00:10 Russian President Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is speaking to the camera.
00:11 Putin continues to speak.
00:12 Putin continues to speak.
00:13 A man in a military uniform is walking down a hallway carrying a bouquet of flowers.
00:14 The man in the military uniform is presenting the bouquet of flowers to a woman in a medical uniform.
00:15 A fire is burning in a building.
00:16 A drone is flying over a field. A white object is seen falling from the drone.
00:17 A man is walking down a dirt road in a rural area.
00:18 US President Joe Biden is standing at a podium in the US Capitol Building. He is waving to the audience.
00:19 Biden is speaking at the podium. Vice President Kamala Harris and another man are seated behind him.
00:20 Biden continues to speak.
00:21 Biden is shaking hands with people in the audience.
00:22 Biden continues to shake hands with people in the audience.
00:23 A blue graphic with abstract shapes is shown.
00:24 A man is holding a sign at a protest. The sign is in Polish.
00:25 A blurry image of a military vehicle is shown.
00:26 A crowd of people is gathered in a street in Nigeria.
00:27 A worker is pouring molten metal into a mold.
00:28 A reporter is standing on a boat in a harbor. He is speaking to the camera.
00:29 A herd of deer is standing in a snowy forest.
00:30 A reporter is standing in the forest with the deer. He is speaking to the camera.
00:31 A baby panda is lying on its back.
00:32 Three women in traditional Russian costumes are dancing on a game show.
00:33 A blue graphic with abstract shapes is shown.
00:34 A blue graphic with a map of the world is shown.
00:35 The logo for the Russian news program "Vesti" is displayed.
00:36 The news anchor is sitting at his desk with a bouquet of pink tulips on the screen behind him.
00:37 The news anchor is speaking.
00:38 The news anchor continues to speak.
00:39 The news anchor continues to speak.
00:40 The news anchor continues to speak.
00:41 The news anchor continues to speak.
00:42 Putin is speaking to the camera.
00:43 Putin continues to speak.
00:44 Putin continues to speak.
00:45 Putin continues to speak.
00:46 Putin continues to speak.
00:47 Putin continues to speak.
00:48 Putin continues to speak.
00:49 Putin continues to speak.
00:50 Putin continues to speak.
00:51 Putin continues to speak.
00:52 Putin continues to speak.
00:53 Putin continues to speak.
00:54 Putin continues to speak.
00:55 Putin continues to speak.
00:56 Putin continues to speak.
00:57 Putin continues to speak.
00:58 Putin continues to speak.
00:59 Putin continues to speak.
01:00 Putin continues to speak.
01:01 Putin continues to speak.
01:02 Putin continues to speak.
01:03 Putin continues to speak.
01:04 Putin continues to speak.
01:05 Putin continues to speak.
01:06 Putin continues to speak.
01:07 Putin continues to speak.
01:08 Putin continues to speak.
01:09 Putin continues to speak.
01:10 Putin continues to speak.
01:11 The news anchor is speaking with a bouquet of white tulips on the screen behind him.
01:12 The news anchor continues to speak.
01:13 The news anchor continues to speak with a bouquet of colorful tulips on the screen behind him.
01:14 The news anchor continues to speak.
01:15 A soldier is handing a woman a tulip on a city street.
01:16 The soldier is holding a basket of tulips.
01:17 The soldier is speaking to the camera.
01:18 Two women are holding tulips on a city street.
01:19 A woman is hugging the soldier.
01:20 The soldier is handing a woman a tulip.
01:21 The soldier is handing a young girl a tulip.
01:22 The soldier is holding a bouquet of tulips.
01:23 Two women are holding tulips.
01:24 A soldier is handing a woman a tulip.
01:25 A woman is holding a white tulip.
01:26 A soldier is speaking to the camera.
01:27 A mime is handing a woman a rose.
01:28 The mime is handing a woman a rose.
01:29 The mime is handing a woman a bouquet of flowers.

Finally, let's add a length requirement to nudge Gemini towards longer descriptions:

Summarize the main events and themes of the video frame-by-frame, focusing on the most important and interesting information. Describe what is happening in the frame. What are the people doing? What is the setting? What are the most important and interesting things to notice in this frame of the video? What emotions are being expressed in this frame of the video? What is the overall tone of this frame of the video? Provide your output as a table, where each row is one second of airtime, with the first column being the time from the start of the video and the second column being your description of that second of airtime. Be as detailed as you can. Make each description at least 6 sentences long and as many as 20 sentences long.

Strangely, this does not appear to change the results in any meaningful way:

Time Description
00:00 A woman with blonde hair and glasses is sitting at a desk with a microphone in front of her. She is looking at a laptop and appears to be recording a podcast.
00:01 A montage of podcast covers is shown, with a variety of topics and hosts.
00:02 The logo for the Russian streaming service "Smotrim" is shown.
00:03 A clock with Roman numerals is shown against a blue background with digital lines and dots. The clock is ticking.
00:04 The clock continues to tick.
00:05 The clock continues to tick.
00:06 The clock continues to tick.
00:07 A news anchor is sitting at a desk in a studio with a large screen behind him showing a map of the world.
00:08 The news anchor is speaking and gesturing with his hands.
00:09 A graphic with the number "4" is shown.
00:10 Russian President Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is speaking to the camera.
00:11 Putin continues to speak.
00:12 Putin continues to speak.
00:13 A man in a military uniform is walking down a hallway carrying a bouquet of flowers.
00:14 The man in the military uniform is presenting the bouquet of flowers to a woman in a medical uniform.
00:15 A fire is burning in a building.
00:16 A drone is flying over a field. A white object is seen falling from the drone.
00:17 A man is walking down a road in a rural area.
00:18 US President Joe Biden is standing at a podium in the US Capitol Building. He is waving to the audience.
00:19 Biden is speaking to the audience. Vice President Kamala Harris and House Speaker Kevin McCarthy are seated behind him.
00:20 Biden continues to speak.
00:21 Biden is shaking hands with people in the audience.
00:22 Biden continues to shake hands with people in the audience.
00:23 A graphic with the number "4" is shown.
00:24 A group of people are holding signs and protesting.
00:25 A military vehicle is driving down a road.
00:26 A crowd of people are gathered in a village.
00:27 A worker is pouring molten metal into a mold.
00:28 A reporter is standing on a boat in a harbor. He is speaking to the camera.
00:29 A herd of deer is standing in a snowy forest.
00:30 A reporter is standing in the forest with the deer. He is speaking to the camera.
00:31 A baby panda is lying on its back.
00:32 Three women in traditional Russian costumes are dancing on a stage.
00:33 A graphic with the number "4" is shown.
00:34 A digital animation of the Earth is shown.
00:35 The logo for the Russian news program "Vesti" is shown.
00:36 The news anchor is sitting at a desk in the studio. A bouquet of pink tulips is shown on the screen behind him.
00:37 The news anchor is speaking.
00:38 The news anchor continues to speak.
00:39 The news anchor continues to speak.
00:40 The news anchor continues to speak.
00:41 The news anchor continues to speak.
00:42 Putin is speaking to the camera.
00:43 Putin continues to speak.
00:44 Putin continues to speak.
00:45 Putin continues to speak.
00:46 Putin continues to speak.
00:47 Putin continues to speak.
00:48 Putin continues to speak.
00:49 Putin continues to speak.
00:50 Putin continues to speak.
00:51 Putin continues to speak.
00:52 Putin continues to speak.
00:53 Putin continues to speak.
00:54 Putin continues to speak.
00:55 Putin continues to speak.
00:56 Putin continues to speak.
00:57 Putin continues to speak.
00:58 Putin continues to speak.
00:59 Putin continues to speak.
01:00 Putin continues to speak.
01:01 Putin continues to speak.
01:02 Putin continues to speak.
01:03 Putin continues to speak.
01:04 Putin continues to speak.
01:05 Putin continues to speak.
01:06 Putin continues to speak.
01:07 Putin continues to speak.
01:08 Putin continues to speak.
01:09 Putin continues to speak.
01:10 Putin continues to speak.
01:11 The news anchor is speaking. A bouquet of white tulips is shown on the screen behind him.
01:12 The news anchor continues to speak.
01:13 The news anchor continues to speak. A bouquet of colorful tulips is shown on the screen behind him.
01:14 The news anchor continues to speak.
01:15 A man in a military uniform is handing a tulip to a woman on the street.
01:16 The man in the military uniform is holding a basket of tulips.
01:17 The man in the military uniform is speaking to the camera.
01:18 Two women are holding tulips and smiling.
01:19 A woman is hugging the man in the military uniform.
01:20 The man in the military uniform is handing a tulip to a woman.
01:21 The man in the military uniform is handing a tulip to a young girl.
01:22 The man in the military uniform is holding a bouquet of tulips.
01:23 Two women are holding tulips and smiling.
01:24 A woman in a headscarf is receiving a tulip from the man in the military uniform.
01:25 A woman is holding a white tulip and smiling.
01:26 The man in the military uniform is speaking to the camera.
01:27 A mime is handing a rose to a woman.
01:28 The mime is handing a rose to a young woman.
01:29 The mime is handing a bouquet of flowers to a woman.

Running a second time, the results are better, but still not fantastic:

Frame-by-Frame Summary of Russian News Broadcast on International Women's Day
Time Description
00:00 A woman with blonde hair and glasses sits at a desk with a microphone, laptop, and papers in front of her. She is looking at the laptop and appears to be recording a podcast.
00:01 A montage of podcast covers is shown, with a variety of topics and hosts.
00:02 The logo for "Smotrim" is shown, with the text "smotrim.ru/podcasts" underneath.
00:03 A clock with Roman numerals is shown against a blue background with digital lines and dots. The clock is ticking and the hands are moving.
00:04 The clock continues to tick and the hands move closer to midnight.
00:05 The clock continues to tick and the hands move even closer to midnight.
00:06 The clock strikes midnight and the hands are now at the top of the clock.
00:07 A news anchor sits at a desk in a studio with a large screen behind him showing a map of the world. He is looking at the camera and appears to be about to start speaking.
00:08 The news anchor begins speaking and welcomes viewers to the news broadcast. The date "8 марта" is shown on the screen.
00:09 A graphic with the number "4" is shown, indicating that this is the fourth news broadcast of the day.
00:10 Vladimir Putin is shown standing in his office, with the Russian flag and a bouquet of flowers behind him. He is looking at the camera and appears to be about to start speaking.
00:11 Putin begins speaking and wishes all women a happy International Women's Day.
00:12 Putin continues speaking and praises the strength and resilience of Russian women.
00:13 A soldier walks down a hallway carrying a bouquet of flowers.
00:14 The soldier enters a room and presents the flowers to a woman in a military uniform.
00:15 A fire burns in a building.
00:16 A drone flies over a destroyed building.
00:17 A man walks down a street in a destroyed village.
00:18 Joe Biden stands at a podium in the US Capitol Building, with Kamala Harris and other officials behind him. He is waving to the crowd and appears to be about to start speaking.
00:19 Biden begins speaking and addresses the nation.
00:20 Biden continues speaking and discusses his plans for the future of the country.
00:21 Biden finishes speaking and shakes hands with Kamala Harris and other officials.
00:22 Biden continues shaking hands and greeting people in the crowd.
00:23 A graphic with the word "Vesti" is shown, indicating that this is the end of the news broadcast.
00:24 A group of people hold up signs and protest in the street.
00:25 A military vehicle drives down a street.
00:26 A crowd of people gathers in a village.
00:27 A worker pours molten metal into a mold.
00:28 A reporter stands on a boat in a harbor and reports on the fishing industry.
00:29 A herd of deer stands in a snowy forest.
00:30 A reporter stands in the forest and talks about the deer population.
00:31 A baby panda cub sleeps on its mother's back.
00:32 Three women in traditional Russian dress dance on a stage.
00:33 A graphic with the word "Vesti" is shown, indicating that this is the end of the news broadcast.
00:34 A graphic with the word "Vesti" is shown, indicating that this is the end of the news broadcast.
00:35 A graphic with the word "Vesti" is shown, indicating that this is the end of the news broadcast.
00:36 The news anchor sits at a desk in a studio with a large screen behind him showing a bouquet of pink tulips. He is looking at the camera and appears to be about to start speaking.
00:37 The news anchor begins speaking and wishes all women a happy International Women's Day.
00:38 The news anchor continues speaking and praises the beauty, wisdom, and generosity of women.
00:39 The news anchor continues speaking and quotes Vladimir Putin's message to women on International Women's Day.
00:40 The news anchor continues speaking and discusses the importance of family.
00:41 The news anchor continues speaking and quotes Vladimir Putin again, saying that "today, in every home, in every family, the most tender, warm wishes are addressed to our mothers, wives, daughters, grandmothers, friends. The most sincere words of admiration and gratitude."
00:42 Vladimir Putin is shown again, standing in his office. He is looking at the camera and appears to be about to start speaking.
00:43 Putin begins speaking and praises the role of women in Russian society.
00:44 Putin continues speaking and says that the most important thing for any woman, regardless of her profession or achievements, is her family.
00:45 Putin continues speaking and says that women are responsible for raising children and caring for their families.
00:46 Putin continues speaking and says that women are the backbone of Russian society.
00:47 Putin continues speaking and says that the government is committed to supporting families with children.
00:48 Putin continues speaking and says that it is important to raise children to be worthy and successful people.
00:49 Putin continues speaking and says that this year is dedicated to the family in Russia.
00:50 Putin continues speaking and says that the family is the most important thing in life.
00:51 Putin continues speaking and says that the government will do everything it can to support families with children.
00:52 Putin continues speaking and says that the government is committed to helping families with children, including large families and young families.
00:53 Putin continues speaking and says that the government wants young mothers to feel the care and support of the state.
00:54 Putin continues speaking and addresses the women who are serving in the military.
00:55 Putin continues speaking and praises the courage and sacrifice of the women who are serving in the military.
00:56 Putin continues speaking and says that the women who are serving in the military are heroes.
00:57 Putin continues speaking and says that the women who are serving in the military are an inspiration to all Russians.
00:58 Putin continues speaking and thanks the women who are serving in the military for their service.
00:59 Putin continues speaking and says that the women who are serving in the military are making a difference.
01:00 Putin continues speaking and says that the government is committed to supporting the families of the women who are serving in the military.
01:01 Putin continues speaking and praises the work of women in volunteer organizations.
01:02 Putin continues speaking and thanks women for their contributions to Russian society.
01:03 Putin continues speaking and says that women are achieving success in all areas of life.
01:04 Putin continues speaking and says that he is proud of the women of Russia.
01:05 Putin continues speaking and wishes women all the best on International Women's Day.
01:06 Putin continues speaking and says that he hopes women will be able to spend International Women's Day with their loved ones.
01:07 Putin continues speaking and wishes women happiness, health, and success.
01:08 Putin finishes speaking and wishes all women a happy International Women's Day.
01:09 The news anchor sits at a desk in a studio with a large screen behind him showing a bouquet of white tulips. He is looking at the camera and appears to be about to start speaking.
01:10 The news anchor begins speaking and discusses the celebrations that are taking place across Russia on International Women's Day.
01:11 The news anchor continues speaking and says that concerts, laser shows, and sporting events are taking place across the country.
01:12 The news anchor continues speaking and says that men are giving flowers to women on International Women's Day.
01:13 The news anchor continues speaking and says that the police are giving flowers to women on International Women's Day.
01:14 The news anchor continues speaking and says that the police are giving flowers to women on International Women's Day.

What if we just repeat our instruction about length? We keep the same session as above and just use this as our second prompt:

Make each description at least one paragraph long, a minimum of 5 sentences.

This time it lumps a few seconds together but does give longer and more detailed output:

Sure. Here is a frame-by-frame description of the video, with each description being at least one paragraph long and a minimum of 5 sentences:
00:00
The video opens with a woman with blonde hair and glasses sitting at a desk with a microphone in front of her. She is looking at a laptop and appears to be recording a podcast. The setting is a simple studio with black walls and a few pieces of equipment. The woman is wearing a blue shirt and has a serious expression on her face. She is gesturing with her hands as she speaks, suggesting that she is passionate about the topic she is discussing.
00:01
A montage of podcast covers is shown, with a variety of topics and hosts. The covers are colorful and eye-catching, and they represent a wide range of interests. This frame suggests that there is a podcast for everyone, and that podcasts are a popular way to consume information and entertainment.
00:02
The logo for the Russian streaming service "Smotrim" is shown. The logo is red and white, and it is set against a black background. This frame suggests that the video is being broadcast on the Smotrim platform.
00:03-00:06
A clock with Roman numerals is shown against a blue background with digital lines and dots. The clock is ticking, and the camera zooms in on the face of the clock. This frame creates a sense of urgency and anticipation, as if something important is about to happen.
00:07-00:08
A news anchor is sitting at a desk in a studio with a large screen behind him showing a map of the world. The news anchor is speaking and gesturing with his hands. He is wearing a suit and tie, and he has a serious expression on his face. This frame suggests that the video is about to present some important news.
00:09
A graphic with the number "4" is shown. This frame is likely a countdown to the start of the news program.
00:10-00:12
Russian President Vladimir Putin is standing in front of a Russian flag and a bouquet of flowers. He is speaking to the camera. He is wearing a suit and tie, and he has a serious expression on his face. This frame suggests that Putin is about to make an important announcement.
00:13-00:14
A man in a military uniform is walking down a hallway carrying a bouquet of flowers. He enters a room and presents the bouquet to a woman in a medical uniform. The woman smiles and accepts the flowers. This frame suggests that the man is a soldier who is returning home from deployment, and that he is giving the flowers to his wife or girlfriend.
00:15
A fire is burning in a building. The fire is large and out of control, and it is causing a lot of damage. This frame suggests that there has been a major accident or disaster.
00:16
A drone is flying over a field. A white object is seen falling from the drone. This frame suggests that the drone is being used to deliver supplies or to conduct surveillance.
00:17
A man is walking down a road in a rural area. The man is wearing a backpack and carrying a walking stick. This frame suggests that the man is on a journey or pilgrimage.
00:18-00:22
US President Joe Biden is standing at a podium in the US Capitol Building. He is waving to the audience and speaking to them. Vice President Kamala Harris and House Speaker Kevin McCarthy are seated behind him. Biden is then seen shaking hands with people in the audience. This frame suggests that Biden is giving a speech to Congress, and that he is receiving a warm reception from the audience.
00:23
A graphic with the number "4" is shown. This frame is likely a countdown to the start of a new segment of the news program.
00:24
A group of people are holding signs and protesting. The signs are in Polish, and they appear to be protesting against the government. This frame suggests that there is political unrest in Poland.
00:25
A military vehicle is driving down a road. The vehicle is heavily armored and has a machine gun mounted on the roof. This frame suggests that there is a military conflict taking place.
00:26
A crowd of people are gathered in a village. The people are wearing traditional African clothing, and they appear to be celebrating or mourning. This frame suggests that there is a cultural event taking place in the village.
00:27
A worker is pouring molten metal into a mold. The worker is wearing protective clothing, and he is working in a factory setting. This frame suggests that the video is about to present a story about industry or manufacturing.
00:28
A reporter is standing on a boat in a harbor. He is speaking to the camera. The reporter is wearing a warm coat, and it is snowing. This frame suggests that the video is about to present a story about the fishing industry or the Arctic.
00:29-00:30
A herd of deer is standing in a snowy forest. A reporter is standing in the forest with the deer. He is speaking to the camera. This frame suggests that the video is about to present a story about wildlife or conservation.
00:31
A baby panda is lying on its back. The panda is very cute and cuddly, and it is playing with a toy. This frame suggests that the video is about to present a story about animals or zoos.
00:32
Three women in traditional Russian costumes are dancing on a stage. The women are smiling and laughing, and they are enjoying themselves. This frame suggests that the video is about to present a story about Russian culture or dance.
00:33
A graphic with the number "4" is shown. This frame is likely a countdown to the start of a new segment of the news program.
00:34-00:35
A digital animation of the Earth is shown. The animation zooms in on Russia, and then the logo for the Russian news program "Vesti" is shown. This frame suggests that the video is about to present a story about Russia or Russian news.
00:36-00:41
The news anchor is sitting at a desk in the studio. A bouquet of pink tulips is shown on the screen behind him. The news anchor is speaking about International Women's Day, and he is quoting Russian President Vladimir Putin. This frame suggests that the video is about to present a story about International Women's Day or Russian politics.
00:42-01:10
Putin is speaking to the camera. He is speaking about International Women's Day, and he is praising the contributions of women to Russian society. He also speaks about the importance of family and the need to support families with children. This frame suggests that Putin is trying to appeal to women voters and to promote his family-friendly policies.
01:11-01:14
The news anchor is speaking. A bouquet of white tulips is shown on the screen behind him. The news anchor is talking about the celebrations that are taking place across Russia for International Women's Day. This frame suggests that International Women's Day is a major holiday in Russia.
01:15-01:29
A montage of scenes is shown from across Russia, featuring men in military uniforms giving flowers to women. The women are smiling and laughing, and they are enjoying the attention. This frame suggests that International Women's Day is a day to celebrate and appreciate women.

And finally – same session, third prompt:

Make the descriptions even more detailed. A minimum of 20 sentences per description.

Unfortunately, the results are truncated this time:

Sure. Here is a frame-by-frame description of the video, with each description being at least 20 sentences long:
00:00
The video opens with a close-up shot of a woman with blonde hair and glasses. She is sitting at a desk with a microphone in front of her, and she is looking intently at a laptop screen. The setting is a simple studio with black walls and a few pieces of equipment. The woman is wearing a blue shirt and has a serious expression on her face. She is gesturing with her hands as she speaks, suggesting that she is passionate about the topic she is discussing.
The camera slowly zooms out, revealing more of the studio. There is a window behind the woman, but it is dark outside. There are also a few books and papers on the desk, as well as a smartphone. The overall tone of the frame is one of concentration and focus. The woman is clearly engaged in her work, and she is not aware of the camera.
00:01
The frame changes to a montage of podcast covers. The covers are colorful and eye-catching, and they represent a wide range of interests. There are podcasts about news, politics, business, sports, entertainment, and more. This frame suggests that there is a podcast for everyone, and that podcasts are a popular way to consume information and entertainment.
The montage is fast-paced and dynamic, and it gives the viewer a sense of the wide variety of podcasts that are available. The frame also suggests that podcasts are a growing medium, and that they are becoming increasingly popular.
00:02
The frame changes to the logo for the Russian streaming service "Smotrim". The logo is red and white, and it is set against a black background. The logo is animated, and it appears to be moving towards the viewer. This frame suggests that the video is being broadcast on the Smotrim platform.
The frame is simple and straightforward, and it effectively conveys the message that the video is being broadcast on Smotrim. The animation of the logo adds a touch of visual interest to the frame.
00:03-00:06
The frame changes to a clock with Roman numerals. The clock is set against a blue background with digital lines and dots. The clock is ticking, and the camera zooms in on the face of the clock. The ticking of the clock is the only sound that can be heard.
This frame creates a sense of urgency and anticipation, as if something important is about to happen. The blue background and digital lines and dots suggest that the video is about to present some kind of technological or futuristic news.
00:07-00:08
The frame changes to a news anchor sitting at a desk in a studio. There is a large screen behind him showing a map of the world. The news anchor is speaking and gesturing with his hands. He is wearing a suit and tie, and he has a serious expression on his face.
The camera slowly zooms in on the news anchor's face. The map of the world behind him suggests that the news he is about to present is of international importance. The news anchor's serious expression suggests that the news is also likely to be serious or even alarming.
00:09
The frame changes to a graphic with the number "4". The graphic is animated, and the number appears to be counting down. This frame is likely a countdown to the start of the news program.
The frame is simple and effective, and it creates a sense of anticipation for the start of the news program. The animation of the number adds a touch of visual interest to the frame.
00:10-00:12
The frame changes to Russian President Vladimir Putin standing in front of a Russian flag and a bouquet of flowers. He is speaking to the camera. He is wearing a suit and tie, and he has a serious expression on his face.
The camera slowly zooms in on Putin's face. The Russian flag and bouquet of flowers behind him suggest that he is speaking on behalf of the Russian people. Putin's serious expression suggests that he is about to make an important announcement.
00:13-00:14
The frame changes to a man in a military uniform walking down a hallway carrying a bouquet of flowers. He enters a room and presents the bouquet to a woman in a medical uniform. The woman smiles and accepts the flowers.
The camera slowly zooms in on the woman's face. She is clearly happy to see the man, and she is touched by his gesture. The man's military uniform suggests that he is a soldier who is returning home from deployment. The flowers suggest that he is giving them to his wife or girlfriend.
00:15
The frame changes to a fire burning in a building. The fire is large and out of control, and it is causing a lot of damage. The camera zooms in on the fire, and the flames can be seen licking at the building.
This frame suggests that there has been a major accident or disaster. The fire is clearly dangerous, and it is likely that people are in danger.
00:16
The frame changes to a drone flying over a field. A white object is seen falling from the drone. The camera zooms in on the object, and it can be seen that it is a parachute.
This frame suggests that the drone is being used to deliver supplies or to conduct surveillance. The parachute suggests that the object being delivered is fragile or important.
00:17
The frame changes to a man walking down a road in a rural area. The man is wearing a backpack and carrying a walking stick. The camera follows the man as he walks, and the scenery around him is beautiful and peaceful.
This frame suggests that the man is on a journey or pilgrimage. The man's backpack and walking stick suggest that he is prepared for a long journey. The peaceful scenery suggests that the man is enjoying his journey.
00:18-00:22
The frame changes to US President Joe Biden standing at a podium in the US Capitol Building. He is waving to the audience and speaking to them. Vice President Kamala Harris and House Speaker Kevin McCarthy are seated behind him. Biden is then seen shaking hands with people in the audience.
The camera slowly zooms in on Biden's face. The US Capitol Building behind him suggests that he is giving a speech to Congress. Biden's waving and smiling suggest that he is receiving a warm reception from the audience.
00:23
The frame changes to a graphic with the number "4". The graphic is animated, and the number appears to be counting down. This frame is likely a countdown to the start of a new segment of the news program.
The frame is simple and effective, and it creates a sense of anticipation for the start of the new segment. The animation of the number adds a touch of visual interest to the frame.
00:24
The frame changes to a group of people holding signs and protesting. The signs are in Polish, and they appear to be protesting against the government. The camera zooms in on the signs, and the protesters can be seen chanting slogans.
This frame suggests that there is political unrest in Poland. The protesters are clearly angry and frustrated, and they are demanding change from the government.
00:25
The frame changes to a military vehicle driving down a road. The vehicle is heavily armored and has a machine gun mounted on the roof. The camera follows the vehicle as it drives, and the scenery around it is barren and desolate.
This frame suggests that there is a military conflict taking place. The military vehicle is clearly designed for combat, and the desolate scenery suggests that the conflict is taking place in a war zone.
00:26
The frame changes to a crowd of people gathered in a village. The people are wearing traditional African clothing, and they appear to be celebrating or mourning. The camera zooms in on the people, and their faces can be seen expressing a range of emotions.
This frame suggests that there is a cultural event taking place in the village. The traditional clothing and the range of emotions on the people's faces suggest that the event is significant and meaningful.
00:27
The frame changes to a worker pouring molten metal into a mold. The worker is wearing protective clothing, and he is working in a factory setting. The camera zooms in on the molten metal, and the sparks can be seen flying.
This frame suggests that the video is about to present a story about industry or manufacturing. The molten metal and sparks suggest that the work is dangerous and demanding.
00:28
The frame changes to a reporter standing on a boat in a harbor. He is speaking to the camera. The reporter is wearing a warm coat, and it is snowing. The camera zooms in on the reporter's face, and he can be seen shivering in the cold.
This frame suggests that the video is about to present a story about the fishing industry or the Arctic. The reporter's warm coat and the snow suggest that the story is taking place in a cold and challenging environment.
00:29-00:30
The frame changes to a herd of deer standing in a snowy forest. A reporter is standing in the forest with the deer. He is speaking to the camera. The camera zooms in on the deer, and they can be seen grazing peacefully.
This frame suggests that the video is about to present a story about wildlife or conservation. The deer are

And combining the original and refinement prompts together and trying again in a fresh session:

Summarize the main events and themes of the video frame-by-frame, focusing on the most important and interesting information. Describe what is happening in the frame. What are the people doing? What is the setting? What are the most important and interesting things to notice in this frame of the video? What emotions are being expressed in this frame of the video? What is the overall tone of this frame of the video? Provide your output as a table, where each row is one second of airtime, with the first column being the time from the start of the video and the second column being your description of that second of airtime. Be as detailed as you can. Make each description at least one paragraph long, a minimum of 20 sentences. Make the descriptions even more detailed. A minimum of 20 sentences per description.

This yields the following truncated results:

00:00
The video begins with a woman sitting at a desk in a studio. She is wearing glasses and has a microphone in front of her. She is looking at a laptop and appears to be taking notes. The setting is a news studio, and the woman is likely a news anchor. The overall tone of this frame is serious and professional.
00:01
The video then cuts to a montage of different podcast covers. The podcasts are on a variety of topics, including politics, culture, and sports. The overall tone of this frame is informative and engaging.
00:02
The video then cuts to a red and blue graphic with the word "SMOTRIM" in the center. The graphic is likely the logo for a Russian news website or television channel. The overall tone of this frame is modern and sleek.
00:03
The video then cuts to a close-up of a clock. The clock is ticking, and the hands are moving. The setting is a dark blue background with lines and dots that look like a map of the world. The overall tone of this frame is urgent and suspenseful.
00:04
The video then cuts to a wider shot of the clock. The clock is still ticking, and the hands are moving. The setting is still a dark blue background with lines and dots that look like a map of the world. The overall tone of this frame is still urgent and suspenseful.
00:05
The video then cuts to a news anchor sitting at a desk in a studio. He is wearing a suit and tie and has a microphone in front of him. He is looking at the camera and appears to be reading from a script. The setting is a news studio, and the man is likely a news anchor. The overall tone of this frame is serious and professional.
00:06
The video then cuts to a close-up of the news anchor's face. He is still looking at the camera and appears to be reading from a script. The overall tone of this frame is still serious and professional.
00:07
The video then cuts to a graphic with the number "4" in the center. The graphic is likely the logo for a Russian news website or television channel. The overall tone of this frame is modern and sleek.
00:08
The video then cuts to Vladimir Putin standing in front of a Russian flag. He is wearing a suit and tie and has a serious expression on his face. The setting is a government office, and Putin is likely giving a speech. The overall tone of this frame is powerful and authoritative.
00:09
The video then cuts to a close-up of Putin's face. He is still looking at the camera and has a serious expression on his face. The overall tone of this frame is still powerful and authoritative.
00:10
The video then cuts to a man in a military uniform walking down a hallway. He is carrying a bouquet of flowers. The setting is a hospital, and the man is likely visiting a patient. The overall tone of this frame is hopeful and heartwarming.
00:11
The video then cuts to the man in the military uniform giving the bouquet of flowers to a woman in a white coat. The woman is smiling and appears to be grateful. The setting is still a hospital, and the man and woman are likely a doctor and patient. The overall tone of this frame is still hopeful and heartwarming.
00:12
The video then cuts to a fire. The fire is burning brightly, and there is a lot of smoke. The setting is a city, and the fire is likely a building fire. The overall tone of this frame is dangerous and destructive.
00:13
The video then cuts to a drone flying over a field. There is a white object in the field, which is likely a bomb. The setting is a war zone, and the drone is likely being used to survey the area. The overall tone of this frame is tense and dangerous.
00:14
The video then cuts to a man walking down a road. The road is covered in ash, and there are burned-out buildings on either side. The setting is a war zone, and the man is likely a civilian who is trying to escape the fighting. The overall tone of this frame is sad and desperate.
00:15
The video then cuts to Joe Biden standing at a podium in front of an American flag. He is wearing a suit and tie and is waving to the crowd. The setting is the U.S. Capitol, and Biden is likely giving a speech. The overall tone of this frame is patriotic and hopeful.
00:16
The video then cuts to a close-up of Biden's face. He is still looking at the camera and has a serious expression on his face. The setting is still the U.S. Capitol, and Biden is likely still giving a speech. The overall tone of this frame is still patriotic and hopeful.
00:17
The video then cuts to a wider shot of Biden and the crowd. Biden is still standing at the podium, and the crowd is clapping and cheering. The overall tone of this frame is still patriotic and hopeful.
00:18
The video then cuts to Biden shaking hands with people in the crowd. The people are smiling and appear to be happy to meet the president. The overall tone of this frame is still patriotic and hopeful.
00:19
The video then cuts to a graphic with the word "VESTI" in the center. The graphic is likely the logo for a Russian news website or television channel. The overall tone of this frame is modern and sleek.
00:20
The video then cuts to a news anchor sitting at a desk in a studio. He is wearing a suit and tie and has a microphone in front of him. He is looking at the camera and appears to be reading from a script. The setting is a news studio, and the man is likely a news anchor. The overall tone of this frame is serious and professional.
00:21
The video then cuts to a close-up of the news anchor's face. He is still looking at the camera and appears to be reading from a script. The overall tone of this frame is still serious and professional.
00:22
The video then cuts to a bouquet of pink tulips. The tulips are beautiful and vibrant. The setting is a wooden table, and the tulips are likely a gift for someone. The overall tone of this frame is romantic and thoughtful.
00:23
The video then cuts to the news anchor sitting at a desk in a studio. He is wearing a suit and tie and has a microphone in front of him. He is looking at the camera and appears to be reading from a script. The setting is a news studio, and the man is likely a news anchor. The overall tone of this frame is serious and professional.
00:24
The video then cuts to a close-up of the news anchor's face. He is still looking at the camera and appears to be reading from a script. The overall tone of this frame is still serious and professional.
00:25
The video then cuts to Vladimir Putin standing in front of a Russian flag. He is wearing a suit and tie and has a serious expression on his face. The setting is a government office, and Putin is likely giving a speech. The overall tone of this frame is powerful and authoritative.
00:26
The video then cuts to a close-up of Putin's face. He is still looking at the camera and has a serious expression on his face. The overall tone of this frame is still powerful and authoritative.
00:27
The video then cuts to a wider shot of Putin and the crowd. Putin is still standing at the podium, and the crowd is clapping and cheering. The overall tone of this frame is still patriotic and hopeful.
00:28
The video then cuts to Putin shaking hands with people in the crowd. The people are smiling and appear to be happy to meet the president. The overall tone of this frame is still patriotic and hopeful.
00:29
The video then cuts to a graphic with the word "VESTI" in the center. The graphic is likely the logo for a Russian news website or television channel. The overall tone of this frame is modern and sleek.
00:30
The video then cuts to a news anchor sitting at a desk in a studio. He is wearing a suit and tie and has a microphone in front of him. He is looking at the camera and appears to be reading from a script. The setting is a news studio, and the man is likely a news anchor. The overall tone of this frame is serious and professional.
00:31
The video then cuts to a close-up of the news anchor's face. He is still looking at the camera and appears to be reading from a script. The overall tone of this frame is still serious and professional.
00:32
The video then cuts to a bouquet of white tulips. The tulips are beautiful and vibrant. The setting is a wooden table, and the tulips are likely a gift for someone. The overall tone of this frame is romantic and thoughtful.
00:33
The video then cuts to the news anchor sitting at a desk in a studio. He is wearing a suit and tie and has a microphone in front of him. He is looking at the camera and appears to be reading from a script. The setting is a news studio, and the man is likely a news anchor. The overall tone of this frame is serious and