Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
51 changes: 51 additions & 0 deletions pipelines/longlive/docs/examples/timeline-factory.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
{
"prompts": [
{
"startTime": 0,
"endTime": 11.225200000047684,
"prompts": [
{
"text": "A cinematic wide-angle panorama slowly panning across a massive industrial factory complex at golden hour. The camera glides smoothly from left to right, revealing towering smokestacks releasing gentle plumes of white steam into the amber sky, rows of corrugated metal warehouses with large numbered doors, and interconnected buildings with reflective glass windows catching the warm sunlight. In the foreground, a paved access road curves through the industrial landscape with yellow safety markings clearly visible. The background shows a distant cityscape silhouette against mountains. The scene captures the grand scale of modern manufacturing, with subtle details like rotating ventilation fans on rooftops, blinking red aviation warning lights on tall structures, loading docks with parked semi-trucks, and small human figures in high-visibility vests walking between buildings for scale. The lighting creates long dramatic shadows across the concrete grounds while the metallic surfaces gleam with industrial precision. The atmosphere is clear with excellent visibility, emphasizing the geometric patterns and industrial architecture of this sprawling manufacturing facility.",
"weight": 100
}
]
},
{
"startTime": 11.225200000047684,
"endTime": 21.944400000333786,
"prompts": [
{
"text": "A dramatic cinematic wide shot of a massive industrial factory complex experiencing a catastrophic explosion during daytime. The camera holds steady as a brilliant orange and yellow fireball erupts from the central manufacturing building, sending a powerful shockwave rippling outward through the air. Thick billowing clouds of dark gray and black smoke rise dramatically into the clear blue sky, mushrooming upward in a towering column. Debris and metal fragments are launched high into the air, tumbling and spinning in slow motion arcs against the sky. The surrounding warehouse structures shake violently from the blast force, with windows shattering outward in cascading sheets of glass that catch the sunlight. Secondary smaller explosions bloom like fiery flowers along the connected pipeline systems, creating a chain reaction of orange bursts. The concrete ground cracks and buckles from the impact, sending dust clouds rolling across the industrial yard. In the foreground, the access road and safety barriers are pelted with falling debris. The background mountains remain serene and untouched, creating a stark contrast to the chaos. The entire scene captures the raw power and destructive force of the industrial accident, with fire, smoke, and destruction dominating the frame while maintaining a safe cinematic distance from the devastation.",
"weight": 100
}
]
},
{
"startTime": 21.944400000333786,
"endTime": 33.73460000038147,
"prompts": [
{
"text": "\"A cinematic wide shot of the burning industrial factory complex as heavy rain begins to fall from dark storm clouds gathering overhead. The camera holds steady as thick raindrops start pelting down, creating visible curtains of water that sweep across the devastated manufacturing buildings. The intense orange and yellow flames that were consuming the structures begin to diminish and sputter as the torrential downpour intensifies, producing massive clouds of white steam that mix with the black smoke. Water cascades off the damaged rooftops and broken structures, forming waterfalls that pour through gaps in the twisted metal framework. The rain creates thousands of tiny splashes on the cracked concrete ground, quickly forming puddles that reflect the dying orange glow of the subsiding fires. Lightning flashes in the distance behind the dark gray storm clouds, briefly illuminating the entire industrial landscape. The heavy rainfall gradually overwhelms the flames, transforming the inferno into smoldering, steam-covered ruins. Ash and soot wash away in dark rivulets across the factory yard. The surrounding warehouse structures are drenched, their metal surfaces gleaming wet in the diffused light. The background mountains disappear into the misty rain and low-hanging clouds. The scene captures nature's power intervening to quell the industrial disaster, with the cleansing rain bringing a sense of calm after the chaos.",
"weight": 100
}
]
}
],
"settings": {
"pipelineId": "longlive",
"resolution": {
"height": 480,
"width": 832
},
"seed": 42,
"denoisingSteps": [
1000,
750
],
"noiseScale": 0.7,
"noiseController": true,
"manageCache": true
},
"version": "2.0",
"exportedAt": "2025-10-27T15:51:04.242Z"
}
51 changes: 51 additions & 0 deletions pipelines/longlive/docs/examples/timeline-ironman.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
{
"prompts": [
{
"startTime": 0,
"endTime": 11.263700000047685,
"prompts": [
{
"text": "Iron Man in his iconic red and gold armor walks steadily through the devastated remains of a once-great city at dusk. The armored superhero's metal boots clank against broken concrete and twisted rebar as he navigates between collapsed skyscrapers and burnt-out vehicles, his arc reactor glowing bright blue in the center of his chest. Golden-orange sunset light filters through thick smoke and dust clouds, reflecting brilliantly off his polished crimson and gold plating and casting long dramatic shadows across the rubble-strewn streets. His helmet's glowing white eye slits scan the destruction around him, the sleek faceplate catching the dying light. Torn fabric and papers flutter in the wind from shattered windows above. The repulsor units in his palms emit a faint blue glow as his arms swing naturally with each step. Exposed steel beams jut from crumbling buildings like broken bones. Small fires still smolder in distant ruins, their orange glow mixing with the fading daylight and complementing the warm tones of his armor. The atmosphere is heavy with ash and debris particles floating through the air, creating a hazy, apocalyptic ambiance. Iron Man maintains a purposeful, heroic stride as he moves deeper into the abandoned cityscape, his distinctive silhouette unmistakable against the devastation. The arc reactor's blue light creates a subtle glow on the surrounding debris, a beacon of hope in the war-torn environment.",
"weight": 100
}
]
},
{
"startTime": 11.263700000047685,
"endTime": 22.51959999990463,
"prompts": [
{
"text": "Iron Man in his iconic red and gold armor suddenly stops walking and shifts into a combat-ready stance in the devastated remains of a once-great city at dusk. The armored superhero plants his feet wide among the rubble-strewn streets, bending his knees and lowering his center of gravity into a powerful fighting position. His right arm pulls back with his fist clenched, while his left arm extends forward with the palm repulsor aimed ahead. The arc reactor in the center of his chest pulses brighter, casting dynamic blue light across the surrounding debris. Golden-orange sunset light continues to filter through the thick smoke and dust clouds, creating dramatic contrast against the cool glow of his weapons systems. His helmet tilts forward slightly, the glowing white eye slits narrowing with focused intensity. Behind Iron Man, collapsed skyscrapers and burnt-out vehicles frame his battle-ready silhouette against the smoky, apocalyptic sky. Small fires still smolder in the distant ruins, their flickering orange glow mixing with the fading daylight. Ash and debris particles swirl around his armor as if responding to the energy building in his suit. His shoulder plates and chest piece catch the dying light, the polished red and gold surfaces gleaming as servo motors audibly whir, preparing for combat. The entire suit seems to hum with barely contained power, ready to unleash devastating force at any moment.",
"weight": 100
}
]
},
{
"startTime": 22.51959999990463,
"endTime": 35.532299999952315,
"prompts": [
{
"text": "Iron Man in his iconic red and gold armor maintains his combat stance while tilting his helmeted head back toward the darkening sky in the devastated remains of a once-great city at dusk. The armored superhero's chest expands as if drawing a deep breath, his head thrown back in a powerful roar of defiance that echoes through the ruins. His repulsors flare even brighter with blue-white energy, sending light cascading across the rubble-strewn streets as his arms remain in fighting position. The arc reactor in his chest blazes with maximum intensity, its brilliant blue light pulsing outward in waves. Golden-orange sunset light continues filtering through the thick smoke and dust clouds, dramatically backlighting his tilted helmet and creating a heroic silhouette. The glowing white eye slits of his faceplate shine upward toward the apocalyptic sky as his entire suit vibrates with barely contained power. Behind Iron Man, collapsed skyscrapers and burnt-out vehicles frame his battle cry against the smoky horizon. Small fires still smolder in the distant ruins, their flickering orange glow mixing with the fading daylight and the increasing glow from his suit's energy systems. Ash and debris particles swirl more violently around his armor, caught in the energy field emanating from the charged repulsors. His red and gold plating gleams with reflected light, every joint and servo locked in a pose of pure determination and strength. The moment captures a warrior's primal challenge to whatever threat approaches through the war-torn cityscape.",
"weight": 100
}
]
}
],
"settings": {
"pipelineId": "longlive",
"resolution": {
"height": 480,
"width": 832
},
"seed": 42,
"denoisingSteps": [
1000,
750
],
"noiseScale": 0.7,
"noiseController": true,
"manageCache": true
},
"version": "2.0",
"exportedAt": "2025-10-27T16:57:56.461Z"
}
51 changes: 51 additions & 0 deletions pipelines/longlive/docs/examples/timeline-panda.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
{
"prompts": [
{
"startTime": 0,
"endTime": 11.4555,
"prompts": [
{
"text": "A 3D animated scene. A panda with fluffy black and white fur walks forward along a stone path through a park on a spring day. The panda moves at a steady pace directly toward the camera, its distinctive black eye patches framing bright, clear eyes that remain focused straight ahead throughout its walk. The panda's round body shifts with each step as its thick black legs alternate in a regular walking rhythm. Cherry blossom trees line the path, their pink-laden branches swaying gently and releasing petals that drift through the air. Green grass spreads calmly on both sides of the path, with beds of colorful tulips and daffodils standing bright and still. The camera remains in a fixed position as the panda approaches, its forward-gazing eyes clearly visible and alert, never looking away or blinking. Spring sunlight filters through the moving tree branches, creating shifting shadows on the path and illuminating the panda's expressive eyes. The panda's fur catches the light as it continues walking forward with its characteristic waddle, maintaining steady eye contact with the camera. Pink petals occasionally land on the panda's head and back before sliding off. The scene captures the peaceful atmosphere of a spring afternoon in the park, with cherry blossoms floating down around the panda's steady, focused forward progress along the stone path.",
"weight": 100
}
]
},
{
"startTime": 11.4555,
"endTime": 24.16839999985695,
"prompts": [
{
"text": "A 3D animated scene. The panda with fluffy black and white fur slows its forward walk and comes to a gentle stop on the stone path in the park on a spring day. The panda's bright, clear eyes within its distinctive black eye patches remain focused forward as it begins to lower itself down, bending its thick black legs and using its front paws for balance. The panda's round body settles onto the warm stone path with a soft, controlled motion, ending in a comfortable sitting position with its legs stretched out in front. As the panda completes this sitting motion, the camera begins a smooth, steady zoom out, pulling back to reveal the panda's entire body from head to toe. The widening frame shows the full panda sitting peacefully on the path, its black and white fur clearly visible against the stone surface. Cherry blossom trees continue to sway gently overhead, their pink petals still drifting down through the expanded view. The broader perspective reveals more of the serene park - the stone path extending in both directions, the calm green grass on either side, and the bright beds of tulips and daffodils. The panda remains centered in frame as the camera pulls back, its eyes still alert and forward-facing, now appearing as a complete figure sitting contentedly in the middle of the path. Spring sunlight continues filtering through the tree branches, casting dappled shadows across the panda's full form. Pink petals land softly on the sitting panda's head and shoulders as the peaceful spring afternoon continues around it.",
"weight": 100
}
]
},
{
"startTime": 24.16839999985695,
"endTime": 36.94459999966622,
"prompts": [
{
"text": "A 3D animated scene. The panda with fluffy black and white fur pushes off from its sitting position on the stone path in the park on a spring day, using its strong front paws against the ground to rise. The panda's distinctive black eye patches frame its bright, clear eyes that remain focused forward as it stands up to its full height, its round body straightening and thick black legs supporting its weight. Once fully standing, the panda lifts both of its black furry arms upward, raising them high above its head in a gentle stretching motion. The panda's arms extend fully, its paws reaching toward the sky as if greeting the beautiful spring day. Cherry blossom trees continue swaying gently overhead, their pink petals drifting down around the panda's raised arms and settling on its fluffy head and shoulders. The camera holds steady in its position, capturing the panda's full standing form with its arms raised in a peaceful, celebratory gesture. The panda's forward-facing eyes remain bright and alert as it holds this position, its round belly visible as it stretches upward. Spring sunlight filters through the tree branches, illuminating the panda's black and white fur and creating a gentle glow around its raised paws. The green grass remains calm on both sides of the path, with the colorful tulips and daffodils standing still. Pink petals continue floating through the air as the panda maintains its arms-raised pose on the peaceful stone path in the serene spring park.",
"weight": 100
}
]
}
],
"settings": {
"pipelineId": "longlive",
"resolution": {
"height": 480,
"width": 832
},
"seed": 42,
"denoisingSteps": [
1000,
750
],
"noiseScale": 0.7,
"noiseController": true,
"manageCache": true
},
"version": "2.0",
"exportedAt": "2025-10-27T16:10:59.279Z"
}
20 changes: 9 additions & 11 deletions pipelines/longlive/docs/usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,21 +6,19 @@ The model is trained using [Self-Forcing](https://self-forcing.github.io/) on Wa

## Examples

The following examples include the prompts used so you can try them as well.
The following examples include timeline JSON files with the prompts used so you can try them as well.

https://github.com/user-attachments/assets/68d3d7f5-80ba-45f7-b83f-add8b970b2d8
https://github.com/user-attachments/assets/e9adaf9d-8639-42aa-911e-fc3574e7fdef

Prompts:
1. "A 3D animated scene. A **panda** walks along a path towards the camera on a spring day."
2. "A 3D animated scene. A **panda** sits down on a path in a park on a spring day."
3. "A 3D animated scene. A **panda** stands up on a path and raises its arms in a park on a spring day."
[Timeline JSON file](./examples/timeline-panda.json)

https://github.com/user-attachments/assets/855a1e5b-cdcd-42ac-8223-d73c999a8026
https://github.com/user-attachments/assets/63940a18-be6e-47fe-80bb-43d05162f2d6

Prompts:
1. A dog walking in grass.
2. A cat walking in grass.
3. A lion walking in grass.
[Timeline JSON file](./examples/timeline-factory.json)

https://github.com/user-attachments/assets/f51d4c1a-c377-49bf-948e-a3c2deeb699e

[Timeline JSON file](./examples/timeline-ironman.json)

## Resolution

Expand Down
Loading