Youtube mirror - https://www.youtube.com/watch?v=UEWUdJbVwjQ \ Twitch mirror - https://www.twitch.tv/timeloop_tv

Added a new sequence of some fractal experiments I did a few weeks ago. These were made with zeroscope_v2 576 model, then I used zeroscope_v2 XL to upscale then FILM for frame interpolation.

Preprocess Data with https://github.com/ExponentialML/Video-BLIP2-Preprocessor

Paper - https://animatediff.github.io/ \ AUTO1111 - https://github.com/continue-revolution/sd-webui-animatediff

Youtube mirror - https://www.youtube.com/watch?v=UEWUdJbVwjQ \ Twitch mirror - https://www.twitch.tv/timeloop_tv

Youtube mirror - https://www.youtube.com/watch?v=UEWUdJbVwjQ \ Twitch mirror - https://www.twitch.tv/timeloop_tv

export const systemPrompt = `You are a helpful assistant working for a TV channel. You catalogued thousand of video snippets on various topics. You also know how stable diffusion works (an AI model to generate image using captions similar to those of image banks and image datasets), and how to prompt it, adding things like "photo of a beautiful cat drinking milk, in a trailer park, with boho style outdoor space with 60s, furnishings, mystical objects, candles, van and lights on, sunset, award-winning, high quality, photorealistic, high details, hyper realistic, trending on artstation.." etc.

Here is a more complete guide for prompting:

Write the caption in the following order: content type > description > style > composition > camera type > additional keywords

• Content type: What type of artwork you want to achieve? Is it a photograph, drawing, sketch, 3D render..?
• Description: define the subject, subject attributes, environment/scene. The more descriptive you are with the use of adjectives, the better the output.
• Style: we’ve seen the most common ones above, but there are also “sub-categories” – lightning, detail…
• Composition: it refers to aspect ratio, camera view and resolution.

Useful terms

Finally, there are some words to improve your prompt, and obviously, the image you’re gonna get. These could be considered as final touches, and you can add as many and as random as you want, but here are a few examples:

Related to: lighting

accent lighting, ambient lighting, backlight, blacklight, blinding light, candlelight, concert lighting, crepuscular rays, direct sunlight, dusk, Edison bulb, electric arc, fire, fluorescent, glowing, glowing radioactively, glow-stick, lava glow, moonlight, natural lighting, neon lamp, nightclub lighting, nuclear waste glow, quantum dot display, spotlight, strobe, sunlight, ultraviolet, dramatic lighting, dark lighting, soft lighting, gloomy

Related to: detail

highly detailed, grainy, realistic, unreal engine, octane render, bokeh, vray, houdini render, quixel megascans, depth of field (or dof), arnold render, 8k uhd, raytracing, cgi, lumen reflections, cgsociety, ultra realistic, volumetric fog, overglaze, analog photo, polaroid, 100mm, film photography, dslr, cinema4d, studio quality

Related to: artistic techniques and materials

Digital art, digital painting, color page, featured on pixiv (for anime/manga), trending on artstation, precise line-art, tarot card, character design, concept art, symmetry, golden ratio, evocative, award winning, shiny, smooth, surreal, divine, celestial, elegant, oil painting, soft, fascinating, fine art

Related: to camera view and quality

ultra wide-angle, wide-angle, aerial view, massive scale, street level view, landscape, panoramic, bokeh, fisheye, dutch angle, low angle, extreme long-shot, long shot, close-up, extreme close-up, highly detailed, depth of field (or dof), 4k, 8k uhd, ultra realistic, studio quality, octane render,

Related to: style and composition

Surrealism, trending on artstation, matte, elegant, illustration, digital paint, epic composition, beautiful, the most beautiful image ever seen,

Related to: colours

Triadic colour scheme, washed colour

Additional keywords (used to make the video generation service use better quality data)

award winning, beautiful, stunning, breathtaking, trending on artstation, high quality, 4k, RAW photo, high detailed skin`

export const userPrompt = (input: string) => `# Context I am trying to call a video generation service, and I need a sequence of captions to describe short videos snippets (about 2 to 3 seconds each).

• You are going to help me generate them, by imagining creative and entertaining sequences, with a logical sequencing (the video need to make sense on a global level, as they are part of the same story)
• It is important that the captions follow each other in a logical way, as combined they describe a longer video, action sequence and/or story.
• Please maintain consistency across the captions (ie. the camera will stay the same, the hour or light conditions). For this to work with our video generation API, it means we need to repeat the same information (eg. camera model) across each prompt.
• thus do not write "Continued from prior ... capture:", instead you need to write the keywords again
• also in the caption, no need to say things like "at the 4 second mark" etc, as this information cannot be used by the video generation tool
• IMPORTANT! please be consistent and do not mix 3D renders with real world footage!
• Try to write the caption in the following order: content type > description > style > composition > camera type > additional keywords

Goal

Can you provide me with a list of captions? The output must be in JSON (here is the type signature: \\\typescript { input: "" // the input query captions: Array<string> // what we need to generate } \\\

Parameters

• I need: 25 shots captions
• Input: ${input}. The action should happens at various hours of the day with a beautiful settings, cast shadows, details of the background, landscape. (note: for each shot caption, please describe in details the objects, textures, lights, colors, shadows, details, environment, weather condition, era or time period etc. Also, add the keywords "cinematic", "photorealistic", "movie" to help the AI generator)`

/*

Parameters

• I need: 25 shot captions
• Input: a movie about a police car chase in Los Angeles (NOT a 3D render!), in term of total timeline film starts at golden hour, then sunset, then night. There is a light rain, the ground is wet. We can see a police car going at speed after a red lambo (to help the AI generator, you must mention police car and the rend lambo in ALL videos shots!). The police car has its lights on, reflecting on the wet ground. The police chase the lambo across all los angeles, including some iconic places. More police cars should join the chase, and even a helicopter at some point. We should see the light of the helicopter ont he ground, like in movies. Everything should be enveloped in a mist, haze, fog, wet ground. The camera should alternate between point of view to give it an intense, fast paced style (drone shots, helicopter shot etc). Please always mention (for each video) the time era and period, clothes of the characters, colors and textures, background, camera positions (note: add the keywords "cinematic", "imax", "movie", "film grain" to help the AI generator) */

https://huggingface.co/jbilcke-hf

Upgraded to 0.18.1 for both UI and Back end.

Todo:

• Minio object storage linked to pictrs for larger uploads
• Email support
• Postgres tuning
• subscriber bot to link more communities

Federation seems to be working pretty well now.

Model - Zeroscope v2 576w

576 x 320 (16:9)

48 Frames @ 24FPS

Date - 07/06/2023

``` { 'prompt': 'Traveling through space, (hyperspace:1.2), FTL, protons, light, light speed, light year, stars, rainbow of colors, cinematic, imax, movie, film grain', 'n_prompt': 'text, watermark, copyright, blurry, nsfw', 'steps': 30, 'frames': 48, 'seed': various, 'scale': 17, 'width': 576, 'height': 320, 'eta': 0.0, 'cpu_vae': 'GPU', 'device': device(type='cuda'), 'skip_steps': 0, 'strength': 0 }

```

The main purpose of the Timeloop TV instance as a whole is for sharing / creating AI artwork.

This is the general community for Timeloop TV. Anything goes here as long as it's not illegal.

Closed Source

VO\ ElevenLabs

---

Open Source

VO \ Bark TTS

Singing\ Diffsvc\ so-vits-svc

Music\ MusicGen / HF Space / Replicate\ Riffusion

Closed Source

Dalle 2

Midjourney

---

Open Source

Interfaces\ Auto1111\ ClipDrop

Models\ Civitai

Closed Source

ChatGPT - OpenAI\ https://chat.openai.com/

---

Open Source

Interfaces\ text-generation-webui\ Llama.cpp\ KoboldAI

Models\ TheBloke

Closed Source

Runway Gen2\ https://research.runwayml.com/gen2

---

Open Source

Using Auto1111 text2video extension

Modelscope\ damo-vilab/modelscope-damo-text-to-video-synthesis

Zeroscope\ cerspense/zeroscope_v2_576w\ cerspense/zeroscope_v2_XL

Potat1\ camenduru/potat1

7/1- Traefik set up with feed.timeloop.tv domain with working SSL

7/2 - Stable Lemmy server working for the first time.

7/5 - After having the server up a few days, here are my findings:

• TLTV users can subscribe to other communities but it takes a while for them to download.
• ALL communities only has communities I've searched for from this account. No posts will be downloaded, or shown on the all feed, unless someone on the server subscribes to that community.
• Other users can post / comment on TLTV.
• TLTV users can post / comment on other servers and
• Outside users can see posts / comments made by TLTV users on other instances.

Will try to keep this community updated with server related updates or announcements.

test