Skip to content

A high-performance tool for video upscaling, interpolation, depth estimation, and more. Available as a CLI and Adobe Extension.

License

Notifications You must be signed in to change notification settings

NevermindNilas/TheAnimeScripter

Repository files navigation

🎬 The Anime Scripter (TAS)

High-performance AI video enhancement toolkit for creators

Visitors Release Downloads Last Commit Discord License GitHub Stars

πŸ“‹ Overview

TheAnimeScripter (TAS) is a cutting-edge AI-powered video enhancement toolkit specialized for anime and general video content. It seamlessly integrates with Adobe After Effects while also offering standalone functionality, bringing professional-grade AI upscaling, interpolation, and restoration to creators.

Table of Contents

πŸš€ Key Features

🎞️ Video Enhancement

  • Motion Interpolation: Create buttery-smooth animation with advanced frame interpolation
  • AI Upscaling: Enhance resolution with AI-powered upscaling (2x)
  • Smart Deduplication: Optimize file size and interpolation by removing redundant frames

🎭 Advanced Editing

  • Background-Foreground Segmentation: Precise automatic rotobrushing
  • Depth Map Generation: 3D-ready depth maps for creative effects
  • Automatic Scene Detection: Intelligent clip splitting at scene changes

πŸ”§ Workflow Optimization

  • After Effects Integration: Seamless plugin for AE workflow
  • Model Chaining: Combine multiple effects in a single processing pass
  • In-Memory Processing: Efficient frame handling without redundant disk operations

🧠 AI Flexibility

  • Multi-Backend Support: CUDA, TensorRT, DirectML, and NCNN acceleration
  • Custom Model Support: Import your own trained models
  • Restoration Options: Denoise, dejpeg, sharpen, and line enhancement

πŸ–₯️ User Interfaces

Adobe After Effects Integration

Currently being enhanced with new features and optimizations

Adobe plugin provides seamless integration directly within your AE workflow, enabling AI-powered video enhancement without leaving your editing environment.

Adobe GUI

Windows Standalone

Under active development - coming soon

The native Windows application will provide a dedicated environment optimized for batch processing and advanced customization options.

πŸ› οΈ Getting Started

Adobe After Effects Plugin

System Requirements:

  • After Effects 2020 (v17.5) or higher
  • Compatible GPU recommended

Installation Steps:

  1. Download the TAS-AdobeEdition from the releases page
  2. Extract the .zip file to a location of your choice
  3. Follow the installation tutorial to add TAS to After Effects

Need help? Watch the video tutorial

Standalone Application

Development Status: Currently in active development. Join the Discord for development updates.

Command Line Interface

Get the most powerful and flexible version of TAS with the command-line interface:

πŸ“š Available Inputs

All available parameters for interacting with the CLI or directly with main.py can be found in the Parameters guide.

πŸ“ Available Models

πŸ†™ Upscaling Models

Model CUDA TensorRT DirectML NCNN
ShuffleCugan βœ… βœ… ❌ βœ…
Span βœ… βœ… βœ… βœ…
SRVGGNet (Compact) βœ… βœ… βœ… ❌
SRVGGNet (Ultra) βœ… βœ… βœ… ❌
SRVGGNet (SuperUltra) βœ… βœ… βœ… ❌
OpenProteus βœ… βœ… βœ… ❌
AniScale 2 βœ… βœ… βœ… ❌
RTMOSR ❌ βœ… βœ… ❌
Custom (Spandrel) βœ… ❌ ❌ ❌

⏱️ Interpolation Models (RIFE)

Version CUDA TensorRT DirectML NCNN
4.6 βœ… βœ… ❌ βœ…
4.15 βœ… βœ… ❌ βœ…
4.15-lite βœ… βœ… ❌ βœ…
4.16-lite βœ… ❌ ❌ βœ…
4.17 βœ… βœ… ❌ βœ…
4.18 βœ… βœ… ❌ βœ…
4.20 βœ… βœ… ❌ βœ…
4.21 βœ… βœ… ❌ βœ…
4.22 βœ… βœ… ❌ βœ…
4.22-lite βœ… βœ… ❌ βœ…
4.25 βœ… βœ… ❌ ❌
4.25-heavy βœ… βœ… ❌ ❌
Rife_Elexor (mod 4.7) βœ… βœ… ❌ ❌

πŸ”§ Restoration Models

Model CUDA TensorRT DirectML NCNN
SCUNet (Denoise) βœ… βœ… ❌ ❌
NAFNet (Denoise) βœ… ❌ ❌ ❌
DPIR (Denoise) βœ… ❌ ❌ ❌
Real-Plksr (DeJpeg) βœ… ❌ ❌ ❌
Anime1080fixer βœ… βœ… βœ… ❌
FastLineDarken βœ… βœ… ❌ ❌
GaterV3 βœ… ❌ βœ… ❌

🌊 Depth Map Models

Model CUDA TensorRT DirectML NCNN
"Faster" Depth-Anything v2 Models
Small v2 βœ… βœ… βœ… ❌
Base v2 βœ… βœ… βœ… ❌
Large v2 βœ… βœ… βœ… ❌
"Faster" Distilled Models
Distill Small v2 βœ… ❌ ❌ ❌
Distill Base v2 βœ… ❌ ❌ ❌
Distill Large v2 βœ… ❌ ❌ ❌
Original Implementation Models
OG Small v2 βœ… ❌ ❌ ❌
OG Base v2 βœ… ❌ ❌ ❌
OG Large v2 βœ… ❌ ❌ ❌
OG Distill Small v2 βœ… ❌ ❌ ❌
OG Distill Base v2 βœ… ❌ ❌ ❌
OG Distill Large v2 βœ… ❌ ❌ ❌

πŸ™ Project Contributors

🧠 Model & Algorithm Contributors

Contributor Contribution Repository
SUDO ShuffleCugan & ONNX models VSGAN-tensorrt-docker
HZWER RIFE interpolation framework Practical-RIFE
the-database SRVGGNet model variants mpv-upscale-2x_animejanai
SkyTNT Anime segmentation models anime-segmentation
DepthAnything Depth map generation Depth-Anything-V2
Hongyuanyu SPAN upscaling technology span
Sirosky Open-Proteus & AniScale 2 Upscale-Hub
Elexor Custom RIFE modifications Modded Rife Experiment(s)
Zarxrax Anime1080Fixer restoration GitHub
umzi RTMOSR & GaterV3 Models GitHub

πŸ› οΈ Framework & Tool Contributors

Contributor Contribution Repository
FFmpeg Group Video processing framework FFmpeg
YT-DLP Team Media download capabilities yt-dlp
Breakthrough Scene detection algorithms PySceneDetect
Chainner-org Neural network architecture spandrel
TNTWise RIFE ONNX/NCNN optimizations GitHub
Hyperbrew Adobe integration framework bolt-cep
moi15moi Accurate inpoint and outpoint handling VideoTimeStamps

🌟 TAS Collaborators

Contributor Contribution
Trentonom0r3 TAS Adobe Edition
Adegerard Project architecture & optimization suggestions

πŸ“§ Missing contributor? Please contact me at [email protected] or open a Github Issue!

🌟 Star History

Star History Chart

πŸŽ₯ Promo Video

Promo Video

About

A high-performance tool for video upscaling, interpolation, depth estimation, and more. Available as a CLI and Adobe Extension.

Topics

Resources

License

Stars

Watchers

Forks

Sponsor this project

Packages

No packages published

Languages