Using ComfyUI nodes in latentflow framework

[tumurzakov]

Hello everybody!

I've just added support for ComfyUI nodes in my LatentFlow framework (ComfyUI like nodes for code). While it's primarily designed for video processing, it can also generate images.

import sys

sys.path.insert(0, f'/path/to/latentflow/src')
sys.path.insert(0, f'/path/to/ComfyUI')

import latentflow as lf
import nodes
import torch

state = lf.State({})

(lf.ComfyNode(nodes.CheckpointLoaderSimple, ckpt_name='revanimated.safetensors').apply()
    | lf.Set(state, "checkpoint")
    | lf.ComfyNode(nodes.EmptyLatentImage, width=512, height=512, batch_size=1)
    | lf.ComfyNode(
        nodes.KSampler,
        model=state['checkpoint']['MODEL'],
        positive=lf.ComfyNode(nodes.CLIPTextEncode, text="a cat", clip=state["checkpoint"]["CLIP"]).apply(),
        negative=lf.ComfyNode(nodes.CLIPTextEncode, text="", clip=state["checkpoint"]["CLIP"]).apply(),
    )
    | lf.ComfyNode(nodes.VAEDecode, vae=state['checkpoint']["VAE"])
    | lf.Apply(lambda x: lf.Video('HWC', torch.stack([x['IMAGE']])))
    | lf.VideoShow()
)

• | is pipe (like unix pipe)
• > write value in state (like in unix too)
• - bypass for pipe
• < bypass for write
• >> go to next statement

I would greatly appreciate your feedback. While it's in the early stages and lacks documentation, I've been extensively working with it for my own purposes.