[Bug]: when use sana-sprint-0.6b-openvino-int4 blank image output #359
Description
fastsdcpu Version
v1.0.0-beta.281
Bug Description
when i use ***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
i got blank images even i try with Tiny Auto Encoder `i got same result . my laptop is i71355U igp-irisxwith 16 GB RAM . below is log details i attach screenshot also
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<?, ?it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:02<00:00, 1.06s/it]
Latency : 116.46 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': 'deformed, (bad quality:1.3), (worst quality:1.2), grainy, '
'noisy, plastic, hazy, extra leg, bad hands, bad feet, '
'mutation, (low res:1.3), (normal quality:1.2), missing '
'finger, extra finger, mutated fingers, (plastic:1.2)',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 2.01it/s]
Latency : 4.66 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 4.25it/s]
Latency : 4.12 seconds
Reshape and compile
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 768,
'image_width': 768,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Reshape and compile
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:02<00:00, 1.12s/it]
Latency : 74.53 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 768,
'image_width': 768,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.63it/s]
Latency : 7.24 seconds
Reshape and compile
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<00:00, 1324.10it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.18it/s]
Latency : 107.93 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose flower',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<?, ?it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.33it/s]
Latency : 99.18 seconds
***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<?, ?it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:02<00:00, 1.06s/it]
Latency : 116.46 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': 'deformed, (bad quality:1.3), (worst quality:1.2), grainy, '
'noisy, plastic, hazy, extra leg, bad hands, bad feet, '
'mutation, (low res:1.3), (normal quality:1.2), missing '
'finger, extra finger, mutated fingers, (plastic:1.2)',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 2.01it/s]
Latency : 4.66 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 4.25it/s]
Latency : 4.12 seconds
Reshape and compile
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 768,
'image_width': 768,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'happy halloween',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Reshape and compile
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:02<00:00, 1.12s/it]
Latency : 74.53 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 768,
'image_width': 768,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.63it/s]
Latency : 7.24 seconds
Reshape and compile
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<00:00, 1324.10it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.18it/s]
Latency : 107.93 seconds
{'clip_skip': 2,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 2,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sana-sprint-0.6b-openvino-int4',
'prompt': 'rose flower',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 0,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': True}
***** Init Text to image (OpenVINO) - rupeshs/sana-sprint-0.6b-openvino-int4 *****
Loading OpenVINO SANA Sprint pipeline
Fetching 18 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 18/18 [00:00<?, ?it/s]
Pipeline : OVSanaSprintPipeline {
"_class_name": "OVSanaSprintPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "Efficient-Large-Model/Sana_Sprint_0.6B_1024px_diffusers",
"scheduler": [
"diffusers",
"SCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"GemmaTokenizerFast"
],
"transformer": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTransformer"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}
Using OpenVINO
Set timesteps: tensor([1.5708, 1.3000, 0.0000])
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 1.33it/s]
Latency : 99.18 seconds
Steps to Reproduce
set DEVICE=GPU
start-webui.bat
Expected Behavior
Logs / Error Output
Operating System
Windows
Hardware / CPU
i7 1355U, Irisx GPU 16GB RAM
Checklist
- I searched existing issues
- I am using a supported environment