【Lora測試16】用stable diffusion做自己的fufu玩偶吧!

前言
對fufu LoRa的全面評測
?
FuFu一詞,指的是在虛擬歌姬初音未來的周邊中,由三月八日老師繪制并由SEGA出品的玩偶。其fufu的名稱則取自玩偶名字fuwafuwa中的簡稱。除卻初音未來iP形象可以被稱為fufu,所有以這種呆萌形象畫風出現(xiàn)的玩偶都可以稱之為fufu。不過看著傻乎乎的fufu價格卻不便宜,貧窮使人進步,學會SD自己生成幾只過過癮還是沒問題的。
?
而本次測試的fufu LoRa模型,就能將任何形象都轉(zhuǎn)化為fufu。
?
下載鏈接
大模型鏈接:
鏈接:https://pan.baidu.com/s/1qucE1B4DyaDRvkn_ZXuJng?pwd=91h1
提取碼:91h1
?
Lora/Embedding鏈接:
鏈接:https://pan.baidu.com/s/1Mf0schQoyCm_hf8uOsHg7A?pwd=dzli
提取碼:dzli
?
圖包鏈接:
鏈接:https://pan.baidu.com/s/15RJF3HT2s0ycpEsdGOQeCg?pwd=kof2
提取碼:kof2
交流群
qq群:697080799
微信群:
?

測試中使用的模型
CKPT大模型
abyssorangemix2SFW_abyssorangemix2Sfw
anything-v5
Basil mix
cetusMix_v4
Chilloutmix
CounterfeitV30_v30
ghostmix_v20Bakedvae
manmaruMix_v10
perfectWorld_v4Baked
realisticVision
revAnimated_v11
sxzLuma_098VAE
Lora模型
fufu3dv0.2(測試lora本體)
blindbox_V1Mix
zhongliLoraCollection_zhongliHard
kleeGenshinImpact_kleeGenshinImpact
?
Embedding模型
ng_deepnegative_v1_75t
EasyNegative
?
實際使用案例
?
?

?
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2??權重:0.8
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3698942781, Size: 600x800
?

?
?
大模型:anything-v5-PrtRE
?
Lora:?fufu3dv0.2??權重:0.8
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
?
1gril,white armor,knight,street,red hair,full body, chibi,wanju/(fufu/),standing,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3993299175, Size: 600x800
?
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2??權重:0.8
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1gril,green eyes, bony meat, eating, happy, bonfire, night, moonlight, beast ears,smile,full body, chibi,wanju/(fufu/),standing,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 27581122, Size: 600x800
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2 ?權重:0.45
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1gril,pointy ears,library,reading,red hair, magic,beast ears,smile,fox Tail,
full body, chibi,wanju/(fufu/),standing,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 778860232, Size: 600x800
?
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:?fufu3dv0.2?權重:0.45
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1gril,pointy ears,outdoors, ??magic,beast ears,smile,fox Tail,
full body, chibi,wanju/(fufu/),standing,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps:?35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1235833522, Size: 600x800
?
?

?
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2 ?權重:0.45
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1gril,outdoors, smile,
full body, chibi,wanju/(fufu/),standing,
PCR, CHIBI
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1814127239, Size: 600x800
?
?
提示詞對照表
大模型:CounterfeitV30_v30
?
Lora:add_detail??權重:1
?
Lora:kleeGenshinImpact_kleeGenshinImpact ?權重:1
?
Lora:fufu3dv0.2?權重:1
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1girl,red hat,blonde hair, WANJU\(FUFU\)
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 609054887, Size: 600x800
?
對照表
?

?
階段結論
使用這款lora,觸發(fā)詞建議使用以上幾個單詞作為提示詞,尤其是這個點點,雖然只是兩個英文句號加一個空格,但能極大的穩(wěn)定面部的生成,這個提示詞的權重可以放到1.5左右。
?
大模型測試
基礎信息
大模型:如下圖對照表所示
?
Lora:fufu3dv0.2 ?權重:0.8
?
嵌入式:EasyNegative??權重:1
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
Candles, Reading, Indoor,1girl, Top Hat,
WANJU\(FUFU\),chibi,hatsune miku,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3405368600, Size: 600x800
對照表
一測
?

?
二測
?

階段結論
這款lora對各種畫風的兼容方面表現(xiàn)一般,比較適合二次元畫風的大模型,如果要追求還原度,則推薦revanimeted。二測的幾款大模型比較推薦用于生成。
?
?
兼容性測試
?
人物lora測試(可莉)
基礎信息
大模型:?CounterfeitV30_v30
?
Lora:fufu3dv0.2??權重:0.5
?
Lora:kleeGenshinImpact_kleeGenshinImpact??權重:0.9
?
嵌入式:EasyNegative??權重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1girl,red hat,blonde hair,standing,looking at viewer, . . ,
WANJU\(FUFU\),chibi,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800
對照圖
?
?
?

?
人物lora測試(鐘離)
基礎信息
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2 ?權重:1
?
Lora:zhongliLoraCollection_zhongliHard ?權重:1.5
?
嵌入式:EasyNegative??權重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
?
1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,standing,
. . ,
WANJU\(FUFU\),chibi,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800
對照圖
?

?
畫風lora測試(盲盒)
基礎信息
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2 ?權重:0.6
?
Lora:blindbox_V1Mix??權重:0.5
?
嵌入式:EasyNegative??權重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
(1girl:1.5), Top Hat, blindbox,
. . ,
WANJU\(FUFU\),chibi,
?
負:
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3659272366, Size: 600x800
對照圖
?

階段結論
這款lora與人物兼容性適配的很不錯,效果理想。不過要注意之前提到的污染問題,可能會讓人物形象傾向初音未來的服裝,也可能讓發(fā)色偏向蔥綠色,需要小心調(diào)試權重或者多試幾次。
?
這里推薦fufuLora:權重0.9~1.1,人物Lora:0.5以上。
?
?
圖生圖測試
基礎信息
大模型:CounterfeitV30_v30
?
Lora:fufu3dv0.2??權重:0.7
?
嵌入式:EasyNegative??權重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權重:1
?
正:
?
masterpiece, best quality,
WANJU\(FUFU\),chibi,hatsune miku,
1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,
?
負:
?
NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2605847031, Size: 608x880
?
對照表
?

?
?
階段結論
圖生圖方面,由于身體比例變化大,這里不做推薦,在高重繪幅度下會有些微妙的效果,說不清是提取了原圖元素還是只是單純對提示詞生效。總之不太推薦使用。
?