【Lora測(cè)試17】用Stable diffusion模擬油畫筆觸

前言
對(duì)油畫LoRa的全面評(píng)測(cè)
?
今天給大家?guī)?lái)的是古典油畫畫風(fēng)的畫風(fēng)lora,相較于之前評(píng)測(cè)的《極樂(lè)disco》巡回畫派的狂野奔放,這款lora則更像是大家通常會(huì)見(jiàn)到的油畫畫風(fēng)。
?
萬(wàn)物皆可油畫,尤其是背景會(huì)表現(xiàn)的格外明顯,圖生圖效果明顯。
Lora訓(xùn)練集主要以風(fēng)景畫為主,生成風(fēng)景效果格外棒且與大部分大模型都比較兼容,但過(guò)于獨(dú)特的大模型就有點(diǎn)沒(méi)辦法融合。生成時(shí)有人物缺失的情況,可能與以風(fēng)景畫為主的訓(xùn)練集為主。雖然與極樂(lè)disco畫風(fēng)不一樣,但生成效果與兼容性略弱一籌。
?
本次測(cè)試的可以生成一些很有反差感的東西,就比如把二次元美少女用油畫的筆觸勾勒出來(lái),把一些人物肖像轉(zhuǎn)化成接近油畫的質(zhì)感。
下載鏈接
大模型鏈接:
鏈接:https://pan.baidu.com/s/1Sf0d4dBguvGWbk7BoqZiHA?pwd=1rm6
提取碼:1rm6
?
Lora/Embedding鏈接:
鏈接:https://pan.baidu.com/s/1ygNJZ79aCYO_BgKdqOq4pA?pwd=k8l7
提取碼:k8l7
?
圖包鏈接:
鏈接:https://pan.baidu.com/s/19MCdX2X3NX1iHCe8p3rFDA?pwd=14zq
提取碼:14zq
交流群
qq群:697080799
微信群:
?

測(cè)試中使用的模型
CKPT大模型
abyssorangemix2SFW_abyssorangemix2Sfw
anything-v5
Basil mix
cetusMix_v4
Chilloutmix
CounterfeitV30_v30
ghostmix_v20Bakedvae
manmaruMix_v10
perfectWorld_v4Baked
realisticVision
revAnimated_v11
sxzLuma_098VAE
majicmixRealistic_v6
Lora模型
bichu-v0612(測(cè)試lora本體)
blindbox_V1Mix
zhongliLoraCollection_zhongliHard
kleeGenshinImpact_kleeGenshinImpact
Add_detail
Mecha
GachaSplashAlter
Embedding模型
ng_deepnegative_v1_75t
EasyNegative
?
實(shí)際使用案例
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:GachaSplashAlter ?權(quán)重:0.7
?
Lora:bichu-v0612 ?權(quán)重:0.5
?
Lora:Mecha ?權(quán)重:0.5
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, ?(white background:1.0),
1gril,white armor,knight,red hair,A long large cloak that grows to the ground,castle,
|BICHU,
|OIL PAINTING,
|IMPRESSIONISM,
<lora:Mecha:0.5>
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4257521451,?Size: 600x800
?
?

?
大模型:CounterfeitV30_v30
?
Lora:GachaSplashAlter ?權(quán)重:0.7
?
Lora:bichu-v0612 ?權(quán)重:0.8
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, ?(white background:1.0),
dress,1girl,full body,A long large cloak that grows to the ground,street,Witch Hat,white hair,
|BICHU,
|OIL PAINTING,|IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler:?DPM++ SDE Karras,?CFG scale: 7, Seed: 3050064932,?Size: ?496x800
?
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:bichu-v0612 ?權(quán)重:1.05
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,full body,
|BICHU,
|OIL PAINTING,
|IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3440931077,?Size: 960x536
?
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:GachaSplashAlter ?權(quán)重:0.7
?
Lora:bichu-v0612???權(quán)重:0.8
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, ?(white background:1.0),
1gril,green eyes, bony meat, eating, happy, bonfire, night, moonlight, beast ears,
|BICHU,
|OIL PAINTING,
|IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler:DPM++ SDE Karras, CFG scale: 7, Seed: 4240876446,?Size: 500x800
?
?
?

?
?
大模型:CounterfeitV30_v30
?
Lora:hanfu ?權(quán)重:0.8
?
Lora:GachaSplashAlter 權(quán)重:0.7
?
Lora:bichu-v0612???權(quán)重:0.8
?
Lora:kleeGenshinImpact_kleeGenshinImpact ?權(quán)重:0.5
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, ?(white background:1.0),
masterpiece, best quality, <lora:hanfu:1>,hanfukozue, 1girl, black hair, bug, butterfly, barefoot, solo, hair ornament, sitting, hanfu, chinese clothes, anklet, leaf, fruit, jewelry, white background, long sleeves, simple background, food, grapes, full body, single hair bun, holding, hair stick, wide sleeves, hair bun, smile, yokozuwari, looking at viewer, long hair, closed mouth, hand up, flower, holding leaf, on floor,
|BICHU,
|OIL PAINTING,
|IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4232934891,?Size: ?500x800
?
?

?
?
大模型:?CounterfeitV30_v30
?
Lora:GachaSplashAlter ?權(quán)重:0.7
?
Lora:bichu-v0612 ?權(quán)重:0.8
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, ?(white background:1.0),
1gril,pointy ears,library,reading,blonde hair,
|BICHU,
|OIL PAINTING,
|IMPRESSIONISM,
?
PCR, CHIBI
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3558119969, Size: 500x800
?
大模型測(cè)試
基礎(chǔ)信息
大模型:如下圖對(duì)照表所示
?
Lora:?bichu-v0612???權(quán)重:0.2
?
嵌入式:EasyNegative??權(quán)重:1
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
?
1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,
BICHU,
OIL PAINTING,
IMPRESSIONISM,
負(fù):
?
?paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 977523733, Size: 600x800
對(duì)照表
一測(cè)
?

?
二測(cè)
?

階段結(jié)論
本次測(cè)試的油畫lora意外的與二次元畫風(fēng)大模型契合度高,但論筆觸的還原程度則realistic還原度更高。
從測(cè)試結(jié)果來(lái)看,平面類風(fēng)格除了繪本風(fēng)格的大模型之外幾乎全部生效,生效程度略有高低。在選擇大模型時(shí),推薦規(guī)避畫風(fēng)過(guò)于獨(dú)特的模型。并且因?yàn)楸旧碛?xùn)練集選擇的是風(fēng)景為主,生成畫面時(shí)會(huì)有人物消失的情況,也需要注意提示詞可以加強(qiáng)一些人物生成方面的控制。
?
?
兼容性測(cè)試
?
人物lora測(cè)試(可莉)
基礎(chǔ)信息
大模型:?CounterfeitV30_v30
?
Lora:bichu-v0612 ?權(quán)重:0.5
?
Lora:kleeGenshinImpact_kleeGenshinImpact??權(quán)重:0.9
?
嵌入式:EasyNegative??權(quán)重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,full body,klee \(genshin impact\),
BICHU,
IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4207137183, Size: 600x800
對(duì)照?qǐng)D
?
?
?

?
人物lora測(cè)試(鐘離)
基礎(chǔ)信息
大模型:CounterfeitV30_v30
?
Lora:bichu-v0612???權(quán)重:0.5
?
Lora:zhongliLoraCollection_zhongliHard ?權(quán)重:0.7
?
嵌入式:EasyNegative??權(quán)重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,
BICHU,IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1285252390, Size: 600x800
對(duì)照?qǐng)D
?
?

?
?
畫風(fēng)lora測(cè)試(盲盒)
基礎(chǔ)信息
大模型:?CounterfeitV30_v30
Lora:blindbox_V1Mix??權(quán)重:0.5
?
Lora:bichu-v0612???權(quán)重:0.5
?
嵌入式:EasyNegative??權(quán)重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,
(1girl:1.5), Top Hat, blindbox,chibi,
BICHU,
IMPRESSIONISM,
?
負(fù):
?
paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres,?bad?anatomy,?bad?hands,?text,?error,?missing?fingers,?extra?digit,?fewer?digits,?cropped,?worst?quality,?low?quality,?normal?quality,?jpeg?artifacts,?signature,?watermark,?username,?blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 185609732,?Size: 600x800
對(duì)照?qǐng)D
?
?

?
?
階段結(jié)論
對(duì)人物lora的兼容性效果不錯(cuò),推薦油畫lora權(quán)重0.5~1.0?,人物lora權(quán)重 0.6~1.0。
盲盒l(wèi)ora的與同為畫風(fēng)lora的模型并不契合,這里不推薦使用。
?
圖生圖測(cè)試
基礎(chǔ)信息
大模型:?CounterfeitV30_v30
?
Lora:bichu-v0612 ?權(quán)重:0.5
?
嵌入式:EasyNegative??權(quán)重:0.7
?
嵌入式:ng_deepnegative_v1_75t??權(quán)重:1
?
正:
?
masterpiece, best quality,
BICHU,IMPRESSIONISM,
1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,
?
負(fù):
?
NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors
?
Steps: 35,?Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2839412415,?Size: 608x880
?
對(duì)照表
?
?

?
階段結(jié)論
圖生圖測(cè)試效果良好,在保留一定程度人物特征的情況下依然生成了畫面,有較為明顯的油畫筆觸。這里使用的是二次元畫風(fēng)的大模型,如果需要更加寫實(shí),換成realistic可能會(huì)有更強(qiáng)烈的效果。
?