AUTOMATIC
683287d87f
rework saving training params to file #6372
2023-01-06 08:52:06 +03:00
timntorres
b6bab2f052
Include model in log file. Exclude directory.
2023-01-05 09:14:56 -08:00
timntorres
b85c2b5cf4
Clean up ti, add same behavior to hypernetwork.
2023-01-05 08:14:38 -08:00
AUTOMATIC1111
eeb1de4388
Merge branch 'master' into gradient-clipping
2023-01-04 19:56:35 +03:00
Vladimir Mandic
192ddc04d6
add job info to modules
2023-01-03 10:34:51 -05:00
AUTOMATIC1111
b12de850ae
Merge pull request #5992 from yuvalabou/F541
...
Fix F541: f-string without any placeholders
2022-12-25 09:16:08 +03:00
Vladimir Mandic
5f1dfbbc95
implement train api
2022-12-24 18:02:22 -05:00
Yuval Aboulafia
3bf5591efe
fix F541 f-string without any placeholders
2022-12-24 21:35:29 +02:00
AUTOMATIC1111
c9a2cfdf2a
Merge branch 'master' into racecond_fix
2022-12-03 10:19:51 +03:00
brkirch
4d5f1691dd
Use devices.autocast instead of torch.autocast
2022-11-30 10:33:42 -05:00
flamelaw
1bd57cc979
last_layer_dropout default to False
2022-11-23 20:21:52 +09:00
flamelaw
d2c97fc3fe
fix dropout, implement train/eval mode
2022-11-23 20:00:00 +09:00
flamelaw
89d8ecff09
small fixes
2022-11-23 02:49:01 +09:00
flamelaw
5b57f61ba4
fix pin_memory with different latent sampling method
2022-11-21 10:15:46 +09:00
flamelaw
bd68e35de3
Gradient accumulation, autocast fix, new latent sampling method, etc
2022-11-20 12:35:26 +09:00
AUTOMATIC
cdc8020d13
change StableDiffusionProcessing to internally use sampler name instead of sampler index
2022-11-19 12:01:51 +03:00
Muhammad Rizqi Nur
cabd4e3b3b
Merge branch 'master' into gradient-clipping
2022-11-07 22:43:38 +07:00
AUTOMATIC
62e3d71aa7
rework the code to not use the walrus operator because colab's 3.7 does not support it
2022-11-05 17:09:42 +03:00
AUTOMATIC1111
cb84a304f0
Merge pull request #4273 from Omegastick/ordered_hypernetworks
...
Sort hypernetworks list
2022-11-05 16:16:18 +03:00
Muhammad Rizqi Nur
bb832d7725
Simplify grad clip
2022-11-05 11:48:38 +07:00
Isaac Poulton
08feb4c364
Sort straight out of the glob
2022-11-04 20:53:11 +07:00
Muhammad Rizqi Nur
3277f90e93
Merge branch 'master' into gradient-clipping
2022-11-04 18:47:28 +07:00
Isaac Poulton
fd62727893
Sort hypernetworks
2022-11-04 18:34:35 +07:00
Fampai
39541d7725
Fixes race condition in training when VAE is unloaded
...
set_current_image can attempt to use the VAE when it is unloaded to
the CPU while training
2022-11-04 04:50:22 -04:00
aria1th
1ca0bcd3a7
only save if option is enabled
2022-11-04 16:09:19 +09:00
aria1th
f5d394214d
split before declaring file name
2022-11-04 16:04:03 +09:00
aria1th
283249d239
apply
2022-11-04 15:57:17 +09:00
AUTOMATIC1111
4918eb6ce4
Merge branch 'master' into hn-activation
2022-11-04 09:02:15 +03:00
Muhammad Rizqi Nur
d5ea878b2a
Fix merge conflicts
2022-10-31 13:54:40 +07:00
Muhammad Rizqi Nur
4123be632a
Fix merge conflicts
2022-10-31 13:53:22 +07:00
Muhammad Rizqi Nur
cd4d59c0de
Merge master
2022-10-30 18:57:51 +07:00
AUTOMATIC1111
17a2076f72
Merge pull request #3928 from R-N/validate-before-load
...
Optimize training a little
2022-10-30 09:51:36 +03:00
Muhammad Rizqi Nur
3d58510f21
Fix dataset still being loaded even when training will be skipped
2022-10-30 00:54:59 +07:00
Muhammad Rizqi Nur
a07f054c86
Add missing info on hypernetwork/embedding model log
...
Mentioned here: https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/1528#discussioncomment-3991513
Also group the saving into one
2022-10-30 00:49:29 +07:00
Muhammad Rizqi Nur
ab05a74ead
Revert "Add cleanup after training"
...
This reverts commit 3ce2bfdf95
2022-10-30 00:32:02 +07:00
Muhammad Rizqi Nur
3ce2bfdf95
Add cleanup after training
2022-10-29 19:43:21 +07:00
Muhammad Rizqi Nur
ab27c111d0
Add input validations before loading dataset for training
2022-10-29 18:09:17 +07:00
Muhammad Rizqi Nur
05e2e40537
Merge branch 'master' into gradient-clipping
2022-10-29 15:04:21 +07:00
timntorres
e98f72be33
Merge branch 'AUTOMATIC1111:master' into 3825-save-hypernet-strength-to-info
2022-10-29 00:31:23 -07:00
AUTOMATIC1111
810e6a407d
Merge pull request #3858 from R-N/log-csv
...
Fix log off by 1 #3847
2022-10-29 07:55:20 +03:00
Muhammad Rizqi Nur
9ceef81f77
Fix log off by 1
2022-10-28 20:48:08 +07:00
Muhammad Rizqi Nur
16451ca573
Learning rate sched syntax support for grad clipping
2022-10-28 17:16:23 +07:00
timntorres
db5a354c48
Always ignore "None.pt" in the hypernet directory.
2022-10-28 01:41:57 -07:00
benkyoujouzu
b2a8b263b2
Add missing support for linear activation in hypernetwork
2022-10-28 12:54:59 +08:00
Muhammad Rizqi Nur
2a25729623
Gradient clipping in train tab
2022-10-28 09:44:56 +07:00
AngelBottomless
029d7c7543
Revert unresolved changes in Bias initialization
...
it should be zeros_ or parameterized in future properly.
2022-10-27 14:44:53 +09:00
guaneec
cc56df996e
Fix dropout logic
2022-10-27 14:38:21 +09:00
AngelBottomless
85fcccc105
Squashed commit of fixing dropout silently
...
fix dropouts for future hypernetworks
add kwargs for Hypernetwork class
hypernet UI for gradio input
add recommended options
remove as options
revert adding options in ui
2022-10-27 14:38:21 +09:00
guaneec
b6a8bb123b
Fix merge
2022-10-26 15:15:19 +08:00
timntorres
a524d137d0
patch bug (SeverianVoid's comment on 5245c7a)
2022-10-26 10:12:46 +03:00
