@waifu @VD15 LLammaCPP can split the model between your GPU and CPU so you can maybe run 1-2 layers on your GPU and rest on your CPU. With a quantized (https://huggingface.co/TheBloke/Silicon-Maid-7B-GGUF) small model it shouldn't be super slow.

**matrix07012** · Jan 06, 2024, 11:32

matrix07012 boosted

Jan 06, 2024, 11:32

Jan 06, 2024, 11:32

:VD15_0::VD15_1::VD15_2::VD15_3::VD15_4::VD15_5::VD15_6::VD15_7: @VD15@pl.valkyrie.world

89034b0d864e05ab0e2f2446c1382b8429d6c6c3d1253d59e4950112405d541f.png

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:37

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:37

Jan 06, 2024, 10:37

matrix07012 @matrix@gameliberty.club

@sjw

c7ca328b0370f91f.mp4

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:36

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:36

Jan 06, 2024, 10:36

matrix07012 @matrix@gameliberty.club

@burner who?

**matrix07012** · Jan 06, 2024, 03:54

matrix07012 boosted

**Electric Pants** @sjw@bae.st · Jan 06, 2024, 03:54

Jan 06, 2024, 03:54

Electric Pants @sjw@bae.st

@matrix
c8d6610cfc.webm

b9dd77af7e6c85e1014219dbe83b0209953cbf08a85b715942f31c9207e8c00c.webm?name=c8d6610cfc.webm

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:35

**matrix07012** @matrix@gameliberty.club · Jan 06, 2024, 10:35

Jan 06, 2024, 10:35

matrix07012 @matrix@gameliberty.club

f436c43401b27329.png

**matrix07012** · Jan 05, 2024, 17:53

matrix07012 boosted

**KF01 Deleted User** @kf01@breastmilk.club · Jan 05, 2024, 17:53

Jan 05, 2024, 17:53

KF01 Deleted User @kf01@breastmilk.club

f211d5a9f10c3b6c884f4331815baf6f46830c1b7078fddfaa8b3c660e547a47.jpg

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 17:55

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 17:55

Jan 05, 2024, 17:55

matrix07012 @matrix@gameliberty.club

468bb1594ce10558.mp4

**matrix07012** · Jan 05, 2024, 17:25

matrix07012 boosted

**ShadowBroker 🇵🇸** @Shadowbroker2135@poa.st · Jan 05, 2024, 17:25

Jan 05, 2024, 17:25

ShadowBroker 🇵🇸 @Shadowbroker2135@poa.st

0d1d87aa748fbbd27c9e3a0cca3fa0759a98cbe07e78a5cfc2c85ad6bb4754b1.mp4

**matrix07012** · Jan 02, 2024, 18:20

matrix07012 boosted

**Shadowman311** @Shadowman311@poa.st · Jan 02, 2024, 18:20

Jan 02, 2024, 18:20

Shadowman311 @Shadowman311@poa.st

588d8f416552626dbaf8b75e6a41d4089b84123e7f6c0764ab3f2f7a24196198.jpg

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 15:22

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 15:22

Jan 05, 2024, 15:22

matrix07012 @matrix@gameliberty.club

ff7a25ccdee84ba2.mp4

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 15:21

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 15:21

Jan 05, 2024, 15:21

matrix07012 @matrix@gameliberty.club

ced0fcfd55dc8a85.mp4

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:43

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:43

Jan 05, 2024, 05:43

matrix07012 @matrix@gameliberty.club

60d3a41fa95c05cb.mp4

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:42

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:42

Jan 05, 2024, 05:42

matrix07012 @matrix@gameliberty.club

06ff2662c0d11246.mp4

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:41

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 05:41

Jan 05, 2024, 05:41

matrix07012 @matrix@gameliberty.club

3da0f1951b6cde83.mp4

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 04:52

**matrix07012** @matrix@gameliberty.club · Jan 05, 2024, 04:52

Jan 05, 2024, 04:52

matrix07012 @matrix@gameliberty.club

04ca34c615e2a652.png

**matrix07012** · Jan 04, 2024, 13:04

matrix07012 boosted

**Out of Touch Thursdays** @oott@poa.st · Jan 04, 2024, 13:04

Jan 04, 2024, 13:04

Out of Touch Thursdays @oott@poa.st

Because a vision softly creeping 🌑
Left its seeds while I was sleeping 🛌🏻
And the vision that was planted in my brain 🧠
Still remains within the sound of Out of Touch Thursday 👯