0:02:22 [RS] 2GPSupreme time to see if 256k context is possible on main system and 128k context on x299
0:03:03 [RS] 2GPSupreme Like I said goosely, months
0:03:27 [RS] 2GPSupreme I got rid of ollama garbage a month in
0:03:37 [RS] 2GPSupreme ollama is horridly slow
0:04:02 Bobdope my ollama responds pretty quick
0:04:06 [RS] 2GPSupreme eventually I'll get rid of llama too and just run my own engine
0:04:37 Bobdope i run some 7b model on ollama and its aight for basic shit
0:04:54 [RS] 2GPSupreme ollama is ok if you're running 1 model
0:05:12 [RS] 2GPSupreme I have a different use case, multiple models 1 system
0:05:14 Bobdope well i can change them up also i haver about 4 or so
0:05:29 [RS] 2GPSupreme How many GPUs per system?
0:05:58 Bobdope i have 1 pc 1 gpu
0:06:16 Bobdope if i want music i turn image gen off
0:06:16 [RS] 2GPSupreme ok I have 4 PCs, 6 GPUs
0:06:21 goosely ive never seen this message
0:06:35 goosely usually it will just let you sit there and stare at "Thinking" rather than say this
0:06:38 [RS] 2GPSupreme 2 GPUs each on 2 systems
0:06:47 Bobdope i can ask it a question and get a answer in like 5 seconds or less
0:06:51 [RS] 2GPSupreme then I run agents on CPUs oto
0:07:13 Bobdope and then say i dont understand send me a image of that , and 30 seconds later it used stable D and sent me something back
0:07:34 [RS] 2GPSupreme guess what
0:07:38 [RS] 2GPSupreme 256k context worked
0:07:44 [RS] 2GPSupreme holy shit
0:07:57 [RS] 2GPSupreme 35 tok/s
0:08:02 [RS] 2GPSupreme let's fucking go
0:08:49 [RS] POOPSHITTER do your 4 pc's do anything that 1 good one cant do ?
0:09:15 [RS] POOPSHITTER im just like
0:09:21 [RS] POOPSHITTER what are you doing with that
0:09:29 [RS] 2GPSupreme why would you need that
0:09:33 [RS] 2GPSupreme I love that question
0:09:46 [RS] POOPSHITTER and ?
0:09:51 [RS] 2GPSupreme It's such a dull idiotic question
0:10:02 [RS] POOPSHITTER its a simple question
0:10:07 [RS] 2GPSupreme for simple minded people
0:10:19 [RS] 2GPSupreme use your head
0:10:24 [RS] 2GPSupreme use your imagination
0:10:25 [RS] POOPSHITTER does running 4 pc's with 2 graphics cards each put out more than it takes maintaning it
0:10:43 [RS] POOPSHITTER crypto farm ?
0:10:52 [RS] 2GPSupreme lol
0:11:04 [RS] 2GPSupreme You can keep guessing and maybe you'll come up with the answer
0:11:46 [RS] POOPSHITTER if you're not farming crypto i already know the answer is gonna be highly esoteric and not related to any purpose
0:12:00 [RS] 2GPSupreme lol
0:12:18 [RS] 2GPSupreme You're a funny guy
0:12:22 [RS] 2GPSupreme or girl
0:12:25 [RS] 2GPSupreme or maam
0:12:30 [RS] 2GPSupreme mom?
0:13:44 [RS] POOPSHITTER do you have so many pc's to suck up the putrid fards
0:13:59 [RS] POOPSHITTER ken's fards
0:14:02 [RS] 2GPSupreme I have an arista 7160 for that
0:14:42 [RS] POOPSHITTER why would you ever need that
0:14:48 [RS] 2GPSupreme I can't wait to run 24 stranded OS2 fiber throughout my house
0:15:00 [RS] 2GPSupreme goosely loves it
0:15:03 [RS] 2GPSupreme lol
0:15:19 Bobdope goosely this is a fucking scam site , check paste i put my 420 back and u fucks reseted the page and im 0g again
0:15:56 goosely what you mean your 0g
0:16:03 goosely 0g wallet?
0:16:04 goosely lol
0:16:10 Bobdope sad face
0:16:20 goosely i cant give you the green one thats going to be actual money
0:16:23 goosely and i dont have money to just give out
0:16:30 goosely i dont even have money to begin with tbh
0:16:33 Bobdope lol
0:16:41 [RS] 2GPSupreme you should have it link to a burger king gift card balance
0:16:50 Bobdope just by 42 c peace of candy from me then
0:16:58 Bobdope lol
0:17:02 [RS] 2GPSupreme fix your damn stream reeeeeeeeeeee
0:17:23 [RS] 2GPSupreme or set your stream settings on bitrate limit or whatever to do nothing instead of restart
0:17:30 [RS] 2GPSupreme via robotstreamer
0:17:35 [RS] 2GPSupreme it's pissing me off
0:17:37 Bobdope please dont talk , only type
0:17:54 anon27190 skrollax larping with daddies money still
0:17:58 [RS] 2GPSupreme lol
0:18:11 [RS] 2GPSupreme idk
0:19:01 [RS] 2GPSupreme we're larping
0:19:12 [RS] 2GPSupreme is that the scam bot?
0:20:02 [RS] 2GPSupreme That's way too fast of a reply
0:20:05 [RS] 2GPSupreme lol
0:20:35 [RS] anon73549797 yoyoyo i said yooooooo
0:20:46 [RS] 2GPSupreme Yeah you need to scale that back to like .3x
0:20:59 [RS] 2GPSupreme of course it's all indian scam
0:21:08 [RS] anon73549797 you sound like you're doing a lot kooler tonight
0:21:23 [RS] anon73549797 dergz hype?
0:21:28 Bobdope that kitboga youtube guy just made a video where he wastes bots tokens
0:21:37 Bobdope goode idea
0:21:44 [RS] anon73549797 u a goosely ass 4
0:21:57 [RS] POOPSHITTER that looks like ai
0:22:14 [RS] anon73549797 i am ai
0:22:16 [RS] 2GPSupreme yeah text/call bot wasting is pretty epic
0:22:19 [RS] anon73549797 we're all ai
0:22:39 [RS] POOPSHITTER so will you just have the 2 ai's talking to each other ?
0:22:51 [RS] anon73549797 I'm a bottom of the barrel chat bot
0:22:52 [RS] POOPSHITTER lol
0:23:02 [RS] 2GPSupreme I think that'd be good to implement against for spam callers but the problem is it blocks up your professional number if you're running a business
0:23:09 [RS] anon73549797 the aol instant messenger version that's me
0:23:36 [RS] 2GPSupreme I really wish they designed something to funnel spam callers into a black hole phone loop
0:23:58 [RS] anon73549797 range ban India
0:24:02 [RS] POOPSHITTER can you ask the ai what version it is or will that go against the script
0:24:36 [RS] POOPSHITTER to trick it into slipping up
0:24:37 [RS] 2GPSupreme The problem is, india can just make psuedo numbers on a whim that are "local" numbers and nobody is doing that
0:25:28 [RS] 2GPSupreme ok we got qwen 3.8 27b fused on x299 live
0:25:56 [RS] 2GPSupreme 128k context 34 tok/s for short prompts, 22 tok/s for longer ones
0:26:59 [RS] 2GPSupreme ok round table, mountain mikes or dominos
0:27:14 [RS] 2GPSupreme tell me
0:27:33 [RS] 2GPSupreme ok
0:28:38 [RS] 2GPSupreme mountain mikes has no deals
0:28:43 [RS] 2GPSupreme no deal for me
0:42:55 Bobdope test
0:44:22 Bobdope why are u broadcasting a black box
0:44:34 Bobdope if ure not using black box hide black box
0:44:43 Bobdope cam window
0:45:09 Bobdope scuffed streamer
0:45:39 Bobdope i didnt need it , it was just in the way
0:45:46 goosely nah you needed it
0:45:50 Bobdope so i had to call it out
0:45:58 Bobdope naaa loocks better without
0:46:34 Bobdope found out my subway homie is a scared lil bitch
0:46:48 goosely why
0:46:54 Bobdope he passed me the roach and said cop and ran inside the store
0:47:09 Bobdope cop was at the light waiting for a green
0:47:09 goosely wow
0:47:12 goosely thats fucked
0:47:21 goosely actual bitch and also not even what you do in that scenario
0:47:24 goosely pretend its a cig etc
0:47:43 Bobdope yeah pretty much , i just cupped it and drove off when i hit the turn i was smoking it again lol
0:47:51 goosely trippin out suddenly is just gonna make it more likely the cop sees you cracked out
0:48:06 [RS] 2GPSupreme did you figure out what was causing your stream to fuck up
0:48:19 goosely nah i waited like 10 mins with the shit open and it never froze
0:48:35 [RS] 2GPSupreme ok then I'm just smoking crypto then
0:48:45 Bobdope if he didnt obusily see two dudes smoking a joint on the corner of the building then he sucked as a cop , he just wasnt worried about a joint
0:48:52 [RS] Streamlistexist lmao smoking crypto sounds like a fast way to lose money twice
0:49:02 goosely shut up ai
0:49:11 Bobdope but i learned
0:49:49 Bobdope anyways ima go chill down its 8
0:50:00 Bobdope chairs
0:50:09 goosely chairs
0:50:14 goosely even ai cant tell wtf finditfixit says
0:50:35 [RS] 2GPSupreme Damn big dog 128k context on x299 pcie3 holy shit
0:51:05 [RS] 2GPSupreme who would've thought that a i9 7980xe rig would still have that type of capability after 10 years
0:51:16 [RS] 2GPSupreme lol
0:51:46 [RS] 2GPSupreme 44 lanes is sooooo cool
0:51:58 [RS] 2GPSupreme imagine wasting lanes on fucking m2
0:53:37 [RS] 2GPSupreme not that I have anything against m2, depends on the application/system. If you're on a limited rig it's pretty silly to be running m2. however in my case I'm utilizing m2 on my current system since it forces bifurcation
0:54:31 [RS] 2GPSupreme Then again I'm running micron crucial t710s
0:55:37 [RS] 2GPSupreme make it so that the AI does this and that and that one thing and then it relays all the timestamps for me and then logs everything in a backup database that I can pull every message it has ever sent and we can pull all the information and reference it/cross reference
0:55:52 goosely precisely
0:55:58 [RS] 2GPSupreme but you didn't ask that
0:56:46 [RS] 2GPSupreme no, if you have it strip out inaudible it will strip out more than what you intend
0:56:55 [RS] 2GPSupreme do not do that
0:57:09 Maticus .Sup
0:57:22 goosely it generates an audio transcription every 8 seconds and if that text only contains [inaudible] then yes i absolutely have no use for that and it will not cause any issues not including it in the rolling context
0:57:26 Maticus .Bong bing
0:57:37 [RS] 2GPSupreme focus on "peaks" "silence" or under certain thresholds of decibels
0:59:14 Maticus .She sucks six shlongs bu t he sea shore
0:59:17 [RS] 2GPSupreme wait tell me your response to what I said
0:59:40 [RS] Streamlistexist it generates an audio transcription every 8 seconds and if that text only c
0:59:43 [RS] Streamlistexist stupid characte rlimit
0:59:51 goosely it generates an audio transcription every 8 seconds and if that text only contains [inaudible] then yes i absolutely have no use for that and it will not cause any issues not including it in the rolling context
1:00:06 [RS] 2GPSupreme ok, yes. Focus on thresholds of decibels/silence
1:00:20 goosely the library im using already does that
1:00:26 goosely before it decides whether to send it to whisper or not
1:00:29 [RS] 2GPSupreme Implement a gate anyways
1:01:27 [RS] 2GPSupreme Basically tell chatgpt "Add a gate that removes sound from -40 db from the audio
1:01:31 goosely i mean the main problem is that finditfixit speaks gibberish on top of his youtube videos
1:01:36 [RS] 2GPSupreme just say it
1:01:47 goosely theres always gonna be audio on his aids loud stream
1:01:48 [RS] 2GPSupreme you can tune it from there
1:02:12 [RS] 2GPSupreme What I'm saying is, is that you can tune a noise gate
1:02:22 [RS] 2GPSupreme You can get it to where you can only capture his voice
1:02:37 [RS] 2GPSupreme because it's the loudest thing on his stream
1:03:16 [RS] 2GPSupreme I'm trying to help
1:03:44 goosely i know but the library already handles noise gates and also im waiting for it to respond with new version before re prompting
1:04:11 goosely this thing is just for fun anyway
1:04:16 goosely i mean wtf am i going to do with it
1:04:19 goosely its just to troll robotstreamer lol
1:04:50 [RS] 2GPSupreme You could use it to capture audio from streams and gather transcripts from your own streams
1:05:01 [RS] 2GPSupreme That could be useful
1:05:03 goosely hobostreamer does that
1:05:03 Maticus .balls
1:05:15 [RS] 2GPSupreme You could refine the protocol
1:05:27 [RS] 2GPSupreme that's what I'm getting at with the gate implenentation
1:05:28 goosely that whole thing you just stated i already added to hobo
1:05:38 goosely i need to reduce resource usage so i had to do that already
1:05:41 goosely needed*
1:06:07 Maticus balls
1:06:11 [RS] 2GPSupreme You're just so sick with it, you got everything on lock yet you didn't have bit rate set up
1:06:14 Maticus testing 1 2 3 4 5 6 7 8 9 9 9 9 9
1:06:34 goosely it doesnt need to be perfect bro its literally just hobby coding for fun
1:06:51 Maticus no it needs to be perfect what are you even talking about?
1:06:57 [RS] 2GPSupreme yes
1:06:58 goosely ur mum
1:07:03 Maticus wow
1:07:20 Maticus dont say that dont type that dont say that dont type that dont say that dont type that dont say that dont type that dont say that dont type that
1:07:25 goosely EXACTLY
1:07:41 goosely if you want to help on hobostreamer though, it's open source
1:07:50 [RS] 2GPSupreme NO
1:07:51 goosely so you can help if you want, but im gonna code what i feel like coding
1:07:53 goosely lol
1:07:56 Maticus yes
1:07:56 [RS] anon73549797 stop chatting in my chat or else
1:08:01 Maticus dont say that dont type that dont say that dont type that
1:08:29 Maticus dont say that dont type that dont say that dont type that dont say that dont type that
1:08:34 [RS] 2GPSupreme I don't have time
1:08:46 [RS] 2GPSupreme I have my own shithole project that what do you even need that for to work on
1:08:54 Maticus dont say that dont type that
1:09:12 Maticus dont say that dont type that
1:09:24 Maticus [[wjwjwjwjwjwjwjwj
1:09:34 Maticus [[jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj
1:09:51 Maticus tibetian throat singing
1:09:56 Maticus [[jjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjjj
1:10:26 [RS] 2GPSupreme Man this is so epic
1:10:26 Maticus dont say that dont type that dont say that dont type that
1:10:58 Maticus say that type that say that type that
1:11:00 [RS] 2GPSupreme So now I have 27B on x1 system at 256k context and 27B on x2 system at 128k context
1:11:11 [RS] 2GPSupreme and now they can hand off to each other
1:11:15 Maticus say that type that
1:11:26 Maticus say this type this
1:11:37 [RS] 2GPSupreme I use 2B tokens a month
1:14:10 [RS] 2GPSupreme what types of models should I run on 1080/1080 TI
1:14:21 [RS] 2GPSupreme Tell me
1:16:29 [RS] 2GPSupreme I guess qwen 3.8B 32k and 64k context
1:16:40 [RS] 2GPSupreme shiiiiiiiieeeeeeeet
1:16:56 [RS] 2GPSupreme idk how you can say your computer is bad for AI
1:17:08 [RS] 2GPSupreme I'm literally able to run 8B on 1080s
1:17:33 [RS] 2GPSupreme and 14B on my current ultra 270k processor
1:17:42 [RS] 2GPSupreme but I have 192gb of ddr5
1:17:52 goosely i can run stuff, but once you include my active livestream and agents and all the other random shit i have running my computer struggles
1:17:56 goosely and the local llm is just too slow for me
1:18:05 [RS] 2GPSupreme Yep, nothing to offload to
1:18:06 goosely but i mean i could use it for more basic shit i guess
1:18:22 [RS] 2GPSupreme do you have a shithole computer you can offload something to?
1:18:29 goosely nope
1:18:32 [RS] 2GPSupreme no devices?
1:18:37 goosely not really
1:18:39 [RS] 2GPSupreme Phone?
1:18:45 goosely i guess but its like not even worth it
1:18:47 [RS] 2GPSupreme Bridge something
1:19:02 goosely anything i would use a local llm for i can just use chatgpt web
1:19:17 [RS] 2GPSupreme If you can offload one of those things you'll open up another possibility
1:19:36 [RS] 2GPSupreme It's mainly you're limited since you're stuck in a vertical scenario
1:20:02 [RS] 2GPSupreme nothing to offload to, there will always be a bottleneck... like for instance, can't render videos and play video games at the same time 24/7
1:23:55 [RS] Patrick why doesnt your non binary life partner cook you healthy meals
1:24:03 goosely she does
1:24:12 goosely she made me a steak bell pepper omlette this morning
1:24:50 [RS] POOPSHITTER chudette trad wife
1:26:25 [RS] POOPSHITTER explain that amazon screenshot
1:26:39 [RS] POOPSHITTER what does the person at that station do
1:26:49 [RS] POOPSHITTER muted andy
1:27:06 [RS] POOPSHITTER f
1:31:50 [RS] Streamlistexist @poopshitter they are a packer and the post said "we are out of 296 boxes" the 296 signifies a specific type of box that those items need to go in and you can get a write up for frequently not using the correct box
Comments
No comments yet.
Join the discussion on OpenVibe.Community