131
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 31 Aug 2023
131 points (95.8% liked)
Ask Lemmy
27268 readers
3163 users here now
A Fediverse community for open-ended, thought provoking questions
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !askusa@discuss.online
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
founded 2 years ago
MODERATORS
Programming. I have a bunch of ideas that are actually useful for my job, but I can’t seem to keep track of the necessary steps to write the code. ChatGPT has helped me create a couple of programs: a discord bot and a very complex (for me) application that brings in NASA data that automatically runs through Stable Diffusion. The code interpreter is amazing… but there’s too much context I’m missing for these things to be truly fun the way I imagine them to be.
Depending on what your level of experience is, it might just take more time and practice. When I was doing my degree, it took two years, an internship, and multiple serious programming courses before I truly felt comfortable programming.
Look up UC Berkeley's CS61A, B, and C, then start looking deeper into the CS curriculum to find the pieces you are missing. For me, it took trying to optimise the CPU scheduler for single threaded processes in Linux, specifically complex assemblies in FreeCAD. That lead me to a few lectures about the scheduler in the OS principals course. I've done a bunch of little embedded projects but struggle with complexity. The concepts around a scheduler are what I was missing. There are a lot of things like this that are readily available for free online if you just go searching for them specifically.
If you want to really free yourself, I run a offline Llama2 70B with GGML 4bit to code. It works well for snippets and can do better than 3 tokens a second on a 12th gen i7/64GB and 16GBV 3080Ti. It can run at around 2 tokens a second on just the CPU, but you'll need a Linux machine with an additional 8GB swap partition just to initially load the model. It takes around 43GB to run after init.