Punch! CAD
»
ViaCAD & Shark
»
Punch Lounge
»
Ponder Small Models and CAD, snd keeping your data and results to yourself.
Rank: Senior Member
Joined: 5/15/2008(UTC) Posts: 1,035
Thanks: 65 times Was thanked: 83 time(s) in 52 post(s)
I'm pretty certain that most self-respecting individuals and firms will have reasons to recoil and withdraw from "cloud" (other people's servers" when it comes to research, design, and prototyping. I hope SharkCAD will always have offline options no less powerful than they'd be if the company gets dragged into online, real-time collaboration-enabling CAD.
"Build Bigger With Small Ai: Running Small Models Locally"
https://youtube.com/watch?v=P-55pV6ss3k&
1 user thanked ZeroLengthCurve for this useful post.
Rank: Senior Member
Joined: 5/15/2008(UTC) Posts: 1,035
Thanks: 65 times Was thanked: 83 time(s) in 52 post(s)
Local AI-assisted CAD without tokens could save designers a ton of money, reduce privacy risks, and allow for greater flexibility to change or swap out components.
1 user thanked ZeroLengthCurve for this useful post.
Rank: Guest
Joined: 4/9/2017(UTC)
Posts: 539
Thanks: 299 times Was thanked: 169 time(s) in 121 post(s)
Originally Posted by: ZeroLengthCurve I'm pretty certain that most self-respecting individuals and firms will have reasons to recoil and withdraw from "cloud" (other people's servers" when it comes to research, design, and prototyping. I hope SharkCAD will always have offline options no less powerful than they'd be if the company gets dragged into online, real-time collaboration-enabling CAD.
"Build Bigger With Small Ai: Running Small Models Locally"
https://youtube.com/watch?v=P-55pV6ss3k& I don't believe that locally run, scaled-down large language models can create good CAD models. They fail at the simplest tasks. ChatGPT without analysis tools is unusable, and the newer models from OpenAI like o3mini high require a lot of energy, and I don't think they can be run locally.
OS: Windows 10 | CPU: AMD Ryzen 7 2700 | RAM: 32 GB | Graphic: AMD Radeon RX Vega 56 | SharkCAD 15 Pro | Unit: mm
1 user thanked MPSchmied for this useful post.
Rank: Senior Member
Joined: 5/15/2008(UTC) Posts: 1,035
Thanks: 65 times Was thanked: 83 time(s) in 52 post(s)
Hi MPScmhmied, Thanks for replying. Regarding the cost of the ChatGPT/OpenAI/others pricing for the queries, could the high costs be due to all those tokens crawling and trawling all over the planet (and possibly causing tokens expensiveness to rise with repeated, incessant "break-in attempts" because the AI's just gotta get that data, no matter what), where the AI is (behind the scenes) being (in some cases) told to doubly and even triply check sources, driving cost even higher? As for scaled-down locally-run LLMs not running efficiently or truthfully/factually and reliably, could that deficiency be reduced by a CAD company ensuring materials sciences, FEA, FEM, CFD, strip theory, etc are added to the local AI as a sort of judge, jury, and 3rd-party tester? To partly answer my own question, I suppose a local user could study some A/B or A/B/C/D alternatives, then continuously make the local LLM do reasonableness and sanity checks and then sign, seal, and authenticate the results with external auditors. (Maybe, maybe, insurance companies could help curb the mad gold rush toward wasteful energy burn by compelling AI/GPT companies to lay high premiums as a hedge against sloppy data interpretation and presentation? Basically, enhanced, compulsory E&O insurance. I imagine the insurance companies feeling left out of the info gold rush party.)
1 user thanked ZeroLengthCurve for this useful post.
Punch! CAD
»
ViaCAD & Shark
»
Punch Lounge
»
Ponder Small Models and CAD, snd keeping your data and results to yourself.
Forum Jump
Punch! CAD
ViaCAD & Shark
- News and Announcements
- General
- 2D Drafting
- Surface Modeling
- Solid Modeling
- Subdivision Modeling
- Rendering & Display
- Import/Export
- Tips and Tutorials
- Suggestions
- Gallery
- PowerPack
- Punch Lounge
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.