logo
NOTICE:  This is the new PunchCAD forum. You should have received an email with your new password around August 27, 2014. If you did not, or would like it reset, simply use the Lost Password feature, and enter Answer as the security answer.
Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Options
Go to last post Go to first unread
ZeroLengthCurve  
#1 Posted : Saturday, March 29, 2025 3:03:40 PM(UTC)
ZeroLengthCurve

Rank: Senior Member

Joined: 5/15/2008(UTC)
Posts: 1,035

Thanks: 65 times
Was thanked: 83 time(s) in 52 post(s)
I'm pretty certain that most self-respecting individuals and firms will have reasons to recoil and withdraw from "cloud" (other people's servers" when it comes to research, design, and prototyping. I hope SharkCAD will always have offline options no less powerful than they'd be if the company gets dragged into online, real-time collaboration-enabling CAD.


"Build Bigger With Small Ai: Running Small Models Locally"

https://youtube.com/watch?v=P-55pV6ss3k&
thanks 1 user thanked ZeroLengthCurve for this useful post.
GARLIC on 3/30/2025(UTC)
ZeroLengthCurve  
#2 Posted : Saturday, March 29, 2025 3:08:43 PM(UTC)
ZeroLengthCurve

Rank: Senior Member

Joined: 5/15/2008(UTC)
Posts: 1,035

Thanks: 65 times
Was thanked: 83 time(s) in 52 post(s)
Local AI-assisted CAD without tokens could save designers a ton of money, reduce privacy risks, and allow for greater flexibility to change or swap out components.
thanks 1 user thanked ZeroLengthCurve for this useful post.
GARLIC on 3/30/2025(UTC)
MPSchmied  
#3 Posted : Sunday, March 30, 2025 4:12:05 AM(UTC)
MPSchmied

Rank: Guest

Joined: 4/9/2017(UTC)
Posts: 539
Man
Germany

Thanks: 299 times
Was thanked: 169 time(s) in 121 post(s)
Originally Posted by: ZeroLengthCurve Go to Quoted Post
I'm pretty certain that most self-respecting individuals and firms will have reasons to recoil and withdraw from "cloud" (other people's servers" when it comes to research, design, and prototyping. I hope SharkCAD will always have offline options no less powerful than they'd be if the company gets dragged into online, real-time collaboration-enabling CAD.


"Build Bigger With Small Ai: Running Small Models Locally"

https://youtube.com/watch?v=P-55pV6ss3k&


I don't believe that locally run, scaled-down large language models can create good CAD models. They fail at the simplest tasks. ChatGPT without analysis tools is unusable, and the newer models from OpenAI like o3mini high require a lot of energy, and I don't think they can be run locally.
OS: Windows 10 | CPU: AMD Ryzen 7 2700 | RAM: 32 GB | Graphic: AMD Radeon RX Vega 56 | SharkCAD 15 Pro | Unit: mm
thanks 1 user thanked MPSchmied for this useful post.
ZeroLengthCurve on 3/30/2025(UTC)
ZeroLengthCurve  
#4 Posted : Sunday, March 30, 2025 5:05:08 PM(UTC)
ZeroLengthCurve

Rank: Senior Member

Joined: 5/15/2008(UTC)
Posts: 1,035

Thanks: 65 times
Was thanked: 83 time(s) in 52 post(s)
Hi MPScmhmied,

Thanks for replying.

Regarding the cost of the ChatGPT/OpenAI/others pricing for the queries, could the high costs be due to all those tokens crawling and trawling all over the planet (and possibly causing tokens expensiveness to rise with repeated, incessant "break-in attempts" because the AI's just gotta get that data, no matter what), where the AI is (behind the scenes) being (in some cases) told to doubly and even triply check sources, driving cost even higher?

As for scaled-down locally-run LLMs not running efficiently or truthfully/factually and reliably, could that deficiency be reduced by a CAD company ensuring materials sciences, FEA, FEM, CFD, strip theory, etc are added to the local AI as a sort of judge, jury, and 3rd-party tester?

To partly answer my own question, I suppose a local user could study some A/B or A/B/C/D alternatives, then continuously make the local LLM do reasonableness and sanity checks and then sign, seal, and authenticate the results with external auditors. (Maybe, maybe, insurance companies could help curb the mad gold rush toward wasteful energy burn by compelling AI/GPT companies to lay high premiums as a hedge against sloppy data interpretation and presentation? Basically, enhanced, compulsory E&O insurance. I imagine the insurance companies feeling left out of the info gold rush party.)
thanks 1 user thanked ZeroLengthCurve for this useful post.
GARLIC on 3/31/2025(UTC)
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.