More accurately:
>looks inside
>matrix multiplicationMax(input*weights, 0) is an if in a sense, I guess.
Good old ReLU. I’ve heard that CNN’s perform better when using ReLU as the activation func, and that’s probably why; ReLU acts as a filter on the image’s features.
Nah. Without a nonlinearity you just get a linear combination of inputs instead of the output of a deep neural network. ReLU or Ramp is just the simplest possible non linearity. Using a simple function can enable using deeper networks yielding even better performance.
It’s actually somewhat of a headache, numerically. Works well enough tho.
Yes, it is inherently incorrect, I just think that increases the fun factor. It reminds me of that guy who wrote a prime-checker for his thesis and it was just a massive list of if-statement
98% accurate prime checker, super fast
isPrime() return False;
That was old AI.
New AI uses a complex, multi-layer sequence of Magic 8-balls.
That’s a common misconception. It is a complex multi-layer sequence of heavily biased Magic 8-balls.
With a post-it note saying “be polite, don’t hallucinate”
“Mirror mirror on the wall please fix my awful code, make no mistakes”
I would be heavily more inclined to use LLMs (and also probably use it in a more correct manner) if it came in the physical form of a magic 8-ball that I would violently shake to get the answer.
You don’t have to be an AI developer to not understand your code. I not understand my code every day.
-Agent
It’s just
y = k*x + ma few trillion times.Yes it’s not even for loop and if. Just multiplication and addition.
If statements are some of the largest sources of bugs in software.
I mean, without if statements and loops theres no logic? It would only be flat code, so i mean… Yeah?
All you need for Turing completeness is finite precision floating-point operations and an infinite loop.
Indeed! See: induction circuits
