Andrej Karpathy says

“The software engineering aspect of deep learning repos I've been watching closely is how they store, catalogue, override, manage and plumb hyperparameter configs. Have come to dislike argparse, YAMLs (too inflexible), and fully enumerated kwargs on classes/defs.”

—Andrej Karpathy

This quote is part of:

Quotes about AI Engineering Quotes

More on this...

“Mark my words, AI is far more dangerous than nukes… Why do we have no regulatory oversight?”

“Every person in your company is a vector. Your progress is determined by the sum of all vectors.”

“Constantly think about how you could be doing things better.”

“I think AI is something that is risky at the civilization level, not merely at the individual risk level, and that's why it really demands a lot of safety research.”

“One of the biggest mistakes we made was trying to automate things that are super easy for a person to do, but super hard for a robot to do.”

“It’s not as though I think the risk is that A.I. will develop a will of its own right off the bat, the concern is more that someone may use it in a way that is bad. Or even if they weren’t going to use it in a way that's bad, that someone could take it from them and use it in a way that’s bad. That I think is quite a big danger. So I think we must have democratization of A.I. technology and make it widely available. And that’s obviously the reason that you [Sam Altman], me, and the rest of the team created OpenAI - was to help spread out A.I. technologies so it doesn’t get concentrated in the hands of a few.”

“A rocket is a huge engineering compromise.”

“Like a rocket is just a giant engineering compromise, and you just have to choose where you're gonna eat the pain and you can choose it in propulsion. You can choose it in structures. You know, where is the bit that's gonna destroy your life?”

“I take the position that I'm always to some degree wrong, and the aspiration is to be less wrong.”

“I think having a high bandwidth interface to the brain [is extremely important], we are currently bandwidth limited. We have a digital tertiary self. In the form of our email, computers, phones, applications, we are effectively superhuman. But we are extremely bandwidth constrained in that interface between the cortex and that tertiary digital form of yourself, and helping solve that bandwidth constraint would be very important for the future as well.”

“Measuring programming progress by lines of code is like measuring aircraft building progress by weight.”

“I am not normally an advocate of regulation and oversight… I think one should generally err on the side of minimizing those things… but this is a case where you have a very serious danger to the public.”

“Persistence is very important. You should not give up unless you are forced to give up.”

“AI is a rare case where I think we need to be proactive in regulation than be reactive.”

“Archimedes is the boringest engine that we can build in a lot of sense.”