Ben Affleck 谈 VFX 老本行：从卷积神经网络时代就"写很烂的 Python 脚本"——机器学习中早就进了电影工业
Quoting Ben Affleck
评分 30
导读
Simon Willison 引用片段(Ben Affleck)：他自述从小喜欢电脑，电影从胶片转数字后更关注技术层面；"视觉特效工作流很多年里一直包含机器学习"——他笑称自己能写"相当烂的 Python 脚本"，因为在卷积神经网络(Transformer 的前身、能同时做更多计算)时代就要看 tensor(把视觉图像转成数字：batch number、frame number 等)。属演员/导演视角的"ML 早已在片场"引语。
主体与标签
#大佬观点#编码#多模态#图像生成#数据/训练
正文
I've always been kind of into computers since I was young. And then when film started to move from analog film to digital, I became more interested in that aspect of it. And the visual effects workflow for many years has included machine learning. So I can write like pretty shitty Python scripts and stuff like that because with convolutional neural networks, which were the sort of precursors to what the transformer can do, which is just much more computation simultaneously, you would do things like look at what's called a tensor, which is just the numerical translation of a visual image in numbers — like the batch number, the frame number, the red, green, and blue values of each pixel in each frame. And a tensor, you use a convolutional neural network to identify patterns in that that would reveal what's called edge detection or feature extraction, which is just identifying patterns enough to know like this is where the window ledge is, so we can more easily take the green screen image out and replace it with something.
— Ben Affleck , Pythonista
Tags: machine-learning , python