Intel® releases a new Extension for PyTorch* that aims to optimise deep learning for Intel® CPUs
Intel engineers in the PyTorch open-source community have created a new Intel® Extension for PyTorch*, which they claimed maximises deep learning inference and training performance on Intel CPUs. Fan Zhao, engineering manager at Intel, shared in a post that Intel® Extension for PyTorch*optimises for both imperative mode and graph mode. The optimisations are performed for three key pillars of PyTorch – operators, graph and runtime. The Intel engineers in the PyTorch open-source community have created an new Intel® Extension for PyTorch* which maximizes deep learning inference and training performance on Intel CPUs. Get the extension to make use of these features today:@fanzhao_intel https://t.co/RMtyhRHeDE— PyTorch (@PyTorch) May 16, 2022 She said in the same post that during execution, Intel® Extension for PyTorch* will override a subset of ATen operators with their optimised counterparts in the extension. It will offer an additional set of custom operators and optimisers for popular use cases. In graph mode, additional graph optimisation passes will be applied that will maximise the performance of the underlying kernel implementations in the extension. “Runtime optimisations are encapsulated in the runtime extension module, which provides a couple of PyTorch frontend APIs for users to get finer-grained control of the thread runtime,” she added. Image: Accelerating PyTorch with Intel® Extension for PyTorch* | by Fan Zhao | PyTorch | May, 2022 | Medium Performance The blog gave some examples of performance gains with Intel® Extension for PyTorch*. The numbers were measured on Intel(R) Xeon(R) Platinum 8380 CPU @ 2.3 GHz. Image: Accelerating PyTorch with Intel® Extension for PyTorch* | by Fan Zhao | PyTorch | May, 2022 | Medium In the future, the team behind this wants to bring users additional performance boost on Intel CPUs in an agile and fast fashion. Zhai added that the team would upstream most of the optimisations to stock PyTorch over time. They will also land new optimisations and features for the latest Intel hardware for users to get their hands on them faster. To know more, click here.
Intel® Extension for PyTorch* optimises for both imperative mode and graph mode.
Intel engineers in the PyTorch open-source community have created a new Intel® Extension for PyTorch*.
["Intel", "Open Source", "open source community", "Pytorch"]
["Pytorch", "API", "Open Source", "programming_languages:R", "AI", "PyTorch", "RPA", "Aim", "deep learning", "open source community", "ai_frameworks:PyTorch", "R", "Intel"]
["AI", "deep learning", "Aim", "PyTorch", "R", "API", "RPA", "ai_frameworks:PyTorch", "programming_languages:R"]
I am a technology journalist at AIM. What gets me excited is deep-diving into new-age technologies and analysing how they impact us for the greater good.

Reach me at sreejani.bhattacharyya@analyticsindiamag.com