Artificial intelligence for partial differential equations in computational mechanics: A review

์ €์ž: Yizheng Wang, Jinshuai Bai, Zhongya Lin, Qimin Wang, C. Anitescu, Jia Sun, M. Eshaghi, YuanTong Gu, Xi-Qiao Feng, X. Zhuang, T. Rabczuk, Yinghua Liu | ๋‚ ์งœ: 2024 | URL: https://arxiv.org/abs/2410.19843 📄 PDF


Essence

Figure 1

Fig. 1. The role of AI4PDEs in AI4Science, along with an introduction to AI4PDEs in computational mechanics, including s

๋ณธ ๋…ผ๋ฌธ์€ ๊ณ„์‚ฐ์—ญํ•™ ๋ถ„์•ผ์—์„œ ํŽธ๋ฏธ๋ถ„๋ฐฉ์ •์‹(PDE)์„ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•œ ์ธ๊ณต์ง€๋Šฅ ์•Œ๊ณ ๋ฆฌ์ฆ˜์˜ ํ˜„ํ™ฉ์„ ์ข…ํ•ฉ์ ์œผ๋กœ ๊ฒ€ํ† ํ•œ ๋ฆฌ๋ทฐ ๋…ผ๋ฌธ์ด๋‹ค. Physics-Informed Neural Networks(PINNs), Deep Energy Methods(DEM), Operator Learning, Physics-Informed Neural Operator(PINO)๋ฅผ ํฌํ•จํ•œ AI4PDEs์˜ ์ฃผ์š” ๋ฐฉ๋ฒ•๋ก ์„ ์ •๋ฆฌํ•˜๊ณ , ๊ณ ์ฒด์—ญํ•™, ์œ ์ฒด์—ญํ•™, ์ƒ์ฒด์—ญํ•™ ๋ถ„์•ผ์˜ ์‘์šฉ์„ ์ฒด๊ณ„์ ์œผ๋กœ ๋ถ„๋ฅ˜ํ•˜์—ฌ ์ œ์‹œํ•œ๋‹ค.

Motivation

Achievement

Figure 1

Fig. 1. The role of AI4PDEs in AI4Science, along with an introduction to AI4PDEs in computational mechanics, including s

์ฃผ์š” ์„ฑ๊ณผ ๋ชฉ๋ก:\n- AI4PDEs์˜ ์„ธ ๊ฐ€์ง€ ์ฃผ์š” ํŒจ๋Ÿฌ๋‹ค์ž„(PINNs, Operator Learning, PINO) ๋ฐ ๊ธฐ์ดˆ ์ด๋ก  ์ •๋ฆฌ\n- ๊ณ„์‚ฐ์—ญํ•™ ์‚ผ๋Œ€ ๋ถ„์•ผ์— ๊ฑธ์นœ 400๊ฑด ์ด์ƒ์˜ ์‘์šฉ ์‚ฌ๋ก€ ์ฒด๊ณ„์  ๋ถ„๋ฅ˜\n- ๋ฌผ๋ฆฌ ์ •๋ณด ๊ธฐ๋ฐ˜ ์‹ ๊ฒฝ๋ง์˜ ๋ฐ์ดํ„ฐ ํšจ์œจ์„ฑ ๋ฐ ํ•ด์„๊ฐ€๋Šฅ์„ฑ ๊ฐœ์„  ๋ฉ”์ปค๋‹ˆ์ฆ˜ ๋ช…ํ™•ํ™”\n- Surrogate model๊ณผ operator learning์˜ ์žฅ๋‹จ์ ์„ ๊ฐ•ํ™”-์•ฝํ™” ๋งค๊ฐœ๋ณ€์ˆ˜ ์ธก๋ฉด์—์„œ ๋น„๊ต ๋ถ„์„\n- Foundation model๊ณผ hybrid numerical solver๋กœ์˜ ๋ฏธ๋ž˜ ๋ฐฉํ–ฅ ์ œ์‹œ

How

Figure 3

Fig. 3. AI for PDEs method: Schematic of PINNs strong form [2].

Originality

Limitation & Further Study

ํ•œ๊ณ„ ๋ฐ ํ›„์† ์—ฐ๊ตฌ:\n- ํ˜„์žฌ AI4PDEs๋Š” ์ฃผ๋กœ ์ •๋ฐฉํ–ฅ ๋ฌธ์ œ ํ•ด๊ฒฐ ๋ฐ ์ œํ•œ๋œ ์—ญ๋ฐฉํ–ฅ ๋ฌธ์ œ์—๋งŒ ์„ฑ์ˆ™, ๋ฏธ์ง€ ๋ฌผ๋ฆฌ ๋ฒ•์น™ ๋ฐœ๊ฒฌ(scientific discovery) ์ธก๋ฉด์€ ๋ฏธ์„ฑ์ˆ™\n- ๋ฐ์ดํ„ฐ ๋ถ€์กฑ, ๋…ธ์ด์ฆˆ ์ฒ˜๋ฆฌ, ๋น„์‹๋ณ„์„ฑ ๋ฌธ์ œ๋กœ ์ธํ•ด ์‹ค๋ฌด ์‘์šฉ์—์„œ ์•„์ง ํ•œ๊ณ„\n- ํ•™์Šต๋œ ๋ชจ๋ธ์˜ ์„œ๋กœ ๋‹ค๋ฅธ ๊ธฐํ•˜ํ•™, ์žฌ๋ฃŒ, ๋ฌผ๋ฆฌ ๊ณผ์ •์— ๋Œ€ํ•œ ์ผ๋ฐ˜ํ™” ๋Šฅ๋ ฅ ๋ถ€์กฑ\n- ์‹ ๋ขฐ์„ฑ, ์ˆ˜๋ ด์„ฑ ์ด๋ก ์ด ๋ถˆ์™„์ „ํ•˜์—ฌ ์•ˆ์ „์ด ์ค‘์š”ํ•œ ๊ณตํ•™ ์‘์šฉ์— ์ œ์•ฝ\n- Operator learning์˜ ๊ณ ์ฐจ์› ๋ฌธ์ œ(curse of dimensionality) ํ™•์žฅ์„ฑ ๋ฏธํก\n- Foundation model ๊ธฐ๋ฐ˜ scientific computing์€ ๊ฐœ๋… ๋‹จ๊ณ„๋กœ ์‹ค์ œ ๊ตฌํ˜„ ๊ฒฝํ—˜ ๋ถ€์กฑ

Evaluation

Novelty: 3/5 Technical Soundness: 4/5 Significance: 4/5 Clarity: 4/5 Overall: 4/5

์ดํ‰: ๋ณธ ๋…ผ๋ฌธ์€ AI4PDEs ๋ถ„์•ผ์˜ ํ˜„ํ™ฉ์„ ๊ณ„์‚ฐ์—ญํ•™ ๋งฅ๋ฝ์—์„œ ๊ฐ€์žฅ ํฌ๊ด„์ ์œผ๋กœ ์ •๋ฆฌํ•œ ๊ณ ํ’ˆ์งˆ ๋ฆฌ๋ทฐ์ด๋‹ค. ๋ฌผ๋ฆฌ ์ •๋ณด ๊ธฐ๋ฐ˜ ์‹ ๊ฒฝ๋ง์˜ ํ•ต์‹ฌ ๊ฐ€์น˜๋ฅผ ๋ช…ํ™•ํžˆ ์ œ์‹œํ•˜๊ณ , ์„ธ ๋Œ€ ๋ถ„์•ผ์— ๊ฑธ์นœ ์‘์šฉ์„ ์ฒด๊ณ„์ ์œผ๋กœ ๋ถ„๋ฅ˜ํ•˜๋ฉฐ, ๋ฏธ๋ž˜ ๋ฐฉํ–ฅ์„ ๊ท ํ˜•์žก๊ฒŒ ์ œ์‹œํ•œ๋‹ค. ๋‹ค๋งŒ ์ด๋ก ์  ๋ถ„์„(์ˆ˜๋ ด์„ฑ, ๊ทผ์‚ฌ ์˜ค์ฐจ)์˜ ์‹ฌํ™”, ์‹ค์ œ ๊ณ ์ฐจ์› ๋ฌธ์ œ์˜ ์„ฑ๊ณต ์‚ฌ๋ก€ ํ™•์ถฉ, ์‹ ๋ขฐ์„ฑ ํ‰๊ฐ€ ๋ฐฉ๋ฒ•๋ก ์˜ ์ œ์‹œ๊ฐ€ ์ถ”๊ฐ€๋˜๋ฉด ๋”์šฑ ๊ฐ•๋ ฅํ•œ ๊ธฐ์—ฌ๊ฐ€ ๋  ๊ฒƒ์ด๋‹ค.

๊ฐ™์ด ๋ณด๋ฉด ์ข‹์€ ๋…ผ๋ฌธ

๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
PDE์—์„œ AI ๋ฐฉ๋ฒ•๋ก ์˜ ์ „๋ฐ˜์  ์—ญํ• ์„ ๋‹ค๋ฃจ๋Š” ์„œ๋ฒ ์ด๋กœ, PINNs์˜ ์œ„์น˜์™€ ์˜๋ฏธ๋ฅผ ๋” ๋„“์€ ๋งฅ๋ฝ์—์„œ ์ดํ•ดํ•˜๋Š” ๋ฐ ๊ธฐ๋ฐ˜์„ ์ œ๊ณตํ•œ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
3374 ๋…ผ๋ฌธ์€ ๋ถ€๋ถ„ ๋ฏธ๋ถ„๋ฐฉ์ •์‹ ๊ธฐ๋ฐ˜ ํ™˜๊ฒฝ์—์„œ AI ์ ์šฉ์˜ ์ด๋ก ์  ํ† ๋Œ€๋ฅผ ์ œ๊ณตํ•˜์—ฌ, FuXi์™€ ๊ฐ™์€ ์˜ˆ๋ณด ์‹œ์Šคํ…œ ๊ฐœ๋ฐœ์˜ ๊ธฐ์ดˆ๋ฅผ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
Physics-Informed Neural Networks and Extensions ๋…ผ๋ฌธ์€ PINN, PINO ๋“ฑ ๊ณ„์‚ฐ์—ญํ•™ PDE ์†”๋ฒ„์˜ ๊ธฐ์ˆ ์  ์š”์†Œ์™€ ์—ฐ๊ตฌ ํ๋ฆ„์„ ์ข…ํ•ฉ์ ์œผ๋กœ ์ œ๊ณตํ•œ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
3374 ๋…ผ๋ฌธ์ด ํฌ๊ด„์  ๋ฆฌ๋ทฐ๋ฅผ ์ œ๊ณตํ•œ๋‹ค๋ฉด 364 ๋…ผ๋ฌธ์€ ํ•ต์‹ฌ neural operator ๊ฑด์ถ•๊ณผ ์‹ค์ œ ์ ์šฉ, ๊ทธ๋ฆฌ๊ณ  ๋ฒ ์ด์ง€์•ˆ ์—ญ๋ฌธ์ œ ๋“ฑ ์‹ค๋ฌด ํ™œ์šฉ ์˜ˆ์‹œ๋ฅผ ๊ฐ•ํ™”ํ•ฉ๋‹ˆ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
Neural Operator์˜ ์„ค๊ณ„์™€ ์„ฑ๋Šฅ์„ ๊ตฌ์กฐ์ ์œผ๋กœ ๋ถ„์„ํ•˜๋ฉฐ 3374๊ฐ€ ๋ฆฌ๋ทฐํ•˜๋Š” Operator Learning์˜ ์ด๋ก ์  ๋ฐฐ๊ฒฝ์„ ์ œ๊ณตํ•œ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
๊ธฐ๊ณ„ํ•™์Šต์„ ํ†ตํ•œ ๋ฏธ๋ถ„๋ฐฉ์ •์‹ ๋ฐ ์–‘์ž๊ณ„ ํ•ด๊ฒฐ์˜ ์ด๋ก ์  ๋ฐฐ๊ฒฝ์ด ๋ฉ๋‹ˆ๋‹ค.
๊ธฐ๋ฐ˜ ์—ฐ๊ตฌ
AI for PDEs ์ตœ์‹  ์„œ๋ฒ ์ด๋Š” ์‹ ๊ฒฝ๋ง ๊ธฐ๋ฐ˜ ์–‘์žยทPDE ๋ฌธ์ œํ•ด๊ฒฐ(์˜ˆ: NQS ๋“ฑ)์˜ ๊ธฐ๋ฐ˜์„ ์ œ๊ณตํ•ด ๋ณธ ๋…ผ๋ฌธ ๋ชจ๋ธ์˜ ์ด๋ก ์  ์ •๋‹น์„ฑ์„ ์„ค๋ช…ํ•œ๋‹ค.
๋‹ค๋ฅธ ์ ‘๊ทผ
Piflow๋Š” ๋‹ค์ค‘ ์—์ด์ „ํŠธ ๊ณผํ•™์  ๋ฐฉ์ •์‹ ๋ฐœ๊ฒฌ ํŒŒ์ดํ”„๋ผ์ธ์„ ์ œ๊ณตํ•˜๋ฉฐ PDE ๋ฌธ์ œ ํ•ด๊ฒฐ์— ๋Œ€ํ•œ ๋Œ€์•ˆ์  AI ํŒจ๋Ÿฌ๋‹ค์ž„์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค.
๋‹ค๋ฅธ ์ ‘๊ทผ
Lang-PINN ๋…ผ๋ฌธ์€ ์ž์—ฐ์–ด โ‡” ๋ฌผ๋ฆฌ ์ œ์•ฝ ์‹ ๊ฒฝ๋ง(PINN) ์ง์ ‘ ์—ฐ๋™ ๊ธฐ๋ฒ•์„ ์†Œ๊ฐœํ•˜์—ฌ ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ๋ฐ˜ PDE ํ•ด๋ฒ•์˜ ๋‹ค์–‘ํ•œ ๊ตฌํ˜„ ๋ฐฉ๋ฒ•์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค.
๋‹ค๋ฅธ ์ ‘๊ทผ
PDE ๋ฌธ์ œ์— AI๋ฅผ ์ ์šฉํ•œ ์ตœ์ฒจ๋‹จ ๋ฐฉ๋ฒ•์„ ์ „๋ฐ˜์ ์œผ๋กœ ๋‹ค๋ฃจ๋Š” ๋…ผ๋ฌธ์œผ๋กœ AutoNumerics์˜ ์‹ ๊ฒฝ๋ง ๋Œ€์•ˆ์„ฑยท์ž๋™ํ™” ๋ฐฉ์‹๊ณผ ๋น„๊ตํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
ํ›„์† ์—ฐ๊ตฌ
364 ๋…ผ๋ฌธ์€ Neural Operator์˜ ์‹ค์šฉ์  ๊ตฌํ˜„ ๋ฐ ๋น„๊ต ๋ถ„์„์„ ์ค‘์ ์ ์œผ๋กœ ๋‹ค๋ฃจ์–ด, 3374 ๋…ผ๋ฌธ์˜ ์ข…ํ•ฉ ๋ฆฌ๋ทฐ๋ฅผ ์‹ค์ œ ์ ์šฉ ์˜ˆ์‹œ๋กœ ๋ณด์™„ํ•ฉ๋‹ˆ๋‹ค.
ํ›„์† ์—ฐ๊ตฌ
Neural Operator ๊ธฐ๋ฐ˜์˜ ์‹ค์ œ ์ธ๋ฒ„์Šค ๋ฌผ๋ฆฌ ๋ฌธ์ œ ์ ์šฉ ์‚ฌ๋ก€๋กœ, 3374์˜ ๋ฆฌ๋ทฐ์— ๊ธฐ๋ฐ˜ํ•œ ์‹ค์งˆ์  ํ™•์žฅ ์‚ฌ๋ก€๋‹ค.
ํ›„์† ์—ฐ๊ตฌ
์ธ๊ณต์ง€๋Šฅ์œผ๋กœ PDE ํ•ด์„ ๋ฐ ํ•ด์˜ ์•ˆ์ •์„ฑ ๋ณด์žฅ ๋ฌธ์ œ๋ฅผ ๋ฒ”์šฉ์ ์œผ๋กœ ๋‹ค๋ฃจ๋Š” ์„œ๋ฒ ์ด๋กœ, ๋ณธ ๋…ผ๋ฌธ์˜ ๋Œ€์นญํ™” ๋ฐฉ๋ฒ•์„ ๋”์šฑ ํ™•์žฅํ•ฉ๋‹ˆ๋‹ค.
์‘์šฉ ์‚ฌ๋ก€
๋ณธ ๋…ผ๋ฌธ์ด ๋‹ค๋ฃจ๋Š” PDE AI ์ตœ์‹  ๋™ํ–ฅ์ด ํ™˜๊ฒฝ๊ณผํ•™ ๋“ฑ ์‹ค์„ธ๊ณ„ ๋ฌธ์ œ์— ์‘์šฉ๋˜๋Š” ์‚ฌ๋ก€๋“ค์„ 342์—์„œ ๊ตฌ์ฒด์ ์œผ๋กœ ์‚ดํŽด๋ณผ ์ˆ˜ ์žˆ๋‹ค.
๋ฐ˜๋ก /๋น„ํŒ
๋”ฅ๋Ÿฌ๋‹ ๊ธฐ๋ฐ˜ PDE ํ•ด๋ฒ•์—์„œ ๋ฌผ๋ฆฌ ๋‚ด์žฌํ™” ๋ฐ neural operator ์ ์šฉ์˜ ๊ฐ€๋Šฅ์„ฑ๊ณผ ํ•œ๊ณ„, ์ƒ์„ฑ์  ํ™œ์šฉ์— ๋Œ€ํ•ด ๋น„ํŒ์ ์œผ๋กœ ์กฐ๋งํ•ฉ๋‹ˆ๋‹ค.
← ๋ชฉ๋ก์œผ๋กœ ๋Œ์•„๊ฐ€๊ธฐ

๐ŸŽง Audio Overview

์ด ๋…ผ๋ฌธ ๋ฆฌ๋ทฐ๋ฅผ ํŒŸ์บ์ŠคํŠธํ˜• ์˜ค๋””์˜ค๋กœ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. (Gemini ยท ํ‚ค๋Š” ๋ธŒ๋ผ์šฐ์ €์—๋งŒ ์ €์žฅ ยท ์™„์„ฑ๋ณธ์€ ์ด๋ฉ”์ผ๋กœ๋„ ์ „์†ก)
โ–ธ ๊ณ ๊ธ‰: ๊ตฌ์„ฑ ๋ฐฉํ–ฅ(๋Œ€๋ณธ ์ž‘์„ฑ ์ง€์นจ) ์ง์ ‘ ์ˆ˜์ •