Skip to content

Latest commit

 

History

History
289 lines (207 loc) · 9.07 KB

File metadata and controls

289 lines (207 loc) · 9.07 KB

🌊 Physics-Informed Neural Networks for Solving Partial Differential Equations

PINN Project TensorFlow Python GPU

🔬 Advanced Scientific Computing with Deep Learning

B.Tech Final Year Project - Information Technology

Siddhant Manna | Meghnad Saha Institute of Technology | 2025


📋 Project Overview

This comprehensive research project explores the revolutionary application of Physics-Informed Neural Networks (PINNs) for solving complex partial differential equations (PDEs). Unlike traditional numerical methods, PINNs embed physical laws directly into neural network architectures, creating a powerful framework that bridges deep learning and computational physics.

🎯 Objectives

  • Develop PINN frameworks for multiple PDE types
  • Achieve high accuracy with minimal training data
  • Demonstrate superiority over traditional numerical methods
  • Explore advanced techniques like curriculum learning and Fourier embeddings

📊 Research Statistics

Metric Value Metric Value
📝 Report Pages 60+ 🧠 PDEs Solved 3
💻 Training Time 9 min 3 sec 📚 References 13+
🎯 Best L2 Error 6.8×10⁻⁴ 🔧 GPU Used NVIDIA T4
Max Iterations 150,000 📈 Convergence Achieved

🔬 Solved Equations

1. Burgers' Equation

$$∂u/∂t + u∂u/∂x = ν∂²u/∂x²$$
  • Application: Fluid dynamics, shock wave modeling
  • Achievement: L2 error of 6.8×10⁻⁴
  • Training Time: 9 minutes on NVIDIA T4

2. Allen-Cahn Equation

$$∂u/∂t = ε²∇²u + u(1-u²)$$
  • Application: Phase separation, material science
  • Key Feature: Multi-component alloy modeling
  • Enhancement: Curriculum learning integration

3. Time-Dependent Eikonal Equation

$$∂S/∂t + |∇S| = 1$$
  • Application: Wave propagation, optimal path planning
  • Innovation: Backward time integration
  • Performance: Superior to fast-sweeping methods

🎨 Research Visualizations

📍 Collocation Points Distribution

Collocation Points Figure 1: Distribution of 10,000 collocation points, 50 initial conditions, and 50 boundary points for PINN training

📉 Training Loss Convergence

Loss Convergence Figure 2: PINN training loss convergence over 5,000 epochs with piecewise learning rate decay, achieving L2 error of 6.8×10⁻⁴

🌊 3D Burgers Solution Surface

3D Solution Figure 3: 3D visualization of Burgers equation solution showing shock formation at t=0.4 and temporal evolution

⚖️ Comparative Analysis: Traditional vs PINN

Comparison Figure 4: Side-by-side comparison demonstrating PINN advantages over traditional numerical methods


🏗️ Architecture & Methodology

🧠 Network Architecture

  • Hidden Layers: 8-9 layers with 20 neurons each
  • Activation: Hyperbolic tangent (tanh)
  • Normalization: Input scaling to [-1,1]
  • Boundary Encoding: Strict Dirichlet condition adherence

⚡ Advanced Techniques

Curriculum Learning

  • Progressive parameter complexity increase
  • Stage-wise training approach
  • Enhanced stability for complex PDEs

Causal Training

  • Time-dependent accuracy enforcement
  • Temporal causality preservation
  • Improved generalization over time

Fourier Feature Embedding (FFE)

  • Spatial periodicity encoding
  • Dramatic error reduction (2+ orders of magnitude)
  • Enhanced spatial accuracy

📈 Experimental Results

🎯 Performance Achievements

Equation Method L2 Error Training Time
Burgers PINN 6.8×10⁻⁴ 9 min 3 sec
Allen-Cahn PINN+FFE Significantly reduced -
Eikonal PINN+Causal Superior accuracy 150k iterations

📊 Comparative Analysis

  • PINNs vs Traditional: Higher accuracy with less computational resources
  • FFE Enhancement: 2+ orders of magnitude error reduction
  • Causal Training: Consistent convergence advantages
  • GPU Acceleration: Optimal performance on NVIDIA T4

🛠️ Technical Implementation

Hardware Setup

  • GPU: NVIDIA T4 Tensor Core
  • Platform: Google Colab
  • Precision: Float32 optimization
  • Memory: Optimized for large-scale problems

Software Stack

tensorflow >= 2.x      # Deep learning framework
numpy                  # Numerical computations
matplotlib             # Visualization
scipy                  # Scientific computing

Key Algorithms

  • Automatic Differentiation: TensorFlow GradientTape
  • Optimization: Adam with adaptive learning rates
  • Loss Functions: Multi-component physics-informed loss
  • Sampling: Uniform and adaptive collocation strategies

📚 Research Contributions

🔬 Theoretical Advances

  • Novel PINN formulations for time-dependent PDEs
  • Integration of curriculum learning with physics constraints
  • Causal training methodology for temporal problems
  • FFE enhancement for periodic boundary conditions

💻 Practical Implementations

  • Efficient GPU-accelerated training pipelines
  • Boundary-encoded output layers
  • Multi-stage training protocols
  • Comprehensive error analysis frameworks

📊 Experimental Validation

  • Rigorous comparison with analytical solutions
  • Performance benchmarking against traditional methods
  • Scalability analysis across different problem sizes
  • Robustness testing under various conditions

🚀 Applications & Impact

🏭 Industrial Applications

  • Fluid Dynamics: Turbulence modeling, flow optimization
  • Materials Science: Alloy design, phase prediction
  • Geophysics: Seismic wave propagation, exploration
  • Robotics: Path planning, navigation systems

🎓 Educational Value

  • Graduate Research: Advanced numerical methods
  • Computational Physics: Modern simulation techniques
  • Machine Learning: Physics-informed AI development
  • Engineering: Real-world problem solving

🔮 Future Directions

🚧 Planned Enhancements

  • Multi-GPU Training: Distributed computing support
  • 3D Extensions: Complex geometry handling
  • Real-time Inference: Optimized deployment
  • Uncertainty Quantification: Bayesian extensions
  • Hybrid Methods: Classical-neural combinations

🌟 Research Opportunities

  • Anisotropic Media: Complex material properties
  • Multi-Physics Coupling: Interdisciplinary problems
  • Inverse Problems: Parameter identification
  • Transfer Learning: Cross-domain applications

📄 Academic Details

🎓 Project Information

  • Title: Solution of Partial Differential Equations Using Physics Informed Neural Network
  • Author: Siddhant Manna (Roll: 14200222065, Reg: 221420120620)
  • Supervisor: Assistant Professor Indrajit Das
  • Institution: Meghnad Saha Institute of Technology
  • Department: Information Technology
  • Year: 2025

📚 Key References

  • Raissi et al. (2019): Foundational PINN methodology
  • Karniadakis et al. (2021): Physics-informed machine learning
  • Multiple domain-specific applications and enhancements

🏆 Achievements

  • ✅ High Accuracy: L2 error of 6.8×10⁻⁴ for Burgers equation
  • ✅ Computational Efficiency: 9-minute training on single GPU
  • ✅ Novel Techniques: FFE, curriculum learning, causal training
  • ✅ Comprehensive Validation: Multiple PDE types solved
  • ✅ Research Impact: Advancing scientific computing methods

🚀 Quick Start

Prerequisites

pip install tensorflow numpy matplotlib scipy

Usage

# Clone the repository
git clone <repository-url>
cd pinn-pde-solver

# Run the main PINN implementation
python Physics-Informed-Neural-Network.py

# Visualize results
python visualize_results.py

📞 Contact & Collaboration

For research collaboration, technical discussions, or project inquiries:

LinkedIn


⭐ If this research contributes to your work, please consider citing! ⭐

Made with ❤️ for Science

Advancing the frontiers of computational physics through deep learning 🚀