New Jersey Institute of TechnologyIS485 / CS485

After completing this course, you will be able to program your own artifical agents in virtual worlds. You will learn artifical intelligence approaches for virtual worlds, including image analysis, robot navigation, multi-agent simulation, path planning and more! And since everything runs on your local machine, you can show your work to your friends-how cool is that!


Example topics:

* Lecture Videos and Slides *

Syllabus:
PDF

Prerequisites:
Python, Javascript


Spring 2023
Wednesdays 06:00 PM - 08:50 PM
Face-to-Face


Asst. Prof. Tomer Weiss, PhD
tomerwei.github.io
GITC, 3420B

Office hours: TBD or email me






Class Schedule

Date Topic Notes
Jan-18 Introduction and Overview Assignment setup code
Introduction
Math Reminder
Assignment 1 Due Feb-01
Jan-25 Physics of Artificial Worlds Overview
Skeleton Code
Physics
Introduction to Animation
Feb-1 Position-based Dynamics I
Particle Systems
PBD
WIP PBD code
Feb-6 Assignment 2 Due Feb-16
Feb-8 Deep Reinforcment Learning for Artifical Worlds (Guest Speaker)
Feb-15 Position-based Dynamics II
Slides 1/2
Slides 2/2
Feb-22 AI Navigation WIP walls
Slides
WIP Path Planning
Spatial Hash Slides
March-01 Procedural Noise Slides
Code
Paper Presentations I
March-08 Presentation Focused Day Paper Presentations II
March-15 Break
March-22 Genetic Algorithms Slides
Paper Presentations III
March-29 Project Decision Day
Signed Distance Fields WIP Code
Slides
Apr-05 Image Processing
SDF Continued WIP Code
April-12 Advanced Image Processing Slides
April-20 Project Office hours
April-27 Project Presentations


Resources

Social-force for Crowd Simulation (Slides, PDF)
Position-based Dynamics (Slides, PDF)




Final Project

Submission Instructions, Project Approval


Presentation Topics


Artificial Environments
Style Compatibility for 3D Furniture Models ( Video, Project )
Color Compatibility From Large Datasets ( Video, Project )
Interactive Furniture Layout Using Interior Design Guidelines ( Short Video, Long Video, Paper )
Simulation, Modeling and Authoring of Glaciers( Video, Project )
Ecoclimates: Climate-Response Modeling of Vegetation( Video, Project )
Interactive simulation of plume and pyroclastic volcanic ejections ( Video, Project )
Fire in Paradise: Mesoscale Simulation of Wildfires( Video, Project )
Computer-Generated Residential Building Layouts ( Video, Paper )
Interactive Procedural Street Modeling( Video, Paper )
Sketch-based Dynamic Illustration of Fluid Systems( Project )
Sequential Line Search for Efficient Visual Design Optimization by Crowds( Project )
Parallel Generation of Architecture on the GPU( Video, Paper )
Hair Meshes ( Project )
Zoomorphic Design ( Project )

Animation
Physics Storyboards ( Project )
Wave Particles ( Project )
Particle Merging-and-Splitting ( Project )
Animating Human Dressing ( Project, Presentation )
Backward Steps in Rigid Body Simulation (Video, PDF)
Inverse-Foley Animation: Synchronizing rigid-body motions to sound (Video, PDF)
Motion-driven Concatenative Synthesis of Cloth Sounds (Video, Project)
Meshless Deformations Based on Shape Matching ( Video, Talk, Paper)
Air Meshes for Robust Collision Handling ( Video, Slides, Paper )
XPBD: Position-Based Simulation of Compliant Constrained Dynamics ( Video, Paper )
Robust Motion In-betweening ( Video, Paper )
PRECISION: Precomputing Environment Semantics for Contact-Rich Character Animation ( Paper, Video, Presentation )

Agent AI
Autonomous Pedestrians (Video, PDF)
Modeling and Animating Myriapoda: A Real-Time Kinematic/Dynamic Approach (Video, PDF)
Door and Doorway Etiquette for Virtual Humans (Video, PDF)
Character navigation in dynamic environments based on optical flow (Video, PDF)
Sound Localization and Multi-Modal Steering for Autonomous Virtual Agents (Video, PDF)
Generating a multiplicity of policies for agent steering in crowd simulation (Video, PDF)
Unified Motion Planner for Fishes with Various Swimming Styles ( Paper, Video, Project )
Simulating Biped Behaviors from Human Motion Data ( Video, Paper )
OIL: Observational Imitation Learning( Video, Project )
Dynamic Terrain Traversal Skills Using Reinforcement Learning ( Presentation, Paper )
Diverse Motion Variations for Physics-based Character Animation ( Video, Paper )
Clone Attack! Perception of Crowd Variety ( Video, Lecture, Paper )
Eye-catching crowds: saliency based selective variation ( Video, Paper )
Morphable Crowds ( Video, Paper )
Learning Bicycle Stunts ( Project )
Discovering and synthesizing humanoid climbing movements ( Video, Presentation, Paper )

More forthcoming... (Slides, PDF)