2.1 Supervise accelerations, not states
A conventional Neural ODE obtains future states by solving an initial value problem, so every training step must differentiate through — or adjoint-solve alongside — the integrator. FNODE instead models the acceleration directly on the augmented state Z = (z⊤, ż⊤)⊤: z̈(t, μ) = fΘ(Z(t), μ), with μ an optional parameter input (e.g., a friction coefficient). Training is plain regression on the vector field,
ℒ(Θ) = (1/N) ∑i ‖ f(zi, żi; Θ) − z̈i ‖22,
with no ODE solve anywhere in the loop. The solver enters only at inference — and can be swapped freely: adaptive steppers for stiff phases, or symplectic leapfrog when energy behavior matters.