The interface in your Media Library will now leverage infinite scrolling and feature other interface tweaks.
The major change is now you can preview embedded media before you publish your post or page. We suggest you review the automatic embeds that WordPress supports to save you time in the future.
You can read and watch videos detailing the new features of WordPress 4.0 at the WordPress blog. Email firstname.lastname@example.org if you have any questions.