I will discuss my approach to perturbative Chern-Simons invariants of 3-manifolds and knots, and their generalizations, such as Rozansky-Witten invariants, via the factorization complex of Weyl e_n-algebras. I will give a review of some results and will describe possible further applications of them.