The great clinical success of chimeric antigen receptor (CAR) T cells has unlocked new levels of immunotherapy for hematological malignancies. Genetically modifying natural killer (NK) cells as alternative CAR immune effector cells is also highly promising, as NK cells can be transplanted across HLA barriers without causing graft-versus-host disease. Therefore, off-the-shelf usage of CAR NK cell products might allow to widely expand the clinical indications and to limit the costs of treatment per patient. However, in contrast to T cells, manufacturing suitable CAR NK cell products is challenging, as standard techniques for genetically engineering NK cells are still being defined. In this study, we have established optimal lentiviral transduction of primary human NK cells by systematically testing different internal promoters for lentiviral CAR vectors and comparing lentiviral pseudotypes and viral entry enhancers. We have additionally modified CAR constructs recognizing standard target antigens for acute lymphoblastic leukemia (ALL) and acute myeloid leukemia (AML) therapy-CD19, CD33, and CD123-to harbor a CD34-derived hinge region that allows efficient detection of transduced NK cells in vitro and in vivo and also facilitates CD34 microbead-assisted selection of CAR NK cell products to >95% purity for potential clinical usage. Importantly, as most leukemic blasts are a priori immunogenic for activated primary human NK cells, we developed an in vitro system that blocks the activating receptors NKG2D, DNAM-1, NKp30, NKp44, NKp46, and NKp80 on these cells and therefore allows systematic testing of the specific killing of CAR NK cells against ALL and AML cell lines and primary AML blasts. Finally, we evaluated in an ALL xenotransplantation model in NOD/SCID-gamma (NSG) mice whether human CD19 CAR NK cells directed against the CD19+ blasts are relying on soluble or membrane-bound IL15 production for NK cell persistence and also in vivo leukemia control. Hence, our study provides important insights into the generation of pure and highly active allogeneic CAR NK cells, thereby advancing adoptive cellular immunotherapy with CAR NK cells for human malignancies further.