Current treatment of osteoarthritis and traumatic lesions of articular cartilage employs the usage of osteochondral implants made of biocompatible polymers. Synthetic scaffolds based on polyvinyl alcohol (PVA) hydrogels have been used to repair or replace damaged tissue, with varying degrees of success. Nano-hydroxyapatite (nano-HA), in turn, is the main hard component of bone and has potential to be used to promote osseointegration of implants. This study investigates the possibility of creating a cell-conducting functionally gradient material made of PVA and nano-HA with excellent biomechanical parameters and exceptional biocompatibility properties. While the polymer has the closest characteristics of the articular cartilage, the presence of the ceramic component as a filler mimics the osseous structure thus making the material an excellent choice for the treatment of osteochondral defects. The material composition was evaluated using infrared attenuated total reflectance spectroscopy (ATR-FTIR) as well as thermogravimetric analysis (TGA) and X-Ray Powder Diffraction (XRPD), whereas biomechanical characteristics while undergoing deformations were tested using Dynamical Mechanical Analysis (DMA). As a result, we have shown that by varying the ratio of a polymer and filler it was possible to achieve the desired parameters for the storage and loss moduli which are close to the ones measured for various parts of the cartilage and bone.