Well, I'm a dinosaur and paint only in oils.
Your start is good, and avoiding shine you doing well with let the oil out of the paint.
Then it is very important that above your basecoat with acrylic you lay a very thin layer of oilpaint above it.
If it doesn't cover the acrylic the first layer...