When I use the camera x5 in Inspire V1 the drone is very unstable

You need different firmware on the Inspire 1 for the X5 camera iirc, pretty sure there are changes to the flight characteristics caused by the added weight of the X5 and it's associated mounting plate...