This should not be a hard question for your lecturers!

Decimal/Hex is irrelevnt - it's just a number; multiplication is multiplication in whatever radix!

The sledgehammer-to-crack-nut solution would be to use a floating-point library!

The method Erik describes is known as "Fixed-Point" arithmetic.