I presume you're talking about something to actually test real hardware - not just another simulator?

If so, what you're looking for is Automatic (or Automated) Test Equipment - or ATE.

Clearly, it cannot be a purely software solution - you also need hardware (test equipment) to provide the stimuli to your Unit Under Test (UUT) and to detect & measure its responses.
Then you need lots of software to control it all!

There is an entire ATE industry, and one thing is quite certain - you will not be getting it for free!


Maybe you're slightly misquoting and/or misunderstanding Wikipedia there, but I would not call this a Design task.

I'd put this more under the "CAM" part of "CAD/CAM" = Computer-Aided Design / Computer-Aided Manufacture...