In brief

Validation was heavily focused on manual testing that was labour intensive and difficult to replicate, with only approximate failure data from the devices under test.

Results

  • Over 1 million test runs recorded
  • More than 20 testers running the automation scripts simultaneously
  • Full traceability of hardware, firmware, and testing software

Challenge

Our client was already performing validation on motors, but it was heavily focused on manual testing that was labour intensive and made it difficult to replicate tests. When they did implement the semi-automated testing, they weren’t able to collect live data from the devices under test, getting only approximate failure data. Testing wasn’t always consistently done and was lacking test traceability data.

The client’s customers wanted to have improved traceability of testing performed with improvements to the control loops at the same time. With this in mind, our client chose to automate the validation process to enhance their productivity, and also allow improvements that are made to the product to be fully tested and benchmarked against the original design. The client required over 1 million test runs of a number of test types to be recorded over design variations.

Solution

We developed new firmware to support the devices under test (DUT) to report internal data directly from all of the control loops and from all device interfaces. The loops were for actuator controls, PLL functionality, and various software controlled power supplies. The test system uses high-level scripts which allows repeating a wide range of tests.

The DUT was able to interact with other products that were also controlled from the test system, such as dynamic loads and other controllers that communicate with the DUT. The Python-based Automated Test system allows for endurance & environmental validation testing of an electro-mechanical sub-system.

Overview

The device under test was a PMSM 3-phase motor that had a number of product variations. We created several test setups that allowed automatic testing of a large range of features, including communication protocols and different motor loads that could change the start load. More than 20 testers were deployed to run the automation scripts simultaneously. The functionality of the testers evolved over time, specifically to enable motor load variations.

Software functions
  • Allows both automatic and manual scheduling of tests
  • Product-specific software components to operate unique products
  • Execute mechanical accelerated life testing
  • Execute environmental accelerated life tests
  • Database file created for every test cycle to record diagnostics data
Diagnostics data
  • Torque, speed, motor current, and voltages
  • Stability of control loops: motor, observer, and power supplies
  • Power supply voltages and currents
  • Temperatures
Hardware used
  • Bluetooth modules
  • Power supplies
  • Analog input card *
  • DMMs *

* Used for only a subset of tests while most of the testing only needing basic extra hardware setup.

Benefit to our client

Enables simple scheduling of multiple test resources and automation of firmware updating.

Automates tests that run for months at a time.

Logs all behaviour during each test, including real-time fault data.

Produces daily and weekly reports from post-processing of raw data to detect trends and abnormalities.

Capable of testing a large variety of product lines and configurations of the same product.

Full traceability of hardware, firmware, and testing software script that is run.

Simple web interface to set up and modify testing scripts.

Reduces risks and improves confidence in product performance when firmware and hardware changes are made.