We do a lot of testing of devices that have LCD screens. Right now the testing is done mainly manually. To automate the tests basically two things have to be done:

- Press buttons. I think that can be done with a 3D printed fixture and something like Lego Robotics.

- Read the screen with a camera: Are there libraries that allow understanding of screen content (buttons, text boxes and so on) even under variable lighting conditions? We have tried screenshots but for that the device had to be in a totally dark enclosure and the brightness couldn't change. I am also interested in screen transitions like progress screens or splash screens that change quickly)