There are a few things that automated testing won’t do:
it won’t fix specific problems that users
might have. When writing and testing the
scripts there are just some scenarios that
are being tested, not all of them.
The main purpose of automated testing is
to find bugs in simple operations, e.g.
to log into the app, create a new account
or send email when the password gets forgotten.
That’s what automated tests do.
App crashes in specific scenarios must still
be tested manually. As we know, machines are
very advanced, but they are not smart, (yet!).
One other thing that automated testing won’t do
is test the effective usability of the design,
e.g. where the buttons are positioned, and
how easy it is to actually use the app.
That still has to be done by manual user-friendly tests.
In conclusion there are benefits and drawbacks
to both automated and manual testing.
To achieve the best results we need a
combination of both types:
automated testing for repetitive,
simple use-cases; and manual testing
for reproducing specific bugs, complicated
use cases and to ensure the best user experience possible.