Yes
Just follow the guide, it explains what certificates to use.
The fullchain.pem
contains the cert.pem
and the chain.pem
which is needed for correct validation. See Letsencrypt chain.pem or trusted root list cert? - #10 by JuergenAuer - Help - Let's Encrypt Community Support