fix: wget recursive workaround

The recursive feature of Wget is being blocked in OpenCI due to the
Robot Exclusive Standard being observed. This patch adds the command
line argument for wget to block the robots.txt file from being observed,
allowing the fetch_directory to work as intended.

Signed-off-by: Lauren Wehrmeister <lauren.wehrmeister@arm.com>
Change-Id: I1e6449fffffec7cda1475b528e9a9f029743d299
1 file changed