diff options
Diffstat (limited to 'docs/configexamples')
| -rw-r--r-- | docs/configexamples/autotest/Wireguard/Wireguard.log | 1079 | ||||
| -rw-r--r-- | docs/configexamples/autotest/Wireguard/Wireguard.rst | 32 | ||||
| -rw-r--r-- | docs/configexamples/autotest/Wireguard/_include/branch.conf | 2 | ||||
| -rw-r--r-- | docs/configexamples/autotest/Wireguard/_include/central.conf | 2 | ||||
| -rw-r--r-- | docs/configexamples/index.rst | 3 | ||||
| -rw-r--r-- | docs/configexamples/l3vpn-hub-and-spoke.rst | 1130 | 
6 files changed, 1786 insertions, 462 deletions
| diff --git a/docs/configexamples/autotest/Wireguard/Wireguard.log b/docs/configexamples/autotest/Wireguard/Wireguard.log index f59a86be..aa02352c 100644 --- a/docs/configexamples/autotest/Wireguard/Wireguard.log +++ b/docs/configexamples/autotest/Wireguard/Wireguard.log @@ -1,451 +1,630 @@ -2021-11-23 15:10:43,829 p=3983 u=rob n=ansible | PLAY [prepare node and Lab] ************************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:43,844 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : fail] ********************************************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:43,864 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:43,865 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:43,866 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:43,869 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:43,871 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : fail] ********************************************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:43,884 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:43,889 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:43,891 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:43,894 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:43,896 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie] ******************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:43,914 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:43,915 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:43,919 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:44,957 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:44,962 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : get template facts] ******************************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:44,994 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:44,996 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:45,001 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:45,552 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:45,558 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Register path status] ***************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:45,591 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:45,591 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:45,597 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:45,999 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:46,003 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : create path] ************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,023 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,031 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,032 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,039 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,042 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Download iso] ************************************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:46,056 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,062 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,065 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,069 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,073 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : create virtioa.qcow2 file] ************************************************************************************************************************************************************************************************************************ -2021-11-23 15:10:46,086 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,092 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,095 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,097 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,100 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie] ******************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:46,112 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,117 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,119 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,123 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,126 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : create lab for node install] ********************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,138 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,144 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,146 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,149 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,151 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : open lab] ***************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,164 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,169 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,171 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,175 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,178 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : set_fact] ***************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,190 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,196 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,198 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,201 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,203 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : add node to lab] ********************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,216 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,221 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,222 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,226 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,228 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : start node] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,240 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,245 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,247 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,250 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,252 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : get node infos] *********************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,265 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,270 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,272 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,275 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,277 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : set_fact] ***************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,291 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,298 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,299 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,303 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,307 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : copy file] **************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,319 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,324 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,327 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,330 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,332 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : run expect script] ******************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,344 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,349 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,351 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,356 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,358 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie (due timeout)] ***************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,372 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,378 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,380 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,382 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,385 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : stop node] **************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,397 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,403 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,405 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,408 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,411 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : Pause to wait node is shutdown] ******************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:46,419 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,421 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : delete iso] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,433 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,439 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,441 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,445 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,447 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : commit virtioa.qcow2] ***************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,460 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,466 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,468 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,470 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,472 p=3983 u=rob n=ansible | TASK [eve-ng-create-node : delete lab for node install] ********************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,484 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,490 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,492 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,496 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,502 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : fail] ************************************************************************************************************************************************************************************************************************************************ -2021-11-23 15:10:46,515 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:46,521 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,523 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,526 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:46,528 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ********************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:46,548 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:46,549 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:46,554 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:47,231 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:47,236 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : get running lab list] ******************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:47,263 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:47,265 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:47,270 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:47,803 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:47,807 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : delte existing lab] ********************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:47,832 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:47,834 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:47,838 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:48,479 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:48,487 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Ensure labtest is present] *************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:48,516 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:48,518 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:48,524 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:48,916 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:48,922 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Create Wireguard Lab] ******************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:48,947 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:48,948 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:48,952 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:49,816 p=3983 u=rob n=ansible | changed: [eveng] -2021-11-23 15:10:49,821 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ********************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:49,846 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:49,848 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:49,854 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:50,540 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:50,546 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : start vyos-oobm] ************************************************************************************************************************************************************************************************************************************* -2021-11-23 15:10:50,579 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:10:50,579 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:50,583 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:10:51,633 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:10:51,640 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos-oobm] ********************************************************************************************************************************************************************************************************************************** -2021-11-23 15:10:51,661 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:10:51,670 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:10:51,676 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:11:28,054 p=3983 u=rob n=ansible | ok: [vyos-oobm] -2021-11-23 15:11:28,061 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ********************************************************************************************************************************************************************************************************************** -2021-11-23 15:11:28,092 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:11:28,093 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:11:28,099 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:11:28,809 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:11:28,815 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : get lab status] ************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:11:28,844 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:11:28,844 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:11:28,850 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:11:29,381 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:11:29,387 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : start all nodes] ************************************************************************************************************************************************************************************************************************************* -2021-11-23 15:11:29,416 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:11:29,418 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:11:29,424 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:11:29,962 p=3983 u=rob n=ansible | ok: [eveng] => (item=1) -2021-11-23 15:11:30,968 p=3983 u=rob n=ansible | ok: [eveng] => (item=4) -2021-11-23 15:11:32,027 p=3983 u=rob n=ansible | ok: [eveng] => (item=6) -2021-11-23 15:11:32,943 p=3983 u=rob n=ansible | ok: [eveng] => (item=2) -2021-11-23 15:11:33,950 p=3983 u=rob n=ansible | ok: [eveng] => (item=3) -2021-11-23 15:11:33,958 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos nodes] ********************************************************************************************************************************************************************************************************************************* -2021-11-23 15:11:33,976 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:11:33,984 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:11:34,907 p=4468 u=rob n=ansible | network_os is set to vyos -2021-11-23 15:11:34,907 p=4467 u=rob n=ansible | network_os is set to vyos -2021-11-23 15:11:49,934 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner -2021-11-23 15:11:49,936 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner -2021-11-23 15:11:49,937 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Traceback (most recent call last): -2021-11-23 15:11:49,937 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:11:49,937 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     raise socket.timeout() -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise socket.timeout() -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | socket.timeout -2021-11-23 15:11:49,938 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | socket.timeout -2021-11-23 15:11:49,938 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Traceback (most recent call last): -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     self._check_banner() -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     self._check_banner() -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner -2021-11-23 15:11:49,939 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner -2021-11-23 15:11:49,939 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     raise SSHException( -2021-11-23 15:11:49,940 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise SSHException( -2021-11-23 15:11:49,940 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner -2021-11-23 15:11:49,940 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner -2021-11-23 15:11:49,940 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:11:49,940 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:05,971 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner -2021-11-23 15:12:05,971 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner -2021-11-23 15:12:05,972 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:12:05,972 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Traceback (most recent call last): -2021-11-23 15:12:05,972 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner -2021-11-23 15:12:05,972 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner -2021-11-23 15:12:05,972 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) -2021-11-23 15:12:05,972 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise socket.timeout() -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     raise socket.timeout() -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | socket.timeout -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | socket.timeout -2021-11-23 15:12:05,973 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:05,973 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Traceback (most recent call last): -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     self._check_banner() -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     self._check_banner() -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner -2021-11-23 15:12:05,974 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise SSHException( -2021-11-23 15:12:05,974 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |     raise SSHException( -2021-11-23 15:12:05,975 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner -2021-11-23 15:12:05,975 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner -2021-11-23 15:12:05,975 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:05,975 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] |  -2021-11-23 15:12:08,410 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) -2021-11-23 15:12:08,477 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' -2021-11-23 15:12:08,478 p=4468 u=rob n=p=4468 u=rob | paramiko [branch] | Authentication (publickey) successful! -2021-11-23 15:12:09,219 p=3983 u=rob n=ansible | ok: [branch] -2021-11-23 15:12:22,012 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) -2021-11-23 15:12:22,013 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise socket.timeout() -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | socket.timeout -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Traceback (most recent call last): -2021-11-23 15:12:22,014 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run -2021-11-23 15:12:22,015 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     self._check_banner() -2021-11-23 15:12:22,015 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner -2021-11-23 15:12:22,015 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |     raise SSHException( -2021-11-23 15:12:22,015 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner -2021-11-23 15:12:22,015 p=4467 u=rob n=p=4467 u=rob | paramiko [central] |  -2021-11-23 15:12:23,497 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) -2021-11-23 15:12:23,597 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' -2021-11-23 15:12:23,598 p=4467 u=rob n=p=4467 u=rob | paramiko [central] | Authentication (publickey) successful! -2021-11-23 15:12:24,468 p=3983 u=rob n=ansible | ok: [central] -2021-11-23 15:12:24,470 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : include Wireguard lab_config.yml] ******************************************************************************************************************************************************************************************************************** -2021-11-23 15:12:24,485 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:12:24,492 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:12:24,504 p=3983 u=rob n=ansible | included: /Users/rob/git/_vyos/vyos-eveng/labs/Wireguard/lab_config.yml for central, branch -2021-11-23 15:12:24,517 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : show wireguard keypairs pubkey default] ************************************************************************************************************************************************************************************************************** -2021-11-23 15:12:26,045 p=4476 u=rob n=p=4476 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) -2021-11-23 15:12:26,147 p=4476 u=rob n=p=4476 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' -2021-11-23 15:12:26,147 p=4476 u=rob n=p=4476 u=rob | paramiko [central] | Authentication (publickey) successful! -2021-11-23 15:12:26,321 p=4475 u=rob n=p=4475 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) -2021-11-23 15:12:26,420 p=4475 u=rob n=p=4475 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' -2021-11-23 15:12:26,421 p=4475 u=rob n=p=4475 u=rob | paramiko [branch] | Authentication (publickey) successful! -2021-11-23 15:12:27,752 p=3983 u=rob n=ansible | ok: [central] -2021-11-23 15:12:28,014 p=3983 u=rob n=ansible | ok: [branch] -2021-11-23 15:12:28,021 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : fail] ************************************************************************************************************************************************************************************************************************************************ -2021-11-23 15:12:28,901 p=3983 u=rob n=ansible | fatal: [branch]: FAILED! => {"changed": false, "msg": "Failed as requested from task"} -2021-11-23 15:12:28,902 p=3983 u=rob n=ansible | fatal: [central]: FAILED! => {"changed": false, "msg": "Failed as requested from task"} -2021-11-23 15:12:28,913 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : generate wireguard default-keypair] ****************************************************************************************************************************************************************************************************************** -2021-11-23 15:12:30,280 p=3983 u=rob n=ansible | ok: [central] -2021-11-23 15:12:30,281 p=3983 u=rob n=ansible | ok: [branch] -2021-11-23 15:12:30,286 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : show wireguard keypairs pubkey default] ************************************************************************************************************************************************************************************************************** -2021-11-23 15:12:31,635 p=3983 u=rob n=ansible | ok: [central] -2021-11-23 15:12:31,635 p=3983 u=rob n=ansible | ok: [branch] -2021-11-23 15:12:31,651 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : setup nodes] ***************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:12:39,514 p=3983 u=rob n=ansible | [WARNING]: To ensure idempotency and correct diff the input configuration lines should be similar to how they appear if present in the running configuration on device including the indentation +2021-11-30 21:33:12,893 p=91291 u=rob n=ansible | PLAY [prepare node and Lab] *********************************************************************************************************************************************** +2021-11-30 21:33:12,911 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : fail] ****************************************************************************************************************************************** +2021-11-30 21:33:12,926 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:12,934 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:12,935 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:12,939 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:12,941 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : fail] ****************************************************************************************************************************************** +2021-11-30 21:33:12,956 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:12,964 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:12,966 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:12,970 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:12,973 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie] **************************************************************************************************************** +2021-11-30 21:33:13,004 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:13,005 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:13,009 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:13,973 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:13,978 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : get template facts] **************************************************************************************************************************** +2021-11-30 21:33:14,000 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,005 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,010 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,489 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:14,495 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Register path status] ************************************************************************************************************************** +2021-11-30 21:33:14,522 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,524 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,528 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,833 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:14,836 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : create path] *********************************************************************************************************************************** +2021-11-30 21:33:14,851 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,859 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,860 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,864 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,867 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Download iso] ********************************************************************************************************************************** +2021-11-30 21:33:14,880 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,886 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,887 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,891 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,893 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : create virtioa.qcow2 file] ********************************************************************************************************************* +2021-11-30 21:33:14,906 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,912 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,914 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,917 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,918 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie] **************************************************************************************************************** +2021-11-30 21:33:14,930 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,936 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,938 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,941 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,943 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : create lab for node install] ******************************************************************************************************************* +2021-11-30 21:33:14,957 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,963 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,965 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,967 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,969 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : open lab] ************************************************************************************************************************************** +2021-11-30 21:33:14,982 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:14,988 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:14,989 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:14,993 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:14,996 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : set_fact] ************************************************************************************************************************************** +2021-11-30 21:33:15,008 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,013 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,015 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,018 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,020 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : add node to lab] ******************************************************************************************************************************* +2021-11-30 21:33:15,031 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,037 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,039 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,041 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,043 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : start node] ************************************************************************************************************************************ +2021-11-30 21:33:15,056 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,062 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,064 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,067 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,068 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : get node infos] ******************************************************************************************************************************** +2021-11-30 21:33:15,080 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,086 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,089 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,091 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,093 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : set_fact] ************************************************************************************************************************************** +2021-11-30 21:33:15,106 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,111 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,113 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,116 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,119 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : copy file] ************************************************************************************************************************************* +2021-11-30 21:33:15,130 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,136 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,138 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,140 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,143 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : run expect script] ***************************************************************************************************************************** +2021-11-30 21:33:15,155 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,161 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,163 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,166 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,168 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Login to EVE-NG and get Cookie (due timeout)] ************************************************************************************************** +2021-11-30 21:33:15,180 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,185 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,187 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,190 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,192 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : stop node] ************************************************************************************************************************************* +2021-11-30 21:33:15,203 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,208 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,210 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,213 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,216 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : Pause to wait node is shutdown] **************************************************************************************************************** +2021-11-30 21:33:15,226 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,228 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : delete iso] ************************************************************************************************************************************ +2021-11-30 21:33:15,241 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,247 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,248 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,253 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,255 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : commit virtioa.qcow2] ************************************************************************************************************************** +2021-11-30 21:33:15,267 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,273 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,275 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,278 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,280 p=91291 u=rob n=ansible | TASK [eve-ng-create-node : delete lab for node install] ******************************************************************************************************************* +2021-11-30 21:33:15,291 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,297 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,299 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,301 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,308 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : fail] ********************************************************************************************************************************************* +2021-11-30 21:33:15,321 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:15,328 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,330 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,333 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:15,335 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ******************************************************************************************************************* +2021-11-30 21:33:15,354 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:15,355 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:15,359 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:16,018 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:16,024 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : get running lab list] ***************************************************************************************************************************** +2021-11-30 21:33:16,052 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:16,054 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:16,058 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:16,535 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:16,541 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : delete existing lab] ****************************************************************************************************************************** +2021-11-30 21:33:16,573 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:16,576 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:16,583 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:17,044 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:17,052 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Ensure labtest is present] ************************************************************************************************************************ +2021-11-30 21:33:17,081 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:17,085 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:17,089 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:17,412 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:17,418 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Create Wireguard Lab] ***************************************************************************************************************************** +2021-11-30 21:33:17,443 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:17,445 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:17,449 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:18,120 p=91291 u=rob n=ansible | changed: [eveng] +2021-11-30 21:33:18,124 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ******************************************************************************************************************* +2021-11-30 21:33:18,150 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:18,160 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:18,163 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:18,886 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:18,891 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : start vyos-oobm] ********************************************************************************************************************************** +2021-11-30 21:33:18,930 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:33:18,932 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:18,937 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:33:20,115 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:33:20,122 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos-oobm] ******************************************************************************************************************************* +2021-11-30 21:33:20,141 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:33:20,156 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:33:20,161 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:34:03,079 p=91291 u=rob n=ansible | ok: [vyos-oobm] +2021-11-30 21:34:03,086 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Login to EVE-NG and get Cookie] ******************************************************************************************************************* +2021-11-30 21:34:03,116 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:34:03,119 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:34:03,124 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:34:03,840 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:34:03,846 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : get lab status] *********************************************************************************************************************************** +2021-11-30 21:34:03,873 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:34:03,876 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:34:03,882 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:34:04,356 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:34:04,361 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : start all nodes] ********************************************************************************************************************************** +2021-11-30 21:34:04,391 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:34:04,391 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:34:04,399 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:34:04,972 p=91291 u=rob n=ansible | ok: [eveng] => (item=1) +2021-11-30 21:34:06,097 p=91291 u=rob n=ansible | ok: [eveng] => (item=4) +2021-11-30 21:34:07,233 p=91291 u=rob n=ansible | ok: [eveng] => (item=6) +2021-11-30 21:34:08,143 p=91291 u=rob n=ansible | ok: [eveng] => (item=2) +2021-11-30 21:34:09,060 p=91291 u=rob n=ansible | ok: [eveng] => (item=3) +2021-11-30 21:34:09,068 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos nodes] ****************************************************************************************************************************** +2021-11-30 21:34:09,087 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:34:09,096 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:34:10,046 p=91755 u=rob n=ansible | network_os is set to vyos +2021-11-30 21:34:10,047 p=91756 u=rob n=ansible | network_os is set to vyos +2021-11-30 21:34:25,068 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner +2021-11-30 21:34:25,071 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:34:25,071 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:34:25,071 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:34:25,071 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     raise socket.timeout() +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | socket.timeout +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: +2021-11-30 21:34:25,072 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     self._check_banner() +2021-11-30 21:34:25,073 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     raise SSHException( +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:34:25,073 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:34:25,074 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:34:25,075 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:34:25,076 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:34:25,076 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:34:25,076 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:41,100 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:34:41,101 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:34:41,102 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:34:41,103 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:34:41,103 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:34:41,103 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:34:41,103 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:41,112 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner +2021-11-30 21:34:41,113 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:34:41,113 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:34:41,113 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:34:41,113 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:34:41,113 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     raise socket.timeout() +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | socket.timeout +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:34:41,114 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:34:41,115 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     self._check_banner() +2021-11-30 21:34:41,115 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:34:41,115 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |     raise SSHException( +2021-11-30 21:34:41,115 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:34:41,115 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] |  +2021-11-30 21:34:43,749 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:34:43,804 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:34:43,805 p=91756 u=rob n=p=91756 u=rob | paramiko [branch] | Authentication (publickey) successful! +2021-11-30 21:34:44,529 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:34:57,139 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:34:57,139 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:34:57,140 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:34:57,141 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:34:57,142 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:34:57,142 p=91755 u=rob n=p=91755 u=rob | paramiko [central] |  +2021-11-30 21:34:58,833 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:34:58,925 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:34:58,926 p=91755 u=rob n=p=91755 u=rob | paramiko [central] | Authentication (publickey) successful! +2021-11-30 21:34:59,733 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:34:59,735 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : include Wireguard lab_config.yml] ***************************************************************************************************************** +2021-11-30 21:34:59,750 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:34:59,755 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:34:59,770 p=91291 u=rob n=ansible | included: /Users/rob/git/_vyos/vyos-eveng/labs/Wireguard/lab_config.yml for central, branch +2021-11-30 21:34:59,787 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : show wireguard keypairs pubkey default] *********************************************************************************************************** +2021-11-30 21:35:01,570 p=91763 u=rob n=p=91763 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:35:01,657 p=91763 u=rob n=p=91763 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:35:01,658 p=91763 u=rob n=p=91763 u=rob | paramiko [central] | Authentication (publickey) successful! +2021-11-30 21:35:01,824 p=91764 u=rob n=p=91764 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:35:01,915 p=91764 u=rob n=p=91764 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:35:01,915 p=91764 u=rob n=p=91764 u=rob | paramiko [branch] | Authentication (publickey) successful! +2021-11-30 21:35:03,133 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:35:03,426 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:35:03,433 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : fail] ********************************************************************************************************************************************* +2021-11-30 21:35:04,306 p=91291 u=rob n=ansible | fatal: [branch]: FAILED! => {"changed": false, "msg": "Failed as requested from task"} +2021-11-30 21:35:04,307 p=91291 u=rob n=ansible | fatal: [central]: FAILED! => {"changed": false, "msg": "Failed as requested from task"} +2021-11-30 21:35:04,317 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : generate wireguard default-keypair] *************************************************************************************************************** +2021-11-30 21:35:05,666 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:35:05,666 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:35:05,674 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : show wireguard keypairs pubkey default] *********************************************************************************************************** +2021-11-30 21:35:07,015 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:35:07,016 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:35:07,031 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : setup nodes] ************************************************************************************************************************************** +2021-11-30 21:35:14,895 p=91291 u=rob n=ansible | [WARNING]: To ensure idempotency and correct diff the input configuration lines should be similar to how they appear if present in the running configuration on device +including the indentation -2021-11-23 15:12:39,515 p=3983 u=rob n=ansible | changed: [branch] -2021-11-23 15:12:39,555 p=3983 u=rob n=ansible | changed: [central] -2021-11-23 15:12:39,557 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : wait, b/c the ping often failed without a short break] *********************************************************************************************************************************************************************************************** -2021-11-23 15:12:39,565 p=4689 u=rob n=ansible | Pausing for 30 seconds -2021-11-23 15:12:39,565 p=4689 u=rob n=ansible | (ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
 -2021-11-23 15:13:09,571 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:13:09,580 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : do ping test] **************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:09,606 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:09,617 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:14,941 p=3983 u=rob n=ansible | ok: [central] => (item=10.0.2.100) -2021-11-23 15:13:14,960 p=3983 u=rob n=ansible | ok: [branch] => (item=10.0.1.100) -2021-11-23 15:13:14,963 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : execute test commands] ******************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:14,986 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:14,986 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:16,263 p=3983 u=rob n=ansible | ok: [central] => (item={'desc': 'Test if IP is set to interface', 'command': "ip -4 addr show dev eth2 | grep inet | tr -s ' ' | cut -d' ' -f3 | head -n 1", 'wait_for': ['result[0] contains "10.0.1.254/24"']}) -2021-11-23 15:13:16,490 p=3983 u=rob n=ansible | ok: [branch] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.2/24                    u/u  VPN-to-central"']}) -2021-11-23 15:13:16,734 p=3983 u=rob n=ansible | ok: [central] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.1/24                    u/u  VPN-to-Branch"']}) -2021-11-23 15:13:16,739 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : register stdout commands] **************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:16,762 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:16,763 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:18,145 p=3983 u=rob n=ansible | ok: [branch] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) -2021-11-23 15:13:18,146 p=3983 u=rob n=ansible | ok: [central] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) -2021-11-23 15:13:21,501 p=3983 u=rob n=ansible | ok: [central] => (item={'name': 'ping_branch_pc', 'command': 'ping 10.0.2.100 count 4'}) -2021-11-23 15:13:21,506 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:21,523 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:21,530 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,390 p=3983 u=rob n=ansible | ok: [central] -2021-11-23 15:13:22,391 p=3983 u=rob n=ansible | ok: [branch] -2021-11-23 15:13:22,407 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : make sure tmp dir exist] ***************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,438 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,447 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,449 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,454 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,459 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Download upgrade_iso] ******************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,476 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,483 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,483 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,488 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,492 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Copy iso to host] ************************************************************************************************************************************************************************************************************************************ -2021-11-23 15:13:22,505 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,512 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,513 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,517 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,519 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : upgrade vyos] **************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,532 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,538 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,540 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,543 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,545 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Reboot vyos] ***************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,558 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,564 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,566 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,569 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,571 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : wait while shutdown] ********************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:22,579 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,580 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos nodes] ********************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:22,593 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,600 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,600 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,604 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,608 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : clear tmp dir] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,615 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,617 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : wait, b/c the ping often failed without a short break] *********************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,625 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,627 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : do ping test] **************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,639 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,645 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,652 p=3983 u=rob n=ansible | skipping: [central] => (item=10.0.2.100)  -2021-11-23 15:13:22,657 p=3983 u=rob n=ansible | skipping: [branch] => (item=10.0.1.100)  -2021-11-23 15:13:22,660 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : execute test commands] ******************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:22,672 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,678 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,686 p=3983 u=rob n=ansible | skipping: [central] => (item={'desc': 'Test if IP is set to interface', 'command': "ip -4 addr show dev eth2 | grep inet | tr -s ' ' | cut -d' ' -f3 | head -n 1", 'wait_for': ['result[0] contains "10.0.1.254/24"']})  -2021-11-23 15:13:22,686 p=3983 u=rob n=ansible | skipping: [central] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.1/24                    u/u  VPN-to-Branch"']})  -2021-11-23 15:13:22,690 p=3983 u=rob n=ansible | skipping: [branch] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.2/24                    u/u  VPN-to-central"']})  -2021-11-23 15:13:22,694 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : register stdout commands] **************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,709 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,714 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,722 p=3983 u=rob n=ansible | skipping: [central] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'})  -2021-11-23 15:13:22,722 p=3983 u=rob n=ansible | skipping: [central] => (item={'name': 'ping_branch_pc', 'command': 'ping 10.0.2.100 count 4'})  -2021-11-23 15:13:22,726 p=3983 u=rob n=ansible | skipping: [branch] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'})  -2021-11-23 15:13:22,729 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,743 p=3983 u=rob n=ansible | skipping: [eveng] -2021-11-23 15:13:22,749 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,750 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,753 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,757 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : make sure output dir exist] ************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,778 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,779 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,783 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:22,951 p=3983 u=rob n=ansible | changed: [eveng -> localhost] -2021-11-23 15:13:22,954 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : make sure output include dir exist] ****************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:22,977 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:22,978 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:22,982 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:23,081 p=3983 u=rob n=ansible | changed: [eveng -> localhost] -2021-11-23 15:13:23,083 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Get timestamp from the system] *********************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:23,102 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:23,104 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:23,108 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:23,844 p=3983 u=rob n=ansible | changed: [eveng] -2021-11-23 15:13:23,846 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] *************************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:23,859 p=3983 u=rob n=ansible | ok: [eveng] -2021-11-23 15:13:23,866 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:23,868 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:23,872 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:23,876 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : generate lab rst file] ******************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:23,908 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:23,910 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:23,910 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:24,168 p=3983 u=rob n=ansible | changed: [eveng -> localhost] -2021-11-23 15:13:24,171 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : find all *.conf files in Lab] ************************************************************************************************************************************************************************************************************************ -2021-11-23 15:13:24,196 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:24,199 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:24,202 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:24,373 p=3983 u=rob n=ansible | ok: [eveng -> localhost] -2021-11-23 15:13:24,382 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : copy all *.conf files] ******************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:24,408 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:24,410 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:24,415 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:24,627 p=3983 u=rob n=ansible | changed: [eveng -> localhost] => (item={'path': 'labs/Wireguard/branch.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 675, 'inode': 22590050, 'dev': 16777233, 'nlink': 1, 'atime': 1637094141.478437, 'mtime': 1637094140.231892, 'ctime': 1637094140.231892, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) -2021-11-23 15:13:24,863 p=3983 u=rob n=ansible | changed: [eveng -> localhost] => (item={'path': 'labs/Wireguard/central.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 668, 'inode': 22590049, 'dev': 16777233, 'nlink': 1, 'atime': 1637094137.349848, 'mtime': 1637094136.0909584, 'ctime': 1637094136.0909584, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) -2021-11-23 15:13:24,867 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : find all *.png files in Lab] ************************************************************************************************************************************************************************************************************************* -2021-11-23 15:13:24,891 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:24,892 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:24,896 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:25,010 p=3983 u=rob n=ansible | ok: [eveng -> localhost] -2021-11-23 15:13:25,015 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : copy all *.png files] ******************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:25,039 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:25,040 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:25,046 p=3983 u=rob n=ansible | skipping: [branch] -2021-11-23 15:13:25,253 p=3983 u=rob n=ansible | changed: [eveng -> localhost] => (item={'path': 'labs/Wireguard/topology.png', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 158227, 'inode': 31651192, 'dev': 16777233, 'nlink': 1, 'atime': 1637092176.426343, 'mtime': 1637092135.8691404, 'ctime': 1637092174.4312608, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) -2021-11-23 15:13:25,257 p=3983 u=rob n=ansible | TASK [eve-ng-lab-test : copy ansible log files] ****************************************************************************************************************************************************************************************************************************** -2021-11-23 15:13:25,281 p=3983 u=rob n=ansible | skipping: [vyos-oobm] -2021-11-23 15:13:25,281 p=3983 u=rob n=ansible | skipping: [central] -2021-11-23 15:13:25,286 p=3983 u=rob n=ansible | skipping: [branch] +2021-11-30 21:35:14,895 p=91291 u=rob n=ansible | changed: [central] +2021-11-30 21:35:14,896 p=91291 u=rob n=ansible | changed: [branch] +2021-11-30 21:35:14,898 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : wait, b/c the ping often failed without a short break] ******************************************************************************************** +2021-11-30 21:35:14,906 p=91977 u=rob n=ansible | Pausing for 30 seconds +2021-11-30 21:35:14,907 p=91977 u=rob n=ansible | (ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
 +2021-11-30 21:35:44,913 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:35:44,926 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : do ping test] ************************************************************************************************************************************* +2021-11-30 21:35:44,957 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:44,967 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:35:50,448 p=91291 u=rob n=ansible | ok: [branch] => (item=10.0.1.100) +2021-11-30 21:35:50,449 p=91291 u=rob n=ansible | ok: [central] => (item=10.0.2.100) +2021-11-30 21:35:50,454 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : execute test commands] **************************************************************************************************************************** +2021-11-30 21:35:50,478 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:50,479 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:35:51,750 p=91291 u=rob n=ansible | ok: [central] => (item={'desc': 'Test if IP is set to interface', 'command': "ip -4 addr show dev eth2 | grep inet | tr -s ' ' | cut -d' ' -f3 | head -n 1", 'wait_for': ['result[0] contains "10.0.1.254/24"']}) +2021-11-30 21:35:51,920 p=91291 u=rob n=ansible | ok: [branch] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.2/24                    u/u  VPN-to-central"']}) +2021-11-30 21:35:52,213 p=91291 u=rob n=ansible | ok: [central] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.1/24                    u/u  VPN-to-Branch"']}) +2021-11-30 21:35:52,216 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : register stdout commands] ************************************************************************************************************************* +2021-11-30 21:35:52,241 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:52,242 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:35:53,570 p=91291 u=rob n=ansible | ok: [branch] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) +2021-11-30 21:35:53,570 p=91291 u=rob n=ansible | ok: [central] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) +2021-11-30 21:35:56,996 p=91291 u=rob n=ansible | ok: [central] => (item={'name': 'ping_branch_pc', 'command': 'ping 10.0.2.100 count 4'}) +2021-11-30 21:35:57,000 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] ************************************************************************************************************************************ +2021-11-30 21:35:57,017 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:57,024 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:35:57,928 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:35:57,928 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:35:57,938 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Reboot vyos] ************************************************************************************************************************************** +2021-11-30 21:35:57,962 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:57,970 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:35:59,233 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:35:59,233 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:35:59,236 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : wait while shutdown] ****************************************************************************************************************************** +2021-11-30 21:35:59,246 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:59,249 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos nodes] ****************************************************************************************************************************** +2021-11-30 21:35:59,265 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:35:59,270 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:36:00,839 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:36:00,933 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:36:00,934 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Auth banner: b'System is going down. Unprivileged users are not permitted to log in anymore. For technical details, see pam_nologin(8).\n\n' +2021-11-30 21:36:01,115 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:36:01,182 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:36:01,182 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Auth banner: b'System is going down. Unprivileged users are not permitted to log in anymore. For technical details, see pam_nologin(8).\n\n' +2021-11-30 21:36:59,483 p=91763 u=rob n=ansible | persistent connection idle timeout triggered, timeout value is 60 secs. +See the timeout setting options in the Network Debug and Troubleshooting Guide. +2021-11-30 21:36:59,489 p=91764 u=rob n=ansible | persistent connection idle timeout triggered, timeout value is 60 secs. +See the timeout setting options in the Network Debug and Troubleshooting Guide. +2021-11-30 21:36:59,590 p=91763 u=rob n=ansible | shutdown complete +2021-11-30 21:36:59,593 p=91764 u=rob n=ansible | shutdown complete +2021-11-30 21:37:17,017 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:17,020 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:17,020 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise socket.timeout() +2021-11-30 21:37:17,021 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | socket.timeout +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:17,022 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     self._check_banner() +2021-11-30 21:37:17,023 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:17,023 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise SSHException( +2021-11-30 21:37:17,023 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:17,023 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:17,255 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:17,256 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:17,256 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:17,256 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:17,256 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:17,257 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:17,258 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:33,055 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:33,055 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:33,056 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:33,056 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:33,056 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:33,056 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:33,056 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise socket.timeout() +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | socket.timeout +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:33,057 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     self._check_banner() +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise SSHException( +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:33,058 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:33,273 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:33,273 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:37:33,274 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:33,275 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:37:33,276 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:33,276 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:37:33,276 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:33,276 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:49,085 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:49,086 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:49,086 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:49,086 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:49,086 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:49,086 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise socket.timeout() +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | socket.timeout +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:49,087 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Traceback (most recent call last): +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     self._check_banner() +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |     raise SSHException( +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:49,088 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] |  +2021-11-30 21:37:49,307 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Exception: Error reading SSH protocol banner +2021-11-30 21:37:49,307 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:49,307 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2211, in _check_banner +2021-11-30 21:37:49,307 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf = self.packetizer.readline(timeout) +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 380, in readline +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     buf += self._read_timeout(timeout) +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/packet.py", line 622, in _read_timeout +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise socket.timeout() +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | socket.timeout +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:49,308 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | During handling of the above exception, another exception occurred: +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Traceback (most recent call last): +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2039, in run +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     self._check_banner() +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |   File "/Users/rob/.local/share/virtualenvs/vyos-eveng-b9X2mBdh/lib/python3.9/site-packages/paramiko/transport.py", line 2215, in _check_banner +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |     raise SSHException( +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | paramiko.ssh_exception.SSHException: Error reading SSH protocol banner +2021-11-30 21:37:49,309 p=92209 u=rob n=p=92209 u=rob | paramiko [central] |  +2021-11-30 21:37:51,170 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:37:51,370 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:37:51,370 p=92210 u=rob n=p=92210 u=rob | paramiko [branch] | Authentication (publickey) successful! +2021-11-30 21:37:51,512 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:37:51,709 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:37:51,709 p=92209 u=rob n=p=92209 u=rob | paramiko [central] | Authentication (publickey) successful! +2021-11-30 21:37:52,515 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:37:52,741 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:37:52,746 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : wait, b/c the ping often failed without a short break] ******************************************************************************************** +2021-11-30 21:37:52,753 p=92299 u=rob n=ansible | Pausing for 30 seconds +2021-11-30 21:37:52,753 p=92299 u=rob n=ansible | (ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
 +2021-11-30 21:38:22,856 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:38:22,863 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : do ping test] ************************************************************************************************************************************* +2021-11-30 21:38:22,899 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:22,900 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:23,861 p=92310 u=rob n=ansible | network_os is set to vyos +2021-11-30 21:38:23,863 p=92309 u=rob n=ansible | network_os is set to vyos +2021-11-30 21:38:25,085 p=92318 u=rob n=p=92318 u=rob | paramiko [branch] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:38:25,085 p=92317 u=rob n=p=92317 u=rob | paramiko [central] | Connected (version 2.0, client OpenSSH_7.9p1) +2021-11-30 21:38:25,174 p=92318 u=rob n=p=92318 u=rob | paramiko [branch] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:38:25,175 p=92318 u=rob n=p=92318 u=rob | paramiko [branch] | Authentication (publickey) successful! +2021-11-30 21:38:25,176 p=92317 u=rob n=p=92317 u=rob | paramiko [central] | Auth banner: b'Welcome to VyOS\n\n' +2021-11-30 21:38:25,176 p=92317 u=rob n=p=92317 u=rob | paramiko [central] | Authentication (publickey) successful! +2021-11-30 21:38:31,822 p=91291 u=rob n=ansible | ok: [central] => (item=10.0.2.100) +2021-11-30 21:38:31,823 p=91291 u=rob n=ansible | ok: [branch] => (item=10.0.1.100) +2021-11-30 21:38:31,827 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : execute test commands] **************************************************************************************************************************** +2021-11-30 21:38:31,846 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:31,855 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:33,035 p=91291 u=rob n=ansible | ok: [central] => (item={'desc': 'Test if IP is set to interface', 'command': "ip -4 addr show dev eth2 | grep inet | tr -s ' ' | cut -d' ' -f3 | head -n 1", 'wait_for': ['result[0] contains "10.0.1.254/24"']}) +2021-11-30 21:38:33,213 p=91291 u=rob n=ansible | ok: [branch] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.2/24                    u/u  VPN-to-central"']}) +2021-11-30 21:38:33,515 p=91291 u=rob n=ansible | ok: [central] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.1/24                    u/u  VPN-to-Branch"']}) +2021-11-30 21:38:33,520 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : register stdout commands] ************************************************************************************************************************* +2021-11-30 21:38:33,547 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:33,548 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:34,881 p=91291 u=rob n=ansible | ok: [branch] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) +2021-11-30 21:38:34,882 p=91291 u=rob n=ansible | ok: [central] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'}) +2021-11-30 21:38:38,374 p=91291 u=rob n=ansible | ok: [central] => (item={'name': 'ping_branch_pc', 'command': 'ping 10.0.2.100 count 4'}) +2021-11-30 21:38:38,378 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] ************************************************************************************************************************************ +2021-11-30 21:38:38,396 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:38,403 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,272 p=91291 u=rob n=ansible | ok: [central] +2021-11-30 21:38:39,273 p=91291 u=rob n=ansible | ok: [branch] +2021-11-30 21:38:39,282 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : make sure tmp dir exist] ************************************************************************************************************************** +2021-11-30 21:38:39,311 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,322 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,322 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,328 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,332 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Download upgrade_iso] ***************************************************************************************************************************** +2021-11-30 21:38:39,352 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,360 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,361 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,365 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,370 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Copy iso to host] ********************************************************************************************************************************* +2021-11-30 21:38:39,383 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,392 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,393 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,396 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,399 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : upgrade vyos] ************************************************************************************************************************************* +2021-11-30 21:38:39,412 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,420 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,421 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,424 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,426 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Reboot vyos] ************************************************************************************************************************************** +2021-11-30 21:38:39,439 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,447 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,449 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,452 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,454 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : wait while shutdown] ****************************************************************************************************************************** +2021-11-30 21:38:39,462 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,463 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Wait for vyos nodes] ****************************************************************************************************************************** +2021-11-30 21:38:39,476 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,482 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,484 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,488 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,492 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : clear tmp dir] ************************************************************************************************************************************ +2021-11-30 21:38:39,499 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,501 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : wait, b/c the ping often failed without a short break] ******************************************************************************************** +2021-11-30 21:38:39,509 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,511 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : do ping test] ************************************************************************************************************************************* +2021-11-30 21:38:39,524 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,529 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,536 p=91291 u=rob n=ansible | skipping: [central] => (item=10.0.2.100)  +2021-11-30 21:38:39,540 p=91291 u=rob n=ansible | skipping: [branch] => (item=10.0.1.100)  +2021-11-30 21:38:39,543 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : execute test commands] **************************************************************************************************************************** +2021-11-30 21:38:39,557 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,563 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,571 p=91291 u=rob n=ansible | skipping: [central] => (item={'desc': 'Test if IP is set to interface', 'command': "ip -4 addr show dev eth2 | grep inet | tr -s ' ' | cut -d' ' -f3 | head -n 1", 'wait_for': ['result[0] contains "10.0.1.254/24"']})  +2021-11-30 21:38:39,571 p=91291 u=rob n=ansible | skipping: [central] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.1/24                    u/u  VPN-to-Branch"']})  +2021-11-30 21:38:39,575 p=91291 u=rob n=ansible | skipping: [branch] => (item={'desc': 'show interfaces wireguard', 'command': 'show interfaces wireguard', 'wait_for': ['result[0] contains "S - State, L - Link, u - Up, D - Down, A - Admin Down"', 'result[0] contains "Interface        IP Address                        S/L  Description"', 'result[0] contains "---------        ----------                        ---  -----------"', 'result[0] contains "wg01             192.168.0.2/24                    u/u  VPN-to-central"']})  +2021-11-30 21:38:39,578 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : register stdout commands] ************************************************************************************************************************* +2021-11-30 21:38:39,591 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,597 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,605 p=91291 u=rob n=ansible | skipping: [central] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'})  +2021-11-30 21:38:39,605 p=91291 u=rob n=ansible | skipping: [central] => (item={'name': 'ping_branch_pc', 'command': 'ping 10.0.2.100 count 4'})  +2021-11-30 21:38:39,608 p=91291 u=rob n=ansible | skipping: [branch] => (item={'name': 'show_interfaces_wireguard', 'command': 'show interfaces wireguard'})  +2021-11-30 21:38:39,611 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] ************************************************************************************************************************************ +2021-11-30 21:38:39,625 p=91291 u=rob n=ansible | skipping: [eveng] +2021-11-30 21:38:39,633 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,633 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,636 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,639 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : make sure output dir exist] *********************************************************************************************************************** +2021-11-30 21:38:39,661 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,661 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,666 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,835 p=91291 u=rob n=ansible | ok: [eveng -> localhost] +2021-11-30 21:38:39,838 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : make sure output include dir exist] *************************************************************************************************************** +2021-11-30 21:38:39,861 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,862 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,866 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:39,967 p=91291 u=rob n=ansible | ok: [eveng -> localhost] +2021-11-30 21:38:39,969 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Get timestamp from the system] ******************************************************************************************************************** +2021-11-30 21:38:39,990 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:39,991 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:39,995 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:40,525 p=91291 u=rob n=ansible | changed: [eveng] +2021-11-30 21:38:40,529 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : Set variables] ************************************************************************************************************************************ +2021-11-30 21:38:40,553 p=91291 u=rob n=ansible | ok: [eveng] +2021-11-30 21:38:40,555 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:40,555 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:40,559 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:40,562 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : generate lab rst file] **************************************************************************************************************************** +2021-11-30 21:38:40,587 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:40,588 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:40,592 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:40,808 p=91291 u=rob n=ansible | changed: [eveng -> localhost] +2021-11-30 21:38:40,811 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : find all *.conf files in Lab] ********************************************************************************************************************* +2021-11-30 21:38:40,834 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:40,835 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:40,839 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:41,002 p=91291 u=rob n=ansible | ok: [eveng -> localhost] +2021-11-30 21:38:41,010 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : copy all *.conf files] **************************************************************************************************************************** +2021-11-30 21:38:41,038 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:41,039 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:41,045 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:41,253 p=91291 u=rob n=ansible | changed: [eveng -> localhost] => (item={'path': 'labs/Wireguard/branch.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 675, 'inode': 33278983, 'dev': 16777233, 'nlink': 1, 'atime': 1638304349.8431501, 'mtime': 1638304348.138039, 'ctime': 1638304348.138039, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) +2021-11-30 21:38:41,469 p=91291 u=rob n=ansible | changed: [eveng -> localhost] => (item={'path': 'labs/Wireguard/central.conf', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 668, 'inode': 33278984, 'dev': 16777233, 'nlink': 1, 'atime': 1638304349.7118278, 'mtime': 1638304348.1385467, 'ctime': 1638304348.1385467, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) +2021-11-30 21:38:41,474 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : find all *.png files in Lab] ********************************************************************************************************************** +2021-11-30 21:38:41,498 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:41,499 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:41,504 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:41,599 p=91291 u=rob n=ansible | ok: [eveng -> localhost] +2021-11-30 21:38:41,604 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : copy all *.png files] ***************************************************************************************************************************** +2021-11-30 21:38:41,630 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:41,631 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:41,637 p=91291 u=rob n=ansible | skipping: [branch] +2021-11-30 21:38:41,889 p=91291 u=rob n=ansible | ok: [eveng -> localhost] => (item={'path': 'labs/Wireguard/topology.png', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 501, 'gid': 20, 'size': 158227, 'inode': 31651192, 'dev': 16777233, 'nlink': 1, 'atime': 1637677693.6729753, 'mtime': 1637092135.8691404, 'ctime': 1637092174.4312608, 'gr_name': 'staff', 'pw_name': 'rob', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) +2021-11-30 21:38:41,894 p=91291 u=rob n=ansible | TASK [eve-ng-lab-test : copy ansible log files] *************************************************************************************************************************** +2021-11-30 21:38:41,917 p=91291 u=rob n=ansible | skipping: [vyos-oobm] +2021-11-30 21:38:41,918 p=91291 u=rob n=ansible | skipping: [central] +2021-11-30 21:38:41,922 p=91291 u=rob n=ansible | skipping: [branch] diff --git a/docs/configexamples/autotest/Wireguard/Wireguard.rst b/docs/configexamples/autotest/Wireguard/Wireguard.rst index ce5a493f..73539e2f 100644 --- a/docs/configexamples/autotest/Wireguard/Wireguard.rst +++ b/docs/configexamples/autotest/Wireguard/Wireguard.rst @@ -3,8 +3,8 @@ Wireguard  ######### -| Testdate: 2021-11-23 -| Version: 1.4-rolling-202106170808 +| Testdate: 2021-11-30 +| Version: 1.4-rolling-202104132216  This simple structure show how to connect two offices. One remote branch and the @@ -46,7 +46,7 @@ After this, the public key can be displayed, to save for later.     vyos@central:~$ generate wireguard default-keypair     vyos@central:~$ show wireguard keypairs pubkey default -   +mLLOGxR37k3EsWba7+G7vIDq6yW4t0s549rNVShWy4= +   P9y9TTRzIOVl27Ij9n/BXjZUdQFADZ5WnHV0kQr1ulQ=  After you have each public key. The wireguard interfaces can be setup. @@ -65,6 +65,20 @@ Branch     :lines: 4-11 +To reach the network, a route must be set on each VyOS host. +In this structure, a static interface route will fit the requirements. + +Central + +.. literalinclude:: _include/central.conf +   :language: none +   :lines: 13 + +Branch + +.. literalinclude:: _include/branch.conf +   :language: none +   :lines: 13  *********************  Testing and debugging @@ -88,11 +102,11 @@ And ping the Branch PC from your central router to check the response.     vyos@central:~$ ping 10.0.2.100 count 4     PING 10.0.2.100 (10.0.2.100) 56(84) bytes of data. -   64 bytes from 10.0.2.100: icmp_seq=1 ttl=63 time=0.609 ms -   64 bytes from 10.0.2.100: icmp_seq=2 ttl=63 time=0.871 ms -   64 bytes from 10.0.2.100: icmp_seq=3 ttl=63 time=0.937 ms -   64 bytes from 10.0.2.100: icmp_seq=4 ttl=63 time=0.746 ms +   64 bytes from 10.0.2.100: icmp_seq=1 ttl=63 time=0.526 ms +   64 bytes from 10.0.2.100: icmp_seq=2 ttl=63 time=0.583 ms +   64 bytes from 10.0.2.100: icmp_seq=3 ttl=63 time=0.873 ms +   64 bytes from 10.0.2.100: icmp_seq=4 ttl=63 time=0.753 ms     --- 10.0.2.100 ping statistics --- -   4 packets transmitted, 4 received, 0% packet loss, time 4ms -   rtt min/avg/max/mdev = 0.609/0.790/0.937/0.130 ms +   4 packets transmitted, 4 received, 0% packet loss, time 48ms +   rtt min/avg/max/mdev = 0.526/0.683/0.873/0.141 ms diff --git a/docs/configexamples/autotest/Wireguard/_include/branch.conf b/docs/configexamples/autotest/Wireguard/_include/branch.conf index 7c96df4b..3faea398 100644 --- a/docs/configexamples/autotest/Wireguard/_include/branch.conf +++ b/docs/configexamples/autotest/Wireguard/_include/branch.conf @@ -7,7 +7,7 @@ set interfaces wireguard wg01 peer central allowed-ips 10.0.1.0/24  set interfaces wireguard wg01 peer central allowed-ips 192.168.0.0/24  set interfaces wireguard wg01 peer central address 198.51.100.1  set interfaces wireguard wg01 peer central port 51820 -set interfaces wireguard wg01 peer central pubkey "+mLLOGxR37k3EsWba7+G7vIDq6yW4t0s549rNVShWy4=" +set interfaces wireguard wg01 peer central pubkey "P9y9TTRzIOVl27Ij9n/BXjZUdQFADZ5WnHV0kQr1ulQ="  set interfaces wireguard wg01 port 51820  set protocols static route 10.0.1.0/24 interface wg01
\ No newline at end of file diff --git a/docs/configexamples/autotest/Wireguard/_include/central.conf b/docs/configexamples/autotest/Wireguard/_include/central.conf index 1414621b..99041d89 100644 --- a/docs/configexamples/autotest/Wireguard/_include/central.conf +++ b/docs/configexamples/autotest/Wireguard/_include/central.conf @@ -7,7 +7,7 @@ set interfaces wireguard wg01 peer branch allowed-ips 10.0.2.0/24  set interfaces wireguard wg01 peer branch allowed-ips 192.168.0.0/24  set interfaces wireguard wg01 peer branch address 198.51.100.2  set interfaces wireguard wg01 peer branch port 51820 -set interfaces wireguard wg01 peer branch pubkey "HF1LJSEgAtknAtkqK2d12DzfuPlx475Y+I4SpJiBWzs=" +set interfaces wireguard wg01 peer branch pubkey "iUUItk5zA22azMltN+Kpp7Bh4g2mf1ea3liSEp9eQEs="  set interfaces wireguard wg01 port 51820  set protocols static route 10.0.2.0/24 interface wg01
\ No newline at end of file diff --git a/docs/configexamples/index.rst b/docs/configexamples/index.rst index b1f34801..3a3c2849 100644 --- a/docs/configexamples/index.rst +++ b/docs/configexamples/index.rst @@ -18,6 +18,7 @@ This chapter contains various configuration examples:     ha     wan-load-balancing     pppoe-ipv6-basic +   l3vpn-hub-and-spoke  Configuration Blueprints (autotest) @@ -45,4 +46,4 @@ The process will do the following steps:     :maxdepth: 1     autotest/L3VPN_EVPN/L3VPN_EVPN -   autotest/Wireguard/Wireguard
\ No newline at end of file +   autotest/Wireguard/Wireguard diff --git a/docs/configexamples/l3vpn-hub-and-spoke.rst b/docs/configexamples/l3vpn-hub-and-spoke.rst new file mode 100644 index 00000000..ad85ef0e --- /dev/null +++ b/docs/configexamples/l3vpn-hub-and-spoke.rst @@ -0,0 +1,1130 @@ + +############################################## +L3VPN for Hub-and-Spoke connectivity with VyOS +############################################## + +IP/MPLS technology is widely used by various service providers and large  +enterprises in order to achieve better network scalability, manageability  +and flexibility. It also provides the possibility to deliver different  +services for the customers in a seamless manner.  +Layer 3 VPN (L3VPN) is a type of VPN mode that is built and delivered  +through OSI layer 3 networking technologies. Often the border gateway  +protocol (BGP) is used to send and receive VPN-related data that is  +responsible for the control plane. L3VPN utilizes virtual routing and  +forwarding (VRF) techniques to receive and deliver user data as well as  +separate data planes of the end-users. It is built using a combination of  +IP- and MPLS-based information. Generally, L3VPNs are used to send data  +on back-end VPN infrastructures, such as for VPN connections between data  +centres, HQs and branches. + +An L3VPN consists of multiple access links, multiple VPN routing and  +forwarding (VRF) tables, and multiple MPLS paths or multiple P2MP LSPs.  +An L3VPN can be configured to connect two or more customer sites. +In hub-and-spoke MPLS L3VPN environments, the spoke routers need to have  +unique Route Distinguishers (RDs). In order to use the hub site as a  +transit point for connectivity in such an environment, the spoke sites  +export their routes to the hub. Spokes can talk to hubs, but never have  +direct paths to other spokes. All traffic between spokes is controlled  +and delivered over the hub site. + + +To deploy a Layer3 VPN with MPLS on VyOS, we should meet a couple  +requirements in order to properly implement the solution.  +We'll use the following nodes in our LAB environment: + +* 2 x Route reflectors (VyOS-RRx) +* 4 x Provider routers (VyOS-Px) +* 3 x Provider Edge (VyOs-PEx) +* 3 x Customer Edge (VyOS-CEx) + +The following software was used in the creation of this document: + +* Operating system: VyOS +* Version: 1.4-rolling-202110310317 +* Image name: vyos-1.4-rolling-202110310317-amd64.iso + +**NOTE:** VyOS Router (tested with VyOS 1.4-rolling-202110310317)  +–  The configurations below are specifically for VyOS 1.4.x. + +General information can be found in the :ref:`l3vpn-vrfs` chapter. + + + +******** +Topology +******** +.. image:: /_static/images/L3VPN_hub_and_spoke.png +   :width: 80% +   :align: center +   :alt: Network Topology Diagram + + + +***************** +How does it work? +***************** + +As we know the main assumption of L3VPN “Hub and Spoke” is, that the traffic  +between spokes have to pass via hub, in our scenario VyOS-PE2 is the Hub PE  +and the VyOS-CE1-HUB is the central customer office device that is responsible  +for controlling access between all spokes and announcing its network prefixes  +(10.0.0.100/32). VyOS-PE2 has the main VRF (its name is BLUE_HUB), its  +own Route-Distinguisher(RD) and route-target import/export lists.  +Multiprotocol-BGP(MP-BGP) delivers L3VPN related control-plane information to  +the nodes across network where PEs Spokes import the route-target 60535:1030  +(this is export route-target of vrf BLUE_HUB) and export its own route-target  +60535:1011(this is vrf BLUE_SPOKE export route-target). Therefore, the  +Customer edge nodes can only learn the network prefixes of the HUB site  +[10.0.0.100/32]. For this example VyOS-CE1 has network prefixes  +[10.0.0.80/32] / VyOS-CE2 has network prefixes [10.0.0.90/32].  +Route-Reflector devices VyOS-RR1 and VyOS-RR2 are used to simplify network  +routes exchange and minimize iBGP peerings between devices. + +L3VPN configuration parameters table: + ++----------+-------+------------+-----------------+-------------+-------------+ +|   Node   |  Role |     VRF    |        RD       |  RT import  |  RT export  | ++----------+-------+------------+-----------------+-------------+-------------+ +| VyOS-PE2 | Hub   | BLUE_HUB   | 10.80.80.1:1011 | 65035:1011  | 65035:1030  | +|          |       |            |                 | 65035:1030  |             | ++----------+-------+------------+-----------------+-------------+-------------+ +| VyOS-PE1 | Spoke | BLUE_SPOKE | 10.50.50.1:1011 | 65035:1030  | 65035:1011  | ++----------+-------+------------+-----------------+-------------+-------------+ +| VyOS-PE3 | Spoke | BLUE_SPOKE | 10.60.60.1:1011 | 65035:1030  | 65035:1011  | ++----------+-------+------------+-----------------+-------------+-------------+ + + + +************* +Configuration +************* + + + +Step-1: Configuring IGP and enabling MPLS LDP +============================================= + +At the first step we need to configure the IP/MPLS backbone network using OSPF as  +IGP protocol and LDP as label-switching protocol for the base connectivity between  +**P** (rovider), **P** (rovider) **E** (dge) and **R** (oute) **R** (eflector) nodes: + +- VyOS-P1: + +.. code-block:: none +    +   # interfaces  +   set interfaces dummy dum10 address '10.0.0.3/32' +   set interfaces ethernet eth0 address '172.16.30.1/24' +   set interfaces ethernet eth1 address '172.16.40.1/24' +   set interfaces ethernet eth2 address '172.16.90.1/24' +   set interfaces ethernet eth3 address '172.16.10.1/24' +   set interfaces ethernet eth5 address '172.16.100.1/24' +    +   # protocols ospf+ldp +   set protocols mpls interface 'eth1' +   set protocols mpls interface 'eth2' +   set protocols mpls interface 'eth3' +   set protocols mpls interface 'eth5' +   set protocols mpls interface 'eth0' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.3' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth2' +   set protocols mpls ldp interface 'eth3' +   set protocols mpls ldp interface 'eth5' +   set protocols mpls ldp router-id '10.0.0.3' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.3 + + +- VyOS-P2: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.4/32' +   set interfaces ethernet eth0 address '172.16.30.2/24' +   set interfaces ethernet eth1 address '172.16.20.1/24' +   set interfaces ethernet eth2 address '172.16.120.1/24' +   set interfaces ethernet eth3 address '172.16.60.1/24' +    +   # protocols ospf+ldp +   set protocols mpls interface 'eth1' +   set protocols mpls interface 'eth2' +   set protocols mpls interface 'eth3' +   set protocols mpls interface 'eth0' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.4' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth2' +   set protocols mpls ldp interface 'eth3' +   set protocols mpls ldp router-id '10.0.0.4' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.4' + +- VyOS-P3: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.5/32' +   set interfaces ethernet eth0 address '172.16.110.1/24' +   set interfaces ethernet eth1 address '172.16.40.2/24' +   set interfaces ethernet eth2 address '172.16.50.1/24' +   set interfaces ethernet eth3 address '172.16.70.1/24' +    +   # protocols ospf + ldp +   set protocols mpls interface 'eth1' +   set protocols mpls interface 'eth2' +   set protocols mpls interface 'eth3' +   set protocols mpls interface 'eth0' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.5' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth2' +   set protocols mpls ldp interface 'eth3' +   set protocols mpls ldp router-id '10.0.0.5' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.5' + +- VyOS-P4: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.6/32' +   set interfaces ethernet eth0 address '172.16.80.2/24' +   set interfaces ethernet eth1 address '172.16.130.1/24' +   set interfaces ethernet eth2 address '172.16.50.2/24' +   set interfaces ethernet eth3 address '172.16.60.2/24' +   set interfaces ethernet eth5 address '172.16.140.1/24' +    +    +   # protocols ospf + ldp +   set protocols mpls interface 'eth1' +   set protocols mpls interface 'eth2' +   set protocols mpls interface 'eth3' +   set protocols mpls interface 'eth0' +   set protocols mpls interface 'eth5' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.6' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth2' +   set protocols mpls ldp interface 'eth3' +   set protocols mpls ldp interface 'eth5' +   set protocols mpls ldp router-id '10.0.0.6' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.6' + +- VyOS-PE1: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.7/32' +   set interfaces ethernet eth0 address '172.16.90.2/24' +    +   # protocols  ospf + ldp  +   set protocols mpls interface 'eth0' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.7' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp router-id '10.0.0.7' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.7' + +- VyOS-PE2: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.8/32' +   set interfaces ethernet eth0 address '172.16.110.2/24' +   set interfaces ethernet eth1 address '172.16.100.2/24' +   set interfaces ethernet eth2 address '172.16.80.1/24' +    +   # protocols  ospf + ldp  +   set protocols mpls interface 'eth0' +   set protocols mpls interface 'eth1' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.8' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp router-id '10.0.0.8' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.8' + +- VyOS-PE3: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum10 address '10.0.0.10/32' +   set interfaces ethernet eth0 address '172.16.140.2/24' +    +   # protocols ospf + ldp +   set protocols mpls interface 'eth0' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.10' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp router-id '10.0.0.10' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.10' + +- VyOS-RR1: + +.. code-block:: none +    +   # interfaces +   set interfaces ethernet eth1 address '172.16.20.2/24' +   set interfaces ethernet eth2 address '172.16.10.2/24' +   set interfaces dummy dum10 address '10.0.0.1/32' +    +   # protocols ospf + ldp +   set protocols mpls interface 'eth1' +   set protocols mpls interface 'eth2' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.1' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth2' +   set protocols mpls ldp router-id '10.0.0.1' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.1' + +- VyOS-RR2: + +.. code-block:: none +    +   # interfaces +   set interfaces ethernet eth0 address '172.16.80.1/24' +   set interfaces ethernet eth1 address '172.16.70.2/24' +   set interfaces dummy dum10 address '10.0.0.2/32' +    +   # protocols ospf + ldp +   set protocols mpls interface 'eth0' +   set protocols mpls interface 'eth1' +   set protocols mpls ldp discovery transport-ipv4-address '10.0.0.2' +   set protocols mpls ldp interface 'eth1' +   set protocols mpls ldp interface 'eth0' +   set protocols mpls ldp router-id '10.0.0.2' +   set protocols ospf area 0 network '0.0.0.0/0' +   set protocols ospf parameters abr-type 'cisco' +   set protocols ospf parameters router-id '10.0.0.2' + + + +Step-2: Configuring iBGP for L3VPN control-plane  +================================================ + +At this step we are going to enable iBGP protocol on MPLS nodes and  +Route Reflectors (two routers for redundancy) that will deliver IPv4  +VPN (L3VPN) routes between them: + +- VyOS-RR1: + +.. code-block:: none +    +   set protocols bgp local-as '65001' +   set protocols bgp neighbor 10.0.0.7 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.7 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.8 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.8 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.9 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.9 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.10 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.10 peer-group 'RR_VPNv4' +   set protocols bgp parameters cluster-id '10.0.0.1' +   set protocols bgp parameters default no-ipv4-unicast +   set protocols bgp parameters log-neighbor-changes +   set protocols bgp parameters router-id '10.0.0.1' +   set protocols bgp peer-group RR_VPNv4 remote-as '65001' +   set protocols bgp peer-group RR_VPNv4 update-source 'dum10' + +- VyOS-RR2: + +.. code-block:: none +    +   set protocols bgp local-as '65001' +   set protocols bgp neighbor 10.0.0.7 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.7 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.8 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.8 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.9 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.9 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.10 address-family ipv4-vpn route-reflector-client +   set protocols bgp neighbor 10.0.0.10 peer-group 'RR_VPNv4' +   set protocols bgp parameters cluster-id '10.0.0.1' +   set protocols bgp parameters default no-ipv4-unicast +   set protocols bgp parameters log-neighbor-changes +   set protocols bgp parameters router-id '10.0.0.2' +   set protocols bgp peer-group RR_VPNv4 remote-as '65001' +   set protocols bgp peer-group RR_VPNv4 update-source 'dum10' + +- VyOS-PE1: + +.. code-block:: none +    +   set protocols bgp local-as '65001' +   set protocols bgp neighbor 10.0.0.1 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.1 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.2 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.2 peer-group 'RR_VPNv4' +   set protocols bgp parameters default no-ipv4-unicast +   set protocols bgp parameters log-neighbor-changes +   set protocols bgp parameters router-id '10.0.0.7' +   set protocols bgp peer-group RR_VPNv4 remote-as '65001' +   set protocols bgp peer-group RR_VPNv4 update-source 'dum10' + +- VyOS-PE2: + +.. code-block:: none +    +   set protocols bgp local-as '65001' +   set protocols bgp neighbor 10.0.0.1 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.1 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.2 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.2 peer-group 'RR_VPNv4' +   set protocols bgp parameters default no-ipv4-unicast +   set protocols bgp parameters log-neighbor-changes +   set protocols bgp parameters router-id '10.0.0.8' +   set protocols bgp peer-group RR_VPNv4 remote-as '65001' +   set protocols bgp peer-group RR_VPNv4 update-source 'dum10' + +- VyOS-PE3: + +.. code-block:: none +    +   set protocols bgp local-as '65001' +   set protocols bgp neighbor 10.0.0.1 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.1 peer-group 'RR_VPNv4' +   set protocols bgp neighbor 10.0.0.2 address-family ipv4-vpn nexthop-self +   set protocols bgp neighbor 10.0.0.2 peer-group 'RR_VPNv4' +   set protocols bgp parameters default no-ipv4-unicast +   set protocols bgp parameters log-neighbor-changes +   set protocols bgp parameters router-id '10.0.0.10' +   set protocols bgp peer-group RR_VPNv4 remote-as '65001' +   set protocols bgp peer-group RR_VPNv4 update-source 'dum10' + + + +Step-3: Configuring L3VPN VRFs on PE nodes +========================================== + +This section provides configuration steps for setting up VRFs on our  +PE nodes including CE facing interfaces, BGP, rd and route-target  +import/export based on the pre-defined parameters. + +- VyOS-PE1: + +.. code-block:: none +    +   # VRF settings +   set vrf name BLUE_SPOKE table '200' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast export vpn +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast import vpn +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast label vpn export 'auto' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast network 10.50.50.0/24 +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast rd vpn export '10.50.50.1:1011' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast redistribute connected +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast route-target vpn export '65035:1011' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast route-target vpn import '65035:1030' +   set vrf name BLUE_SPOKE protocols bgp local-as '65001' +   set vrf name BLUE_SPOKE protocols bgp neighbor 10.50.50.2 address-family ipv4-unicast as-override +   set vrf name BLUE_SPOKE protocols bgp neighbor 10.50.50.2 remote-as '65035' +    +   # interfaces +   set interfaces ethernet eth3 address '10.50.50.1/24' +   set interfaces ethernet eth3 vrf 'BLUE_SPOKE' + +- VyOS-PE2: + +.. code-block:: none +    +   # VRF settings  +   set vrf name BLUE_HUB table '400' +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast export vpn +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast import vpn +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast label vpn export 'auto' +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast network 10.80.80.0/24 +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast rd vpn export '10.80.80.1:1011' +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast redistribute connected +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast route-target vpn export '65035:1030' +   set vrf name BLUE_HUB protocols bgp address-family ipv4-unicast route-target vpn import '65035:1011 65050:2011 65035:1030' +   set vrf name BLUE_HUB protocols bgp local-as '65001' +   set vrf name BLUE_HUB protocols bgp neighbor 10.80.80.2 address-family ipv4-unicast as-override +   set vrf name BLUE_HUB protocols bgp neighbor 10.80.80.2 remote-as '65035' +    +   # interfaces +   set interfaces ethernet eth3 address '10.80.80.1/24' +   set interfaces ethernet eth3 vrf 'BLUE_HUB' + +- VyOS-PE3: + +.. code-block:: none +    +   # VRF settings +   set vrf name BLUE_SPOKE table '200' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast export vpn +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast import vpn +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast label vpn export 'auto' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast network 10.60.60.0/24 +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast rd vpn export '10.60.60.1:1011' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast redistribute connected +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast route-target vpn export '65035:1011' +   set vrf name BLUE_SPOKE protocols bgp address-family ipv4-unicast route-target vpn import '65035:1030' +   set vrf name BLUE_SPOKE protocols bgp local-as '65001' +   set vrf name BLUE_SPOKE protocols bgp neighbor 10.60.60.2 address-family ipv4-unicast as-override +   set vrf name BLUE_SPOKE protocols bgp neighbor 10.60.60.2 remote-as '65035' +    +   # interfaces +   set interfaces ethernet eth3 address '10.60.60.1/24' +   set interfaces ethernet eth3 vrf 'BLUE_SPOKE' + + + +Step-4: Configuring CE nodes +============================ + +Dynamic routing used between CE and PE nodes and eBGP peering  +established for the route exchanging between them. All routes  +received by PEs are then exported to L3VPN and delivered from  +Spoke sites to Hub and vise-versa based on previously  +configured L3VPN parameters. + +- VyOS-CE1-SPOKE: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum20 address '10.0.0.80/32' +   set interfaces ethernet eth0 address '10.50.50.2/24' +    +   # BGP for peering with PE +   set protocols bgp 65035 address-family ipv4-unicast network 10.0.0.80/32 +   set protocols bgp 65035 neighbor 10.50.50.1 ebgp-multihop '2' +   set protocols bgp 65035 neighbor 10.50.50.1 remote-as '65001' +   set protocols bgp 65035 neighbor 10.50.50.1 update-source 'eth0' +   set protocols bgp 65035 parameters default no-ipv4-unicast +   set protocols bgp 65035 parameters log-neighbor-changes +   set protocols bgp 65035 parameters router-id '10.50.50.2' + +- VyOS-CE1-HUB: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum20 address '10.0.0.100/32' +   set interfaces ethernet eth0 address '10.80.80.2/24' +    +   # BGP for peering with PE +   set protocols bgp 65035 address-family ipv4-unicast network 10.0.0.100/32 +   set protocols bgp 65035 address-family ipv4-unicast redistribute connected +   set protocols bgp 65035 neighbor 10.80.80.1 ebgp-multihop '2' +   set protocols bgp 65035 neighbor 10.80.80.1 remote-as '65001' +   set protocols bgp 65035 neighbor 10.80.80.1 update-source 'eth0' +   set protocols bgp 65035 parameters default no-ipv4-unicast +   set protocols bgp 65035 parameters log-neighbor-changes +   set protocols bgp 65035 parameters router-id '10.80.80.2' + +- VyOS-CE2-SPOKE: + +.. code-block:: none +    +   # interfaces +   set interfaces dummy dum20 address '10.0.0.90/32' +   set interfaces ethernet eth0 address '10.60.60.2/24' +    +   # BGP for peering with PE  +   set protocols bgp 65035 address-family ipv4-unicast network 10.0.0.90/32 +   set protocols bgp 65035 neighbor 10.60.60.1 ebgp-multihop '2' +   set protocols bgp 65035 neighbor 10.60.60.1 remote-as '65001' +   set protocols bgp 65035 neighbor 10.60.60.1 update-source 'eth0' +   set protocols bgp 65035 parameters default no-ipv4-unicast +   set protocols bgp 65035 parameters log-neighbor-changes +   set protocols bgp 65035 parameters router-id '10.60.60.2' + + + +Step-5: Verification +==================== + +This section describes verification commands for MPLS/BGP/LDP  +protocols and L3VPN related routes as well as diagnosis and  +reachability checks between CE nodes. + +Let’s check IPv4 routing and MPLS information on provider nodes  +(same procedure for all P nodes): + +- “show ip ospf neighbor” for checking ospf relationship + +.. code-block:: none +    +   vyos@VyOS-P1:~$  show ip ospf neighbor +    +   Neighbor ID 	Pri State       	Dead Time Address     	Interface            RXmtL RqstL DBsmL +   10.0.0.4       	1 Full/Backup   	34.718s   172.16.30.2 	eth0:172.16.30.1       0 	  0 	  0 +   10.0.0.5       	1 Full/Backup   	35.132s   172.16.40.2 	eth1:172.16.40.1       0 	  0 	  0 +   10.0.0.7       	1 Full/Backup   	34.764s   172.16.90.2 	eth2:172.16.90.1       0 	  0 	  0 +   10.0.0.1       	1 Full/Backup   	35.642s   172.16.10.2 	eth3:172.16.10.1       0 	  0 	  0 +   10.0.0.8       	1 Full/Backup   	35.484s   172.16.100.2	eth5:172.16.100.1      0 	  0     0 + +- “show mpls ldp neighbor “ for checking ldp neighbors + +.. code-block:: none +    +   vyos@VyOS-P1:~$ show mpls ldp neighbor +   AF   ID          	State   	   Remote Address	Uptime +   ipv4 10.0.0.1     	OPERATIONAL 10.0.0.1     	07w5d06h +   ipv4 10.0.0.4     	OPERATIONAL 10.0.0.4     	09w3d00h +   ipv4 10.0.0.5     	OPERATIONAL 10.0.0.5     	09w2d23h +   ipv4 10.0.0.7     	OPERATIONAL 10.0.0.7     	03w0d01h +   ipv4 10.0.0.8     	OPERATIONAL 10.0.0.8     	01w3d02h + +- “show mpls ldp binding” for checking mpls label assignment + +.. code-block:: none +    +   vyos@VyOS-P1:~$ show mpls ldp discovery +   AF   Destination      	Nexthop     	Local    Label Remote Label  In Use +   ipv4 10.0.0.1/32       	10.0.0.1     	23      	      imp-null     	yes +   ipv4 10.0.0.1/32       	10.0.0.4     	23      	      20            	no +   ipv4 10.0.0.1/32       	10.0.0.5     	23      	      17            	no +   ipv4 10.0.0.1/32       	10.0.0.7     	23      	      16            	no +   ipv4 10.0.0.1/32       	10.0.0.8     	23      	      16            	no +   ipv4 10.0.0.2/32       	10.0.0.1     	20      	      16            	no +   ipv4 10.0.0.2/32       	10.0.0.4     	20      	      22            	no +   ipv4 10.0.0.2/32       	10.0.0.5     	20      	      24           	yes +   ipv4 10.0.0.2/32       	10.0.0.7     	20      	      17            	no +   ipv4 10.0.0.2/32       	10.0.0.8     	20      	      17            	no +   ipv4 10.0.0.3/32       	10.0.0.1     	imp-null	      17            	no +   ipv4 10.0.0.3/32       	10.0.0.4     	imp-null	      16            	no +   ipv4 10.0.0.3/32       	10.0.0.5     	imp-null	      18            	no +   ipv4 10.0.0.3/32       	10.0.0.7     	imp-null	      18            	no +   ipv4 10.0.0.3/32       	10.0.0.8     	imp-null	      18            	no +   ipv4 10.0.0.4/32       	10.0.0.1     	16      	      18            	no +   ipv4 10.0.0.4/32       	10.0.0.4     	16      	      imp-null     	yes +   ipv4 10.0.0.4/32       	10.0.0.5     	16      	      19            	no +   ipv4 10.0.0.4/32       	10.0.0.7     	16      	      19            	no +   ipv4 10.0.0.4/32       	10.0.0.8     	16      	      19            	no +   ipv4 10.0.0.5/32       	10.0.0.1     	21      	      19            	no +   ipv4 10.0.0.5/32       	10.0.0.4     	21      	      17            	no +   ipv4 10.0.0.5/32       	10.0.0.5     	21      	      imp-null     	yes +   ipv4 10.0.0.5/32       	10.0.0.7     	21      	      20            	no +   ipv4 10.0.0.5/32       	10.0.0.8     	21      	      20            	no +   ipv4 10.0.0.6/32       	10.0.0.1     	17      	      20            	no +   ipv4 10.0.0.6/32       	10.0.0.4     	17      	      23           	yes +   ipv4 10.0.0.6/32       	10.0.0.5     	17      	      21           	yes +   ipv4 10.0.0.6/32       	10.0.0.7     	17      	      21            	no +   ipv4 10.0.0.6/32       	10.0.0.8     	17      	      21            	no +   ipv4 10.0.0.7/32       	10.0.0.1     	22      	      21            	no +   ipv4 10.0.0.7/32       	10.0.0.4     	22      	      18            	no +   ipv4 10.0.0.7/32       	10.0.0.5     	22      	      20            	no +   ipv4 10.0.0.7/32       	10.0.0.7     	22      	      imp-null     	yes +   ipv4 10.0.0.7/32       	10.0.0.8     	22      	      22            	no +   ipv4 10.0.0.8/32       	10.0.0.1     	24      	      22            	no +   ipv4 10.0.0.8/32       	10.0.0.4     	24      	      19            	no +   ipv4 10.0.0.8/32       	10.0.0.5     	24      	      16            	no +   ipv4 10.0.0.8/32       	10.0.0.7     	24      	      22            	no +   ipv4 10.0.0.8/32       	10.0.0.8     	24      	      imp-null     	yes +   ipv4 10.0.0.9/32       	10.0.0.1     	18      	      23            	no +   ipv4 10.0.0.9/32       	10.0.0.4     	18      	      21           	yes +   ipv4 10.0.0.9/32       	10.0.0.5     	18      	      22            	no +   ipv4 10.0.0.9/32       	10.0.0.7     	18      	      23            	no +   ipv4 10.0.0.9/32       	10.0.0.8     	18      	      23            	no +   ipv4 10.0.0.10/32   	10.0.0.1     	19      	      24            	no +   ipv4 10.0.0.10/32   	10.0.0.4     	19      	      24           	yes +   ipv4 10.0.0.10/32   	10.0.0.5     	19      	      23           	yes +   ipv4 10.0.0.10/32   	10.0.0.7     	19      	      24            	no +   ipv4 10.0.0.10/32   	10.0.0.8     	19      	      24            	no +    +Now we’re checking iBGP status and routes from route-reflector  +nodes to other devices: + +- “show bgp ipv4 vpn summary” for checking BGP VPNv4 neighbors: + +.. code-block:: none +    +   vyos@VyOS-RR1:~$ show bgp ipv4 vpn summary +   BGP router identifier 10.0.0.1, local AS number 65001 vrf-id 0 +   BGP table version 0 +   RIB entries 9, using 1728 bytes of memory +   Peers 4, using 85 KiB of memory +   Peer groups 1, using 64 bytes of memory +    +   Neighbor    	V     	AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt +   10.0.0.7     	4  	65001  	7719  	7733    	      0	   0	0   5d07h56m        	2   	10 +   10.0.0.8     	4  	65001  	7715  	7724    	      0	   0	0   5d08h28m        	4   	10 +   10.0.0.9     	4  	65001  	7713  	7724    	      0	   0	0   5d08h28m        	2   	10 +   10.0.0.10 	4  	65001  	7713  	7724    	      0	   0	0   5d08h28m        	2   	10 +    +   Total number of neighbors 4 + +- “show bgp ipv4 vpn”  for checking all VPNv4 prefixes information:  + +.. code-block:: none +    +   vyos@VyOS-RR1:~$ show bgp ipv4 vpn +   BGP table version is 2, local router ID is 10.0.0.1, vrf id 0 +   Default local pref 100, local AS 65001 +   Status codes:  s suppressed, d damped, h history, * valid, > best, = multipath, +              	i internal, r RIB-failure, S Stale, R Removed +   Nexthop codes: @NNN nexthop's vrf id, < announce-nh-self +   Origin codes:  i - IGP, e - EGP, ? - incomplete +    +      Network      	Next Hop        	Metric LocPrf Weight Path +   Route Distinguisher: 10.50.50.1:1011 +   *>i10.50.50.0/24	10.0.0.7              	0	100  	0 i +   	UN=10.0.0.7 EC{65035:1011} label=80 type=bgp, subtype=0 +   *>i80.80.80.80/32   10.0.0.7              	0	100  	0 65035 i +   	UN=10.0.0.7 EC{65035:1011} label=80 type=bgp, subtype=0 +   Route Distinguisher: 10.60.60.1:1011 +   *>i10.60.60.0/24	10.0.0.10          	0	100  	0 i +   	UN=10.0.0.10 EC{65035:1011} label=80 type=bgp, subtype=0 +   *>i90.90.90.90/32   10.0.0.10          	0	100  	0 65035 i +   	UN=10.0.0.10 EC{65035:1011} label=80 type=bgp, subtype=0 +   Route Distinguisher: 10.80.80.1:1011 +   *>i10.80.80.0/24	10.0.0.8              	0	100  	0 i +   	UN=10.0.0.8 EC{65035:1030} label=80 type=bgp, subtype=0 +   *>i100.100.100.100/32 +                   	10.0.0.8              	0	100  	0 65035 i +   	UN=10.0.0.8 EC{65035:1030} label=80 type=bgp, subtype=0 +   Route Distinguisher: 172.16.80.1:2011 +   *>i10.110.110.0/24  10.0.0.8              	0	100  	0 65050 i +   	UN=10.0.0.8 EC{65050:2011} label=81 type=bgp, subtype=0 +   *>i172.16.80.0/24   10.0.0.8              	0	100  	0 i +   	UN=10.0.0.8 EC{65050:2011} label=81 type=bgp, subtype=0 +   Route Distinguisher: 172.16.100.1:2011 +   *>i10.210.210.0/24  10.0.0.9              	0	100  	0 65050 i +   	UN=10.0.0.9 EC{65050:2011} label=80 type=bgp, subtype=0 +   *>i172.16.100.0/24  10.0.0.9              	0	100  	0 i +   	UN=10.0.0.9 EC{65050:2011} label=80 type=bgp, subtype=0 + +- “show bgp ipv4 vpn x.x.x.x/x” for checking best path selected  +  for specific VPNv4 destination + +.. code-block:: none +    +   vyos@VyOS-RR1:~$ show bgp  ipv4 vpn 10.0.0.100/32 +   BGP routing table entry for 10.80.80.1:1011:10.0.0.100/32 +   not allocated +   Paths: (1 available, best #1) +     Advertised to non peer-group peers: +     10.0.0.7 10.0.0.8 10.0.0.9 10.0.0.10 +     65035, (Received from a RR-client) +   	10.0.0.8 from 10.0.0.8 (10.0.0.8) +     	Origin incomplete, metric 0, localpref 100, valid, internal, best (First path received) +     	Extended Community: RT:65035:1030 +     	Remote label: 80 +     	Last update: Tue Oct 19 13:45:32 202 +    +Also we can verify how PE devices receives VPNv4 networks from the RRs  +and installing them to the specific customer VRFs: + +- “show bgp ipv4 vpn summary” for checking iBGP neighbors against  +  route-reflector devices: + +.. code-block:: none +    +   vyos@VyOS-PE1:~$ show bgp ipv4 vpn summary +   BGP router identifier 10.0.0.7, local AS number 65001 vrf-id 0 +   BGP table version 0 +   RIB entries 9, using 1728 bytes of memory +   Peers 2, using 43 KiB of memory +   Peer groups 1, using 64 bytes of memory +    +   Neighbor    	V     	AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt +   10.0.0.1     	4  	65001  	8812  	8794    	   0	   0	   0   01:18:42        	8    	2 +   10.0.0.2     	4  	65001  	8800  	8792    	   0	   0	   0   6d02h27m        	8    	2 + +- “show bgp vrf all” for checking all the prefix learning on BGP  +   within VRFs: + +.. code-block:: none +    +   vyos@VyOS-PE1:~$ show  bgp vrf all + +   Instance default: +   No BGP prefixes displayed, 0 exist +    +   Instance BLUE_SPOKE: +   BGP table version is 8, local router ID is 10.50.50.1, vrf id 6 +   Default local pref 100, local AS 65001 +   Status codes:  s suppressed, d damped, h history, * valid, > best, = multipath, +              	i internal, r RIB-failure, S Stale, R Removed +   Nexthop codes: @NNN nexthop's vrf id, < announce-nh-self +   Origin codes:  i - IGP, e - EGP, ? - incomplete +    +      Network      	Next Hop        	Metric LocPrf Weight Path +   *  10.50.50.0/24	0.0.0.0              	0     	32768 ? +   *>              	0.0.0.0              	0     	32768 i +   *> 10.80.80.0/24	10.0.0.8@0<           	0	100  	0 i +   *               	10.0.0.8@0<           	0	100  	0 i +   *> 10.0.0.80/32   10.50.50.2           	0         	0 65035 i +   *> 10.0.0.100/32 +                   	10.0.0.8@0<           	0	100  	0 65035 ? +   *               	10.0.0.8@0<           	0	100  	0 65035 ? + +- “show bgp vrf BLUE_SPOKE summary” for checking EBGP neighbor  +   information between PE and CE: +    +.. code-block:: none +    +   vyos@VyOS-PE1:~$ show bgp vrf BLUE_SPOKE summary + + +   IPv4 Unicast Summary: +   BGP router identifier 10.50.50.1, local AS number 65001 vrf-id 6 +   BGP table version 8 +   RIB entries 7, using 1344 bytes of memory +   Peers 1, using 21 KiB of memory +    +   Neighbor    	V     	AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt +   10.50.50.2  	4  	65035  	9019  	9023    	      0	0	   0   6d06h12m        	1    	4 +    +   Total number of neighbors 1 + +- “show ip route vrf BLUE_SPOKE” for viewing the RIB in our Spoke PE.  +   Using this command we are also able to check the transport and  +   customer label (inner/outer) for Hub network prefix (10.0.0.100/32): + +.. code-block:: none +    +   vyos@VyOS-PE1:~$ show ip route vrf BLUE_SPOKE + +   Codes: K - kernel route, C - connected, S - static, R - RIP, +      	O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP, +      	T - Table, v - VNC, V - VNC-Direct, A - Babel, D - SHARP, +      	F - PBR, f - OpenFabric, +      	> - selected route, * - FIB route, q - queued, r - rejected, b - backup +    +   VRF BLUE_SPOKE: +   K>* 0.0.0.0/0 [255/8192] unreachable (ICMP unreachable), 03w0d23h +   C>* 10.50.50.0/24 is directly connected, eth3, 03w0d23h +   B>  10.80.80.0/24 [200/0] via 10.0.0.8 (vrf default) (recursive), label 80, weight 1, 04:22:00 +     *                     	via 172.16.90.1, eth0 (vrf default), label 24/80, weight 1, 04:22:00 +   B>* 10.0.0.80/32 [20/0] via 10.50.50.2, eth3, weight 1, 6d05h30m +   B>  10.0.0.100/32 [200/0] via 10.0.0.8 (vrf default) (recursive), label 80, weight 1, 04:22:00 +     *                          	via 172.16.90.1, eth0 (vrf default), label 24/80, weight 1, 04:22:00 + +- “show bgp ipv4 vpn x.x.x.x/32” for checking the best-path to the  +   specific VPNv4 destination including extended community and  +   remotelabel information. This procedure is the same on all Spoke nodes: +    +.. code-block:: none +    +   vyos@VyOS-PE1:~$ show bgp ipv4 vpn 10.0.0.100/32 +   BGP routing table entry for 10.80.80.1:1011:10.0.0.100/32 +   not allocated +   Paths: (2 available, best #1) +     Not advertised to any peer +     65035 +   	10.0.0.8 from 10.0.0.1 (10.0.0.8) +     	Origin incomplete, metric 0, localpref 100, valid, internal, best (Neighbor IP) +     	Extended Community: RT:65035:1030 +     	Originator: 10.0.0.8, Cluster list: 10.0.0.1 +     	Remote label: 80 +     	Last update: Tue Oct 19 13:45:26 2021 +     65035 +   	10.0.0.8 from 10.0.0.2 (10.0.0.8) +     	Origin incomplete, metric 0, localpref 100, valid, internal +     	Extended Community: RT:65035:1030 +     	Originator: 10.0.0.8, Cluster list: 10.0.0.1 +     	Remote label: 80 +     	Last update: Wed Oct 13 12:39:34 202 + +Now, let’s check routing information on out Hub PE: +- “show bgp ipv4 vpn summary” for checking iBGP neighbors again  +   VyOS-RR1/RR2 + +.. code-block:: none +    +   vyos@VyOS-PE2:~$ show bgp ipv4 vpn summary +   BGP router identifier 10.0.0.8, local AS number 65001 vrf-id 0 +   BGP table version 0 +   RIB entries 9, using 1728 bytes of memory +   Peers 2, using 43 KiB of memory +   Peer groups 1, using 64 bytes of memory +    +   Neighbor    	V     	AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt +   10.0.0.1     	4  	65001 	15982 	15949    	0	0	0 05:41:28        	6    	4 +   10.0.0.2     	4  	65001  	9060  	9054    	0	0	0 6d06h47m        	6    	4 +    +   Total number of neighbors + +- “show bgp vrf all” for checking all the prefixes learning on BGP + +.. code-block:: none +    +   vyos@VyOS-PE2:~$ show bgp vrf all + +   Instance default: +   No BGP prefixes displayed, 0 exist +    +   Instance BLUE_HUB: +   BGP table version is 50, local router ID is 10.80.80.1, vrf id 8 +   Default local pref 100, local AS 65001 +   Status codes:  s suppressed, d damped, h history, * valid, > best, = multipath, +              	i internal, r RIB-failure, S Stale, R Removed +   Nexthop codes: @NNN nexthop's vrf id, < announce-nh-self +   Origin codes:  i - IGP, e - EGP, ? - incomplete +    +      Network      	Next Hop        	Metric LocPrf Weight Path +   *> 10.50.50.0/24	10.0.0.7@0<           	0	100  	0 i +   *               	10.0.0.7@0<           	0	100  	0 i +   *> 10.60.60.0/24	10.0.0.10@0<       	0	100  	0 i +   *               	10.0.0.10@0<       	0	100  	0 i +   *  10.80.80.0/24	10.80.80.2           	0         	0 65035 ? +   *               	0.0.0.0              	0     	32768 i +   *>              	0.0.0.0              	0     	32768 ? +   *> 10.110.110.0/24  172.16.80.2@9<       	0         	0 65050 i +   *> 10.210.210.0/24  10.0.0.9@0<           	0	100  	0 65050 i +   *               	10.0.0.9@0<           	0	100  	0 65050 i +   *> 10.0.0.80/32   10.0.0.7@0<           	0	100  	0 65035 i +   *               	10.0.0.7@0<           	0	100  	0 65035 i +   *> 10.0.0.90/32   10.0.0.10@0<       	0	100  	0 65035 i +   *               	10.0.0.10@0<       	0	100  	0 65035 i +   *> 10.0.0.100/32 +                   	10.80.80.2           	0         	0 65035 ? +   *> 172.16.80.0/24   0.0.0.0@9<           	0     	32768 ? +                   	0.0.0.0@9<           	0     	32768 i +   *> 172.16.100.0/24  10.0.0.9@0<           	0	100  	0 i +   *               	10.0.0.9@0<           	0	100  	0 i + +- “show bgp vrf BLUE_HUB summary” for checking EBGP neighbor  +   CE Hub device + +.. code-block:: none +    +   vyos@VyOS-PE2:~$ show bgp vrf BLUE_HUB summary + +   IPv4 Unicast Summary: +   BGP router identifier 10.80.80.1, local AS number 65001 vrf-id 8 +   BGP table version 50 +   RIB entries 19, using 3648 bytes of memory +   Peers 1, using 21 KiB of memory +    +   Neighbor    	V     	AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt +   10.80.80.2  	4  	65035 	15954 	15972    	   0	0	   0   01w4d01h        	2   	10 +    +- “show ip route vrf BLUE_HUB” to view the RIB in our Hub PE.  +   With this command we are able to check the transport and  +   customer label (inner/outer) for network spokes prefixes  +   10.0.0.80/32 - 10.0.0.90/32 +    +.. code-block:: none +    +   vyos@VyOS-PE2:~$ show ip route vrf BLUE_HUB +   Codes: K - kernel route, C - connected, S - static, R - RIP, +      	O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP, +      	T - Table, v - VNC, V - VNC-Direct, A - Babel, D - SHARP, +      	F - PBR, f - OpenFabric, +      	> - selected route, * - FIB route, q - queued, r - rejected, b - backup +   VRF BLUE_HUB: +   K>* 0.0.0.0/0 [255/8192] unreachable (ICMP unreachable), 01w4d01h +   B>  10.50.50.0/24 [200/0] via 10.0.0.7 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                     	via 172.16.100.1, eth1 (vrf default), label 22/144, weight 1, 05:53:15 +   B>  10.60.60.0/24 [200/0] via 10.0.0.10 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                     	via 172.16.110.1, eth0 (vrf default), label 23/144, weight 1, 05:53:15 +   C>* 10.80.80.0/24 is directly connected, eth3, 01w4d01h +   B>* 10.110.110.0/24 [200/0] via 172.16.80.2, eth2 (vrf GREEN), weight 1, 01w4d01h +   B>  10.210.210.0/24 [200/0] via 10.0.0.9 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                       	via 172.16.100.1, eth1 (vrf default), label 18/144, weight 1, 05:53:15 +     *                       	via 172.16.110.1, eth0 (vrf default), label 22/144, weight 1, 05:53:15 +   B>  10.0.0.80/32 [200/0] via 10.0.0.7 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                      	via 172.16.100.1, eth1 (vrf default), label 22/144, weight 1, 05:53:15 +   B>  10.0.0.90/32 [200/0] via 10.0.0.10 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                      	via 172.16.110.1, eth0 (vrf default), label 23/144, weight 1, 05:53:15 +   B>* 10.0.0.100/32 [20/0] via 10.80.80.2, eth3, weight 1, 01w4d01h +   B>* 172.16.80.0/24 [200/0] is directly connected, eth2 (vrf GREEN), weight 1, 01w4d01h +   B>  172.16.100.0/24 [200/0] via 10.0.0.9 (vrf default) (recursive), label 144, weight 1, 05:53:15 +     *                       	via 172.16.100.1, eth1 (vrf default), label 18/144, weight 1, 05:53:15 +     *                       	via 172.16.110.1, eth0 (vrf default), label 22/144, weight 1, 05:53:15 + +- “show bgp ipv4 vpn x.x.x.x/32” for checking best-path,  +   extended community and remote label of specific destination +    +.. code-block:: none +    +   vyos@VyOS-PE2:~$ show bgp ipv4 vpn 10.0.0.80/32 +   BGP routing table entry for 10.50.50.1:1011:10.0.0.80/32 +   not allocated +   Paths: (2 available, best #1) +     Not advertised to any peer +     65035 +   	10.0.0.7 from 10.0.0.1 (10.0.0.7) +     	Origin IGP, metric 0, localpref 100, valid, internal, best (Neighbor IP) +     	Extended Community: RT:65035:1011 +     	Originator: 10.0.0.7, Cluster list: 10.0.0.1 +     	Remote label: 144 +     	Last update: Tue Oct 19 13:45:30 2021 +     65035 +   	10.0.0.7 from 10.0.0.2 (10.0.0.7) +     	Origin IGP, metric 0, localpref 100, valid, internal +     	Extended Community: RT:65035:1011 +     	Originator: 10.0.0.7, Cluster list: 10.0.0.1 +     	Remote label: 144 +     	Last update: Wed Oct 13 12:39:37 2021 +    +   vyos@VyOS-PE2:~$ show bgp ipv4 vpn 10.0.0.90/32 +   BGP routing table entry for 10.60.60.1:1011:10.0.0.90/32 +   not allocated +   Paths: (2 available, best #1) +     Not advertised to any peer +     65035 +   	10.0.0.10 from 10.0.0.1 (10.0.0.10) +     	Origin IGP, metric 0, localpref 100, valid, internal, best (Neighbor IP) +     	Extended Community: RT:65035:1011 +     	Originator: 10.0.0.10, Cluster list: 10.0.0.1 +     	Remote label: 144 +    	Last update: Tue Oct 19 13:45:30 2021 +     65035 +   	10.0.0.10 from 10.0.0.2 (10.0.0.10) +     	Origin IGP, metric 0, localpref 100, valid, internal +     	Extended Community: RT:65035:1011 +     	Originator: 10.0.0.10, Cluster list: 10.0.0.1 +     	Remote label: 144 +     	Last update: Wed Oct 13 12:45:44 2021 + +Finally, let’s check the reachability between CEs: + +- VyOS-CE1-SPOKE ----->   VyOS-CE-HUB + + +.. code-block:: none +    +   # check rib  +   vyos@VyOS-CE1-SPOKE:~$ show ip route +   Codes: K - kernel route, C - connected, S - static, R - RIP, +      	O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP, +      	T - Table, v - VNC, V - VNC-Direct, A - Babel, D - SHARP, +      	F - PBR, f - OpenFabric, +      	> - selected route, * - FIB route, q - queued, r - rejected, b - backup +    +   B   10.50.50.0/24 [20/0] via 10.50.50.1 inactive, weight 1, 6d07h53m +   C>* 10.50.50.0/24 is directly connected, eth0, 09w0d00h +   B>* 10.80.80.0/24 [20/0] via 10.50.50.1, eth0, weight 1, 6d07h53m +   C>* 10.0.0.80/32 is directly connected, dum20, 09w0d00h +   B>* 10.0.0.100/32 [20/0] via 10.50.50.1, eth0, weight 1, 6d07h53m +    +   # check icmp +   vyos@VyOS-CE1-SPOKE:~$ ping 10.0.0.100 interface 10.0.0.80 +   PING 10.0.0.100 (10.0.0.100) from 10.0.0.80 : 56(84) bytes of data. +   64 bytes from 10.0.0.100: icmp_seq=1 ttl=62 time=6.52 ms +   64 bytes from 10.0.0.100: icmp_seq=2 ttl=62 time=4.13 ms +   64 bytes from 10.0.0.100: icmp_seq=3 ttl=62 time=4.04 ms +   64 bytes from 10.0.0.100: icmp_seq=4 ttl=62 time=4.03 ms +   ^C +   --- 10.0.0.100 ping statistics --- +   4 packets transmitted, 4 received, 0% packet loss, time 8ms +   rtt min/avg/max/mdev = 4.030/4.680/6.518/1.064 ms +    +   # check network path +   vyos@VyOS-CE1-SPOKE:~$ traceroute 10.0.0.100 +   traceroute to 10.0.0.100 (10.0.0.100), 30 hops max, 60 byte packets +    1  10.50.50.1 (10.50.50.1)  1.041 ms  1.252 ms  1.835 ms +    2  * * * +    3  10.0.0.100 (10.0.0.100)  9.225 ms  9.159 ms  9.121 m + +- VyOS-CE-HUB -------> VyOS-CE1-SPOKE +- VyOS-CE-HUB -------> VyOS-CE2-SPOKE + +.. code-block:: none +    +   # check rib +   vyos@VyOS-CE-HUB:~$ show ip route +   Codes: K - kernel route, C - connected, S - static, R - RIP, +      	O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP, +      	T - Table, v - VNC, V - VNC-Direct, A - Babel, D - SHARP, +      	F - PBR, f - OpenFabric, +      	> - selected route, * - FIB route, q - queued, r - rejected, b - backup +    +   B>* 10.50.50.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h04m +   B>* 10.60.60.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h35m +   C>* 10.80.80.0/24 is directly connected, eth0, 01w6d07h +   B>* 10.110.110.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 01w4d02h +   B>* 10.210.210.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h35m +   B>* 10.0.0.80/32 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h04m +   B>* 10.0.0.90/32 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h35m +   C>* 10.0.0.100/32 is directly connected, dum20, 01w6d07h +   B>* 172.16.80.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 01w4d02h +   B>* 172.16.100.0/24 [20/0] via 10.80.80.1, eth0, weight 1, 6d08h35m +    +   # check icmp +   vyos@VyOS-CE-HUB:~$ ping 10.0.0.80 interface 10.0.0.100 c 4 +   PING 10.0.0.80 (10.0.0.80) from 10.0.0.100 : 56(84) bytes of data. +   64 bytes from 10.0.0.80: icmp_seq=1 ttl=62 time=3.31 ms +   64 bytes from 10.0.0.80: icmp_seq=2 ttl=62 time=4.23 ms +   64 bytes from 10.0.0.80: icmp_seq=3 ttl=62 time=3.89 ms +   64 bytes from 10.0.0.80: icmp_seq=4 ttl=62 time=3.22 ms +    +   --- 10.0.0.80 ping statistics --- +   4 packets transmitted, 4 received, 0% packet loss, time 9ms +   rtt min/avg/max/mdev = 3.218/3.661/4.226/0.421 ms +    +   vyos@VyOS-CE-HUB:~$ ping 10.0.0.90 interface 10.0.0.100 c 4 +   PING 10.0.0.90 (10.0.0.90) from 10.0.0.100 : 56(84) bytes of data. +   64 bytes from 10.0.0.90: icmp_seq=1 ttl=62 time=7.46 ms +   64 bytes from 10.0.0.90: icmp_seq=2 ttl=62 time=4.43 ms +   64 bytes from 10.0.0.90: icmp_seq=3 ttl=62 time=4.60 ms +   ^C +   --- 10.0.0.90 ping statistics --- +   3 packets transmitted, 3 received, 0% packet loss, time 6ms +   rtt min/avg/max/mdev = 4.430/5.498/7.463/1.391 ms +    +   # check network path +   vyos@VyOS-CE-HUB:~$ traceroute 10.0.0.80 +   traceroute to 10.0.0.80 (10.0.0.80), 30 hops max, 60 byte packets +    1  10.80.80.1 (10.80.80.1)  1.563 ms  1.341 ms  1.075 ms +    2  * * * +    3  10.0.0.80 (10.0.0.80)  8.125 ms  8.019 ms  7.781 ms +    +   vyos@VyOS-CE-HUB:~$ traceroute 10.0.0.90 +   traceroute to 10.0.0.90 (10.0.0.90), 30 hops max, 60 byte packets +    1  10.80.80.1 (10.80.80.1)  1.305 ms  1.137 ms  1.097 ms +    2  * * * +    3  * * * +    4  10.0.0.90 (10.0.0.90)  9.358 ms  9.325 ms  9.292 ms + +- VyOS-CE2-SPOKE ------->  VyOS-CE-HUB + +.. code-block:: none +    +   # check rib +   vyos@rt-ce2-SPOKE:~$ show ip route +   Codes: K - kernel route, C - connected, S - static, R - RIP, +      	O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP, +      	T - Table, v - VNC, V - VNC-Direct, A - Babel, D - SHARP, +      	F - PBR, f - OpenFabric, +      	> - selected route, * - FIB route, q - queued, r - rejected, b - backup +    +   B   10.60.60.0/24 [20/0] via 10.60.60.1 inactive, weight 1, 02w6d00h +   C>* 10.60.60.0/24 is directly connected, eth0, 02w6d00h +   B>* 10.80.80.0/24 [20/0] via 10.60.60.1, eth0, weight 1, 6d08h46m +   C>* 10.0.0.90/32 is directly connected, dum20, 02w6d00h +   B>* 10.0.0.100/32 [20/0] via 10.60.60.1, eth0, weight 1, 6d08h46m +    +   # check icmp +   vyos@rt-ce2-SPOKE:~$ ping 10.0.0.100 interface 10.0.0.90 c 4 +   PING 10.0.0.100 (10.0.0.100) from 10.0.0.90 : 56(84) bytes of data. +   64 bytes from 10.0.0.100: icmp_seq=1 ttl=62 time=4.97 ms +   64 bytes from 10.0.0.100: icmp_seq=2 ttl=62 time=4.45 ms +   64 bytes from 10.0.0.100: icmp_seq=3 ttl=62 time=4.20 ms +   64 bytes from 10.0.0.100: icmp_seq=4 ttl=62 time=4.29 ms +    +   --- 10.0.0.100 ping statistics --- +   4 packets transmitted, 4 received, 0% packet loss, time 9ms +   rtt min/avg/max/mdev = 4.201/4.476/4.971/0.309 ms +    +   # check network path +   vyos@rt-ce2-SPOKE:~$ traceroute 10.0.0.100 +   traceroute to 10.0.0.100 (10.0.0.100), 30 hops max, 60 byte packets +    1  10.60.60.1 (10.60.60.1)  1.343 ms  1.190 ms  1.152 ms +    2  * * * +    3  * * * +    4  10.0.0.100 (10.0.0.100)  7.504 ms  7.480 ms  7.488 ms + +**Note:** At the moment, trace mpls doesn’t show labels/paths. So we’ll see * * *  for the transit routers of the mpls backbone. | 
