Feature/persisten systemvm redundant vpc rebase#118

Merged

asfgit merged 274 commits intoapache:masterfrom

schubergphilis:feature/persisten-systemvm-redundant-vpc-REBASE

Mar 17, 2015

This pull request is big! We're only showing the most recent 250 commits

Commits on Mar 16, 2015

Disable cmdline check until it's fixed

spark404
authored and
wilderrodrigues
committed
1. Completed provider for ip rules (fwmark)

Ian Southam
authored and
wilderrodrigues
committed
Corrected a hole in my logic

Ian Southam
authored and
wilderrodrigues
committed
Rewrite networkacl model to have separate entries for each rule

spark404
authored and
wilderrodrigues
committed
Add some debug logging to keep track of timing

spark404
authored and
wilderrodrigues
committed
Change vmdata to the new config system

spark404
authored and
wilderrodrigues
committed
A working test-kitchen setup for testing systemvm boxes.

lsimons
authored and
wilderrodrigues
committed
Include the guestnetwork code

Ian Southam
authored and
wilderrodrigues
committed
Split Databag in to separate class as I would now need this

Ian Southam
authored and
wilderrodrigues
committed
junit report output for vagrant systemvm tests

lsimons
authored and
wilderrodrigues
committed
Use bundler to exec test-kitchen

lsimons
authored and
wilderrodrigues
committed
Commit missing .kitchen.yml

lsimons
authored and
wilderrodrigues
committed
Massively simpler serverspec invocation

lsimons
authored and
wilderrodrigues
committed
Missing gem for vagrant magic

lsimons
authored and
wilderrodrigues
committed
Documentation and license headers for new systemvm testing tools.

lsimons
authored and
wilderrodrigues
committed
Plan B

Ian Southam
authored and
wilderrodrigues
committed
Test data for ipassociation

Ian Southam
authored and
wilderrodrigues
committed
Added some lost lines back using Hugo witchcraft

Ian Southam
authored and
wilderrodrigues
committed
Put a netmask in the netmask field

spark404
authored and
wilderrodrigues
committed
Moved bag location to /et/cloudstack

Ian Southam
authored and
wilderrodrigues
committed
Pure python tests for systemvm

lsimons
authored and
wilderrodrigues
committed
Replace serverspec with nose in systemvm test.sh

lsimons
authored and
wilderrodrigues
committed
Attempt to get these tests working on python 2.6

lsimons
authored and
wilderrodrigues
committed
Second Attempt to get these tests working on python 2.6.

lsimons
authored and
wilderrodrigues
committed
Added guest network configuration

Ian Southam
authored and
wilderrodrigues
committed
This was a good one

Ian Southam
authored and
wilderrodrigues
committed
Move some static strings to constants and remove some duplicate code

spark404
authored and
wilderrodrigues
committed
New style save password command

spark404
authored and
wilderrodrigues
committed
Fancy line editor for Ian

lsimons
authored and
wilderrodrigues
committed
Don't fail if you've logged into an older systemvm manually, before.

lsimons
authored and
wilderrodrigues
committed
Set up rsync for systemvm patches.

lsimons
authored and
wilderrodrigues
committed
Fix update_config.py use of subprocess.

lsimons
authored and
wilderrodrigues
committed
Fix configure::waitForDevice when a device is missing.

lsimons
authored and
wilderrodrigues
committed
Tests for update_config.py

lsimons
authored and
wilderrodrigues
committed
Add forwarding rules to the new config format and do a little rewrite on

spark404
authored and
wilderrodrigues
committed
Removed merge_cline - no longer required

Ian Southam
authored and
wilderrodrigues
committed
New style manage VPN user command <Still need some testing with the VR image>

sbotman
authored and
wilderrodrigues
committed
Add more nics by default

lsimons
authored and
wilderrodrigues
committed
Have Vagrantfile errors go to STDERR so output is machine-parseable.

lsimons
authored and
wilderrodrigues
committed
Adding the Vagrant configuration that will build xen and db servers.

sbotman
authored and
wilderrodrigues
committed
modified StaticNatRule to use the new style

spark404
authored and
wilderrodrigues
committed
iDo not do the post configure steps on a control interface

Ian Southam
authored and
wilderrodrigues
committed
Removed chef as we will definitely not go this way

Ian Southam
authored and
wilderrodrigues
committed
Migrate ip alias commands

spark404
authored and
wilderrodrigues
committed
Do not use eth0 or eth1 for random tests

Ian Southam
authored and
wilderrodrigues
committed
Stop ignoring eth0

Ian Southam
authored and
wilderrodrigues
committed
Fix on error reporting (null doesn't say much, so lets return the actual problem)

sbotman
authored and
wilderrodrigues
committed
Adding new model for the Site2SiteVpn configuration.

sbotman
authored and
wilderrodrigues
committed
Added some tests that test stuff

Ian Southam
authored and
wilderrodrigues
committed
Change the location for the temporary json files to /var/cache/cloud

spark404
authored and
wilderrodrigues
committed
Staticroutes to new json style

spark404
authored and
wilderrodrigues
committed
New model for RemoteAccessVpn and moving into the new structure

sbotman
authored and
wilderrodrigues
committed
Hotfix for lost control interface

spark404
authored and
wilderrodrigues
committed
Small fixes

spark404
authored and
wilderrodrigues
committed
Creating new model for the MonitorService

sbotman
authored and
wilderrodrigues
committed
Added vmpassword type (does nothing yet)

Ian Southam
authored and
wilderrodrigues
committed
New style dnsmasq configuration

spark404
authored and
wilderrodrigues
committed
Fixed test (assert in guest check was wrong way around)

Ian Southam
authored and
wilderrodrigues
committed
Creating new model for the firewall rules

sbotman
authored and
wilderrodrigues
committed
Some bug fixes

Ian Southam
authored and
wilderrodrigues
committed
fixing the nullpointer on type which is null

sbotman
authored and
wilderrodrigues
committed
Fixed bug in which every run of loadQueueFile would append to the json file (merge)

Ian Southam
authored and
wilderrodrigues
committed
Small update to try do deal with the stuck issue

spark404
authored and
wilderrodrigues
committed
Add catchall for unknown types

Ian Southam
authored and
wilderrodrigues
committed
Do not update etc or you will bring in a load of files that will have their

Ian Southam
authored and
wilderrodrigues
committed
Added merge for network_acl type message

Ian Southam
authored and
wilderrodrigues
committed
Added placeholder for networkacl tests

Ian Southam
authored and
wilderrodrigues
committed
Moved processing the cmd_line databag into update

Ian Southam
authored and
wilderrodrigues
committed
Refactored CsHelper into a module

Ian Southam
authored and
wilderrodrigues
committed
Merge vmmetadata, reuse the code from the existing script to parse it.

spark404
authored and
wilderrodrigues
committed
First part of some serious refactoring

Ian Southam
authored and
wilderrodrigues
committed
Tidied up main to be in line with the newer classes

Ian Southam
authored and
wilderrodrigues
committed
Added logic to create all necessary firewall rules

Ian Southam
authored and
wilderrodrigues
committed
Auto create missing chains

Ian Southam
authored and
wilderrodrigues
committed
Call update_config.py if it is there

Ian Southam
authored and
wilderrodrigues
committed
Small (but important) fixes

spark404
authored and
wilderrodrigues
committed
Acl code linked in

Ian Southam
authored and
wilderrodrigues
committed
That should be all the dhcp settings correct

Ian Southam
authored and
wilderrodrigues
committed
Fix a bug that would add updated control ip address instead of replace

spark404
authored and
wilderrodrigues
committed
Add the static nat rules to the merge procedure

spark404
authored and
wilderrodrigues
committed
Corrected a couple of small typos

Ian Southam
authored and
wilderrodrigues
committed
That is the acls.

Ian Southam
authored and
wilderrodrigues
committed
Corrected bug (I love tests)

Ian Southam
authored and
wilderrodrigues
committed
Stupid stupd bug

Ian Southam
authored and
wilderrodrigues
committed
Implemented delete (add : false) for cs_dhcp

Ian Southam
authored and
wilderrodrigues
committed
Fix the forwardingrule databag

spark404
authored and
wilderrodrigues
committed
Add port forwarding and static nat to the convergence infrastructure

spark404
authored and
wilderrodrigues
committed
Add the public source nat rule

spark404
authored and
wilderrodrigues
committed
Add missing sourcenat rule

spark404
authored and
wilderrodrigues
committed
Removed dhcpopts.conf for now as, it is the routing options and they seem to be dealt with dofferently in the new arrangement

Ian Southam
authored and
wilderrodrigues
committed
A lot of corner cases dealt with

Ian Southam
authored and
wilderrodrigues
committed
Bug fixed:

Ian Southam
authored and
wilderrodrigues
committed
If a file doesn't exist, create it

spark404
authored and
wilderrodrigues
committed
Sourcenat is handled differently for routers and vpc routers

spark404
authored and
wilderrodrigues
committed
Some new tests for the acl code

Ian Southam
authored and
wilderrodrigues
committed
Include base rule sets in Acls

Ian Southam
authored and
wilderrodrigues
committed
Moved databag into a separate file

Ian Southam
authored and
wilderrodrigues
committed
icmp-type parameter was being skipped

Ian Southam
authored and
wilderrodrigues
committed
Add some parameters to make nose a little less chatty

Ian Southam
authored and
wilderrodrigues
committed
Added some new tests to check the acls are being made sort of correctly

Ian Southam
authored and
wilderrodrigues
committed
Added code to configure netusage for vpc and domR devices

Ian Southam
authored and
wilderrodrigues
committed
Merge operation for site2site vpn

Ian Southam
authored and
wilderrodrigues
committed
Process VPN requests\

Ian Southam
authored and
wilderrodrigues
committed
New code for ACLs (VPN configuration) failed functional tests

Ian Southam
authored and
wilderrodrigues
committed
A start on the redundancy code

Ian Southam
authored and
wilderrodrigues
committed
Getting redundancy to work via teh configuration files

Ian Southam
authored and
wilderrodrigues
committed
backup fault and master implemented

Ian Southam
authored and
wilderrodrigues
committed
Removed stuff that is moved to CsRedundant

Ian Southam
authored and
wilderrodrigues
committed
Cockup during the adding of the Apache licence

Ian Southam
authored and
wilderrodrigues
committed
TK-2925 Add support for loadbalancer config in ConfigHelper
wilderrodrigues
committed
Add 8 Commands/ConfigItems to new style
wilderrodrigues
committed
Adding all other (13) rules to the new code design
wilderrodrigues
committed
BumpUpPriotity doesn't need the generateConfigItems() method.
wilderrodrigues
committed
Adding LoadBalancer command to JSON style
wilderrodrigues
committed
Adding tests for IpAssocVpc; DeleteIpAlias; DnsMasqConfig
wilderrodrigues
committed
Seems like some of these can be nil

lsimons
authored and
wilderrodrigues
committed
Stop using rvm

lsimons
authored and
wilderrodrigues
committed
Fix a few things introduced by the rebase

spark404
authored and
wilderrodrigues
committed
ConfigHelper is replace by a facade pattern

spark404
authored and
wilderrodrigues
committed
Interfaces were not coming up on non redundant router

Ian Southam
authored and
wilderrodrigues
committed
Updated incorrect file.

Ian Southam
authored and
wilderrodrigues
committed
Fix indents

spark404
authored and
wilderrodrigues
committed
Fix test cases now ConfigHelper is gone

spark404
authored and
wilderrodrigues
committed
Fix compilation problem only visible upon simulator build

afornie
authored and
wilderrodrigues
committed
Vpc redundancy enabled. Including Vpc & Vpc Offering creation. Marvin tests and UI.

Antonio Fornie
authored and
wilderrodrigues
committed
We actually don't need all the process stuff

spark404
authored and
wilderrodrigues
committed
VR interfaces need the proper network type in ips

spark404
authored and
wilderrodrigues
committed
Avoid confusion and make sure the file is put in only one location

spark404
authored and
wilderrodrigues
committed
Daft mistake that left more data getting merged than we would have liked

Ian Southam
authored and
wilderrodrigues
committed
Fix tab characters

spark404
authored and
wilderrodrigues
committed
Decided not at this stage to combine VPC and VR code

Ian Southam
authored and
wilderrodrigues
committed
Typo

Ian Southam
authored and
wilderrodrigues
committed
Fix indent

spark404
authored and
wilderrodrigues
committed
Fix PEP8 compliance

spark404
authored and
wilderrodrigues
committed
pep8

spark404
authored and
wilderrodrigues
committed
Fix license headers

spark404
authored and
wilderrodrigues
committed
Aligning router chain names correctly

Ian Southam
authored and
wilderrodrigues
committed
Fix syntax error

Ian Southam
authored and
wilderrodrigues
committed
Splitting router and vpc

Ian Southam
authored and
wilderrodrigues
committed
Bug corrections

Ian Southam
authored and
wilderrodrigues
committed
Syntax error

Ian Southam
authored and
wilderrodrigues
committed
Bugger

Ian Southam
authored and
wilderrodrigues
committed
New code must not run on systemvm

Ian Southam
authored and
wilderrodrigues
committed
Corrected basic firewalling setup

Ian Southam
authored and
wilderrodrigues
committed
iAdd chains before provisioning rules

Ian Southam
authored and
wilderrodrigues
committed
Fix a problem where virtual routers were deployed multiple times in a network

spark404
authored and
wilderrodrigues
committed
Call planDeploymentRouters in the same place as we do in master

spark404
authored and
wilderrodrigues
committed
Get started with some tests on the python code

spark404
authored and
wilderrodrigues
committed
Add boilerplates for module unittests

spark404
authored and
wilderrodrigues
committed
Let's stick to CamelCase for now

spark404
authored and
wilderrodrigues
committed
More pep8 checks and fixes

spark404
authored and
wilderrodrigues
committed
Adding pyde configuration to gitignore
wilderrodrigues
committed
Adding [ERROR] tag before error message to ease identification
wilderrodrigues
committed
Removing "global" declaration from if block
wilderrodrigues
committed
veewee 0.5 alpha is breaking build

lsimons
authored and
wilderrodrigues
committed
Adding .pydevproject to gitignore
wilderrodrigues
committed
A couple of firewall fixes for DomRouter code

Ian Southam
authored and
wilderrodrigues
committed
This time after running the unittests <blush>

Ian Southam
authored and
wilderrodrigues
committed
Adding port forwarding ranges exposes a rather unfortunate typo

Ian Southam
authored and
wilderrodrigues
committed
firewallrules (VR) and metworkacl (VPC) did not as I believe they shgould get combined

Ian Southam
authored and
wilderrodrigues
committed
pep8

Ian Southam
authored and
wilderrodrigues
committed
Lots of fixes from the testing

Ian Southam
authored and
wilderrodrigues
committed
Load balancer config

Ian Southam
authored and
wilderrodrigues
committed
Small bug

Ian Southam
authored and
wilderrodrigues
committed
Forgot to add append method

Ian Southam
authored and
wilderrodrigues
committed
Fixed hostname on router

Ian Southam
authored and
wilderrodrigues
committed
Fix imports

spark404
authored and
wilderrodrigues
committed
Broken code during guest network merge

Ian Southam
authored and
wilderrodrigues
committed
Dhcp refactor

Ian Southam
authored and
wilderrodrigues
committed
Some convenience methods

Ian Southam
authored and
wilderrodrigues
committed
[TK-3101] Fix VPCVirtualRouterElement
wilderrodrigues
committed
Countless bug fixes, mostly do do with VR redundancy

Ian Southam
authored and
wilderrodrigues
committed
[TK-3101] Fix VPCVirtualRouterElement
wilderrodrigues
committed
Formatting the class: it was a mess!
wilderrodrigues
committed
[TK-3113] fixed CloudRuntimeException: NO EVENT PUBLISH CAN BE WRAPPED WITHIN DB TRANSACTION!
wilderrodrigues
committed
Sorting out redundancy

Ian Southam
authored and
wilderrodrigues
committed
[TK-3119] Fix NPEs and improve exception handling + error messages
wilderrodrigues
committed
New unit test

Ian Southam
authored and
wilderrodrigues
committed
Fixing delete_leases function.
wilderrodrigues
committed
Fix createSetupGuestNetworkCommand() method in order to pass the value of the getIsRedundantRouter() method instead of false.
wilderrodrigues
committed
Fix problem with reading invalid key form the dictionary
wilderrodrigues
committed
Extracting local variable and formatting the code.
wilderrodrigues
committed
Java: Fixing the redundant flag for the router control nic and the guest network command;
wilderrodrigues
committed
Fixing the priority in the setup guest network command
wilderrodrigues
committed
Fixing Site2Site VPN and private gateway on VpcVirtualRouterElement
wilderrodrigues
committed
Make sure we can plug the nic in 2 routers with the same mac address
wilderrodrigues
committed
Fixing call on AclIP class. Instead of self.fw = fw we have to do self.fw = fw.get_fw()
wilderrodrigues
committed
TK-3135 fixes for VPC restart
wilderrodrigues
committed
Log an error when removing keepalived.strikes file and it doesn't exit.
wilderrodrigues
committed
Fixing CsDhcp.py
wilderrodrigues
committed
Fixing getRouters() to make it call the super method.
wilderrodrigues
committed
Fix: allow multiple VIFs per Mac Address
wilderrodrigues
committed
Adding some info to the update_config.py
wilderrodrigues
committed
Fix: the update_config.py was not parsing the incoming guest net configuration properly
wilderrodrigues
committed
get_dns via guest network returns blank dns servers

Ian Southam
authored and
wilderrodrigues
committed
Fixing guest network interfaces on redundant routers
wilderrodrigues
committed
Fixing the timout )ssh hanging) on the CsApp.py file
wilderrodrigues
committed
Fix restarting VPC
wilderrodrigues
committed
Removing guest interfaces form the VRRP list
wilderrodrigues
committed
Reverting the changes on CsAddress done in commit 374946e07748dd3ad659381c7d88e5e4140e4eeb
wilderrodrigues
committed
Lots of changes to do with redundancy

Ian Southam
authored and
wilderrodrigues
committed
Implementing redundant router arguments to add redundant_state
wilderrodrigues
committed
Fix router priuority using the same logic as the one for the state
wilderrodrigues
committed
Vrrp will fail if your own code keeps killing it off

Ian Southam
authored and
wilderrodrigues
committed
No bump for now

Ian Southam
authored and
wilderrodrigues
committed
Adding the router priority when the control interface is created
wilderrodrigues
committed
This change breaks stuff

Ian Southam
authored and
wilderrodrigues
committed
Implement the new VPC restart
wilderrodrigues
committed
Remove vpc_router_svcs because they will be the same as any other router (soon)

Ian Southam
authored and
wilderrodrigues
committed
Set to EQUAL and noprempt - let keppalived decide who is boss

Ian Southam
authored and
wilderrodrigues
committed
Fixed CsAddress destroying the VIP address on a redundant router

Ian Southam
authored and
wilderrodrigues
committed
Fixed up get_dns for normal isolated vrs

Ian Southam
authored and
wilderrodrigues
committed
Mistake no I set no priority!

Ian Southam
authored and
wilderrodrigues
committed
Another correction

Ian Southam
authored and
wilderrodrigues
committed
Fix array index problems on the ACL command.
wilderrodrigues
committed
Restart keepalived if a pub interface gets added or removed

Ian Southam
authored and
wilderrodrigues
committed
Who changed my condition!

Ian Southam
authored and
wilderrodrigues
committed
Turn a single VPC into a redundant VPC
wilderrodrigues
committed
Switch control interface for vrrp to guest network

Ian Southam
authored and
wilderrodrigues
committed
Make virtual router id unique per redundant group
wilderrodrigues
committed
Fixed rules for dhcp towards v,

Ian Southam
authored and
wilderrodrigues
committed
Show all routers of a VPC
wilderrodrigues
committed
Fix the router id on the virtural routers
wilderrodrigues
committed
Better message about making the VPC redundant
wilderrodrigues
committed
Move the . to the right place.
wilderrodrigues
committed
Adding nre method to NetworkDao
wilderrodrigues
committed
Fix the checkrouter.sh script in order to report the routers state
wilderrodrigues
committed
Fixed password server, fixed more firewall issues

Ian Southam
authored and
wilderrodrigues
committed
Fix checkSanity. We do not need to check the priority anymore.
wilderrodrigues
committed
Removing trailing spaces
wilderrodrigues
committed
Add network stats for isalated networks

Ian Southam
authored and
wilderrodrigues
committed
Fix state of isolated redundant network router
wilderrodrigues
committed
A tab got in there somehow!

Ian Southam
authored and
wilderrodrigues
committed
{ip: hosts} syntax goes wrong if ip contains 1::

Ian Southam
authored and
wilderrodrigues
committed
Utterley stupid

Ian Southam
authored and
wilderrodrigues
committed
generate random password for redundant VPC
wilderrodrigues
committed
No hardcoded passwords.
wilderrodrigues
committed
One of the routers is not running, so we don't have to continue here since the host will be null any way. Also, there is no need
wilderrodrigues
committed
During the merge I removed by mistake the @Inject tag
wilderrodrigues
committed
dnsmasq should restart if config changes and hup if hosts change

Ian Southam
authored and
wilderrodrigues
committed
nat rules added to incorrect interface

Ian Southam
authored and
wilderrodrigues
committed
Check both ip and hosts when building dhcp bag

Ian Southam
authored and
wilderrodrigues
committed
Work arounds for how CS adds and removes hosts

Ian Southam
authored and
wilderrodrigues
committed
Remove the priority checks from the code
wilderrodrigues
committed
ACL issues

Ian Southam
authored and
wilderrodrigues
committed
Disable this for now - causes too much grief

Ian Southam
authored and
wilderrodrigues
committed
Use reload on keepalived

Ian Southam
authored and
wilderrodrigues
committed
Fixed password server respawning issue

Ian Southam
authored and
wilderrodrigues
committed
Fixed Port forwarding (DNAT/SNAT) for isolated networks

Ian Southam
authored and
wilderrodrigues
committed
If master gets called and then within a few seconds backup (this can happen during provisioning), the master process will complete after the backup one. Not what we want. These commands must be s…

Ian Southam
authored and
wilderrodrigues
committed