Forum for HA and Autoscaling UTM deployments @ AWS?

hi, any update on this ? im interested in this feature on AWS.

thanks

P.

I've been trying this for few weeks as well.  

Apparently, the firmware upgrade within UTM does not do anything for HA/Autoscaling.  It's basically UTM software patch(eg. Windows security patch vs Windows Service Pack).  What has to happen is that you have to download entirely new AMI version(9.4x) from AWS marketplace and reconfigure the new instance from scratch.  or use backup to reload your configurations.  Which it kind of sucks because, it requires more work than just simple upgrade.  

Sophos is really behind on their contents on this matter.  Their template is pointing to the wrong AMI version(9.3x) so you have to manually change that first and their instructions is wrong as well.  

Good news:

We have identified the problem (basically there is no valid upgrade path for the conversion feature with pretty old install versions as yours).

We fixed this and it will be released with 9.408.

So all you will have to do, as soon as 9.408 is release, is to upgrade and the conversion feature should work as intended for you.

Thanks for finding and reporting this issue.

great... nothing like being "punished" again for being an early adopter of the UTM @ AWS :(  

Glad to hear there's finally a fix coming though.  Better late than never I suppose.

I just upgraded to version Firmware version: 9.408-4  Pattern version:112573

I have a single AWS Sophos UTM installed in one VPC the above error is what I get when trying to click

Unfortunately our new AMIs and templates are not published by Amazon yet.

But this is in progress and should be finished in the next days.

I will dig for some a release date with our product management.

Apologizes for the confusion, with the release of this feature.

Sebastian, Thanks for the update,

Please advise are you saying the current AMI i'm using will have to be shutdown and a new AMI will have to be lunched that will support the Auto HA warm setup feature? If that is the case How soon are the New AMI's going to be released this is critical because my company in the next two weeks wants to finalize the AWS firewall purchase.

I would love to use Sophos But I cant without proper "Warm" HA fail-over. Can you give us all on this Blog a better time line and eta ?

Anyupdate on the timeline for the New AWS Sophos utm  AMI I and I think the rest of the customers that need HA would like to see a date of the next AWS EC2 AMI availability and time line, I have production items I cant move into aws because my Firewall is not in an HA mode and I cant convert it. Really need time line thank you

Hi Vitale.

We released the AMIs and the template today :)

So if you have a 9.408 running, or update to 9.408, you should now be able to start the conversion process.

Any feedback is highly appreciated.

Please let us know how it works for you.

BTW, if you want to have a look on the templates, see the utm/conversion subfolder of our github:

https://github.com/sophos-iaas/aws-cf-templates

Thank you for the update I'm running the latest AMI from amazon market place see screen shot below the version it says was  Updated: 11/17/16 but when I run the migration wizard it says its not able to migrate please wait a few days.

Thank you for the update I'm running the latest AMI from amazon market place see screen shot below the version it says was  Updated: 11/17/16 but when I run the migration wizard it says its not able to migrate please wait a few days.

Hi Vitale,

Over the weekend, AWS published our latest UTM 9.408 release, which had a fix for the conversion utility. However, this morning our dev team confirmed certain scenarios where the conversion utility may convert PAYG AMIs to BYOL AMIs. Based on that, we pulled the conversion templates to prevent any customers from unintentionally converting over to BYOL. We're working on a fix and will update the forum once it goes live. Apologies for any inconveniences. Release notes are pasted below for reference.

Thanks.

community.sophos.com/.../sophos-utm-9-408-on-aws-release-notes

Hi Vitale,

Over the weekend, AWS published our latest UTM 9.408 release, which had a fix for the conversion utility. However, this morning our dev team confirmed certain scenarios where the conversion utility may convert PAYG AMIs to BYOL AMIs. Based on that, we pulled the conversion templates to prevent any customers from unintentionally converting over to BYOL. We're working on a fix and will update the forum once it goes live. Apologies for any inconveniences. Release notes are pasted below for reference.

Thanks.

community.sophos.com/.../sophos-utm-9-408-on-aws-release-notes

Do you know the time line and the Aws markets place AMI number that will be released in the upcoming days ?

Hi guys

Interesting reading. In the same situation here also. Unable to build a warm standby instance. Assume by reading this it is known about and we can expect something soon, tho a little concerning for an enterprise product what has happend in this thread. Not to worry, I do have faith in this, and believe once stable it will be a great product.

Please update us once you have an ETA of a finished product as such. I am assuming that the EIP can be moved between each instance (between primary and standby) if an instance fails - could someone please confirm that. And what would you recommend in terms of placing these instances in a cluster across 2 Availability Zones, or building a cluster in each AZ ? 

Thanks

Hi Zak,

Thanks for looking at the UTM on AWS and appreciate you reaching out. Note that the most recent comments are around a new feature we've put in place that allows a customer to go from an already deployed stand alone/single UTM instance, to either a High Availability or Auto Scaling cluster of UTM's. You can currently simply use the existing CloudFormation template to install a new VPC and the HA pair of UTM's as discussed in the below linked KB which also has the CFT links. Also below is a link to our Github repo that we're populating with new CFT's and info, and also a link to our Auto Scaling Guide in case you have any questions about that. Let us know if you have anymore questions or need assistance with anything.

I am assuming that the EIP can be moved between each instance (between primary and standby) if an instance fails - could someone please confirm that. Confirmed. The EIP is assigned to the active UTM instance and will be migrated to the passive UTM as part of the failover process. 

And what would you recommend in terms of placing these instances in a cluster across 2 Availability Zones, or building a cluster in each AZ ? The linked CFT will deploy the UTM's into different Availability Zones per AWS Best Practice guidance. The UTM's also are monitored by AWS services such as CloudWatch and part of an Auto Scaling group, so if there is an issue with their health or the AZ, they'll be recreated automatically. The KB has some more info on the design.

High Availability KB

https://community.sophos.com/kb/hu-hu/122202

Github repo

https://github.com/sophos-iaas/aws-cf-templates

UTM on AWS Auto Scaling Guide

https://www.sophos.com/en-us/medialibrary/PDFs/documentation/SophosUTMAWS.pdf

Bill

Zak,

Bill is correct in the above statement. This thread is specifically to address and understand how long current customers on the latest Sophos UTM 9  version 9.408-4  on a AWS with a live production VPC environment have to wait before the  HA deployment feature within the GUI works. This thread is for sophos to report on ETA's report current firmware that address the issue and  issues with HA configurations, I would visit other threads that already answer and address concerns of EIP's and how they move between AWS AZ's.

Any update on the HA release I will have to use cisco or fortnet for my AWS solution if we can not make the HA conversion work. Please let us know timeline ?

Hi Vitale,

We're looking to fix this in 9.409, which is scheduled for the week of December 26. We'll keep you posted when we publish.

Thanks.

Rich thank you for the update will this address the HA GUI deployment

Hi Vitale,

You're welcome. We just pushed 9.409 to the AWS Marketplace today. It will probably take AWS a couple of days to scan the AMIs and publish them. We'll let you know when we hear a date. Once 9.409 is published, the conversion utility for HA should work. We'll follow up in January with a 9.10 release that will support the conversion utility for Auto Scaling.

Let me know if you have any questions. Thanks.

Thank you for the update I went ahead and upgraded the existing firewall, to version  9409 as you can see in my screen shot below but I was unable to complete the HA setup still. Is there a reson why I cant deploy HA after the upgrade? Do i really need to launch a brand new instance from AWS market place first? If so which instance do I need Launch.

Thanks Vitale,

There are two ways customers can update Sophos UTM on AWS. One way is via up2date, which I believe is the method you used. This update path is only available for our Stand Alone (Single AMI) release and uses the normal update process for all UTMs.

Because our Auto Scaling and HA releases uses multiple AMIs, these releases don't update via up2date. Instead we've built a process called Cloud Update which uses CloudFormation stack updates to update the different AMIs. The conversion utility also uses CloudFormation stack updates as the process converts a Single AMI to multiple AMIs (depending on the option you choose). This means that the conversion utility won't work until (1) AWS publishes the latest AMI in the AWS Marketplace, and (2) we've updated our CloudFormation templates with the new AMI IDs (which AWS gives us).

docs.aws.amazon.com/.../using-cfn-updating-stacks.html

Again, we just pushed 9.409 to the AWS Marketplace yesterday. It usually takes AWS a couple of days to scan and publish them, with the holidays it may take a bit more. As soon as AWS comes back with the new AMI IDs, we'll update our templates and then the conversion utility should work. We'll let you know when we hear back from AWS.

Hope that makes sense. If not, ping us via aws.maketplace@sophos.com and we can arrange a call.

Thanks.