AWS Device Farm • Hacker News Board

Re: AWS Device Farm

#11

Post by ColinDabritz » Thu, Jul 09, 2015, 4:00 PM UTC

Artemis2 wrote: post #9

Amazon is coming for Google's [Cloud Test Lab]( https://developers.google.com/cloud-test-lab/ ) and [Nativetap]( https://beta.nativetap.io/ ).

On a brief look, it appears that all of these choices (Including Amazon's new one) only support Android devices and not iOS?

I believe Xamarin Test Cloud includes iOS, although I'm not certain if it integrates outside of the Xamarin framework. http://xamarin.com/test-cloud

Seems like a gap they should all be trying to fill.

Re: AWS Device Farm

#12

Post by rasmuskl » Thu, Jul 09, 2015, 4:09 PM UTC

ColinDabritz wrote: post #11

Artemis2 wrote: post #9

Amazon is coming for Google's [Cloud Test Lab]( https://developers.google.com/cloud-test-lab/ ) and [Nativetap]( https://beta.nativetap.io/ ).

On a brief look, it appears that all of these choices (Including Amazon's new one) only support Android devices and not iOS? I believe Xamarin Test Cloud includes iOS, although I'm not certain if it integrates outside of the Xamarin framework. http://xamarin.com/test-cloud Seems like a gap they should all be trying to fill.

Xamarin Test Cloud is not limited to Xamarin apps for either platform.

Disclaimer: I work at Xamarin.

Re: AWS Device Farm

#13

Post by jastanton » Thu, Jul 09, 2015, 4:12 PM UTC

Correct me if I'm wrong but does this feel pretty expensive?

> Pricing is based on device minutes, which are determined by the number of devices you use and the duration of your tests. AWS Device Farm comes with a free tier of 250 device minutes. After that you are charged $0.17 per device minute. As your testing needs grow, you can opt for our unmetered testing plan, which allows unlimited testing for a flat monthly fee of $250 per device.

Re: AWS Device Farm

#14

Post by middleman90 » Thu, Jul 09, 2015, 4:20 PM UTC

jastanton wrote: post #13

Correct me if I'm wrong but does this feel pretty expensive? > Pricing is based on device minutes, which are determined by the number of devices you use and the duration of your tests. AWS Device Farm comes with a free tier of 250 device minutes. After that you are charged $0.17 per device minute. As your testing needs grow, you can opt for our unmetered testing plan, which allows unlimited testing for a flat monthly…

Yes, but consider that is not a virtualization, is a proper device

Re: AWS Device Farm

#15

Post by lubesGordi » Thu, Jul 09, 2015, 4:23 PM UTC

jastanton wrote: post #13

Correct me if I'm wrong but does this feel pretty expensive? > Pricing is based on device minutes, which are determined by the number of devices you use and the duration of your tests. AWS Device Farm comes with a free tier of 250 device minutes. After that you are charged $0.17 per device minute. As your testing needs grow, you can opt for our unmetered testing plan, which allows unlimited testing for a flat monthly…

I'm guessing people will use this right before they push their first beta version, just as a quick sanity check against devices they don't already have. Most compatibility issues will probably arise from supporting pre-ICS devices and those are basically all under $250. Besides that, mostly what developers are going to be concerned with is how the app looks on different devices, having taken care of functional issues by developing on slower/lower memory devices in the first place.

Re: AWS Device Farm

#16

Post by martin_tipgain » Thu, Jul 09, 2015, 4:33 PM UTC

Check us out at https://www.testmunk.com/ we do have iOS and Android support :) Don't hesitate to reach out if you have any questions.

Re: AWS Device Farm

#17

Post by techaddict009 » Thu, Jul 09, 2015, 4:45 PM UTC

martin_tipgain wrote: post #16

Check us out at https://www.testmunk.com/ we do have iOS and Android support :) Don't hesitate to reach out if you have any questions.

$ 790/mo arent you guys too costlier compared to AWS?

Re: AWS Device Farm

#18

Post by martin_tipgain » Thu, Jul 09, 2015, 4:55 PM UTC

techaddict009 wrote: post #17

martin_tipgain wrote: post #16

Check us out at https://www.testmunk.com/ we do have iOS and Android support :) Don't hesitate to reach out if you have any questions.

$ 790/mo arent you guys too costlier compared to AWS?

Amongst others, amazon doesn't provide iOS testing. With http://www.testmunk.com you will be able to run the same testcases on both iOS and Android. You will also get a QA Engineer for some hours per month that quickly assists you in getting the needed test coverage.

Re: AWS Device Farm

#19

Post by jakozaur » Thu, Jul 09, 2015, 5:05 PM UTC

I wonder if they add IOS at some point. Maybe it's the Amazon way of doing. Start with MVP and iterate.

Re: AWS Device Farm

#20

Post by Someone1234 » Thu, Jul 09, 2015, 5:14 PM UTC

jastanton wrote: post #13

Correct me if I'm wrong but does this feel pretty expensive? > Pricing is based on device minutes, which are determined by the number of devices you use and the duration of your tests. AWS Device Farm comes with a free tier of 250 device minutes. After that you are charged $0.17 per device minute. As your testing needs grow, you can opt for our unmetered testing plan, which allows unlimited testing for a flat monthly…

Strange, I was actually thinking the pricing was very reasonable. 250 minutes free is pretty generous and will likely be all many small developers need.

17c/minute/device is fine after that since you'll only likely need 20 minutes to test your average app against each device (and they only seem to support a handful). So $10~ to test your apps against a bunch of Amazon devices (ignoring the free 250 minutes), is fine by me.

The only reason I might look elsewhere is that other services offer a more broad range of Android devices, not just Amazon Fire stuff. So you can spin up a Galaxy S6, Nexus, Fire Tablet, etc all under one roof.