Starling Benchmark for mobile devices

Starling Forum » Miscellaneous » Announcements

Starling Benchmark for mobile devices

(80 posts) (18 voices)

Started 1 year ago by ekeeper
Latest reply from Dingo

Tags:

12 3 Next »

ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Hi folks! I'm working on a Starling Benchmark - it's a Starling Framework performance benchmarking application for mobile devices. Currently only Android is supported.

You can get this app here: https://play.google.com/store/apps/details?id=air.com.dustunited.StarlingBenchmark

Application will send results to the external server after each benchmark.

Statistics data is open. You can get it here: http://makegames.ru/starling/benchmark/

Starling Becnmark is an Open Source project. You can get the source code here: http://github.com/ekeeper/Starling-Benchmark

And I need your support and opinions! Any suggestions, code review or pull requests. And let's gather this statistics together!

What benchmarks I need to add? Is it looking too ugly?

Posted 1 year ago #
lokhy

Senior Bird
Joined: Sep '11
Posts: 68

done!

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Thank you! I'll appreciate any suggestions.
There was a little bug on my server - please repeat your benchmarks!

I'll add an automatic mode very soon.

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Hi! Some reports are now available here: http://makegames.ru/starling/benchmark/

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Hi folk! I need help Can I ask you about small code review of my Starling Benchmark? I have a little problem with iPad2.

https://github.com/ekeeper/Starling-Benchmark/blob/master/src/Constants.as

I use this code to detect devices. Detection of iPad2 is ok.

Then: https://github.com/ekeeper/Starling-Benchmark/blob/master/src/Game.as

Starling.current.stage.stageWidth = Number(Constants.Device.screenWidth);
Starling.current.stage.stageHeight = Number(Constants.Device.screenHeight);

And when I run it on iPad2 I get something like... http://dl.dropbox.com/u/21347582/Photos/IMG_0147.PNG

I checked it all on iPod4 before iPad2 and all was okay. All is working fine on Android devices.

Can anybody help me?

Posted 1 year ago #
danieldourado_2

Moderating Bird
Joined: Feb '12
Posts: 204

That happens to me when I set the app to fullscreen.

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Muito obrigado. I'll try to use fullscreen=false
So, it is bug of AIR?

Posted 1 year ago #
danieldourado_2

Moderating Bird
Joined: Feb '12
Posts: 204

I think it is a bug related to the stage 3d. Because my game has regular displayContainer for menus and stage3d for the game. With regular displayContainer it works well. When I init Stage3d it is like the picture you sent. Then I set <fullscreen>false</fullscreen> in the applicationDescriptor and it works well.

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

So, we need to wait a new version of AIR

Does anybody knows how to get info about CPU, GPU and RAM on Android?

Posted 1 year ago #
Jeff

Moderating Owl
Joined: Nov '11
Posts: 1,287
Are you setting
stage.scaleMode = StageScaleMode.NO_SCALE; stage.align = StageAlign.TOP_LEFT;
in your startup class on the flash stage?
Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Jeff, sure.

https://github.com/ekeeper/Starling-Benchmark/blob/master/src/Startup.as

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

<fullscreen>false</fullscreen> - the same result

Maybe this settings are wrong?
[SWF(width="320", height="480", frameRate="60", backgroundColor="#000000")]

But on iPod4 it work correctly - resolution changed to 640x960

Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

ekeeper, the performance demo looks good, but I have a couple suggestions to make it a little better:

1. Add a couple full screen background image's. This taxes fillRate, and seems to create tremendous load on many of the devices out there, and is much more 'real world' in terms of what a game will usually require.

2. The results are split by resolution, which is not super useful. AIR has totally different performance characteristics on iOS than it does on Android. Ideally results would be split between iOS and Android, and then by resolution or deviceName (should be easy for iOS)

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

esDot, thanks for feedback!

1. You mean that I need to create just backgrounds for all benchmarks or you mean that I need to create a special benchmark with fullscreen background images?

2. When I'll fix all my issues with iOS, I will change all reports on the page. I plan to group by OS and CPU or GPU.

Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

I would just add a fullscreen BG to all tests, it's a better representation of what the rendering load would be in production... I realize you're counting sprites here, but this would be somewhat of a constant? I think you'd find it exposes some performance issues on some devices...

Here's some old code I used for device detection, maybe it will be helpful?
var os:String = Capabilities.os.toLowerCase();
if(os.indexOf("iphone") > -1){
//iPhone OS 4.3.3 iPad2,1
_deviceName = (os.indexOf("ipad") > -1) ? IPAD : IPHONE;
} else if(Capabilities.manufacturer.toLowerCase().indexOf("android") > -1 ||
os.indexOf("android") > -1){
_deviceName = ANDROID;
}

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Screenshot with <fullscreen>false</fullscreen>: http://dl.dropbox.com/u/21347582/Photos/IMG_0151.PNG

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

esDot, this is my class: https://github.com/ekeeper/Starling-Benchmark/blob/master/src/Constants.as

About images - http://makegames.ru/starling/benchmark/?d=all - too much very different resolutions. So I think that big tiles will help me.

Posted 1 year ago #
Thynsiia

Hatchling
Joined: Apr '12
Posts: 4

I'm having the same problem, the app detects an ipad, and then pops up in the upper left of the screen, all the rest of my devices seem to run fine, (testing on ipad 3, iphone4)
only way i got it to run okay was to set the swf to ipad res:(

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Thynsiia, yes - it looks like we need to make different builds... :((((

Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

Ah, nice class, looks great! Ignore my stuff then, I think I will borrow yours instead :p

Posted 1 year ago #
Thynsiia

Hatchling
Joined: Apr '12
Posts: 4

i have been wondering the same, i hoped i didn't have to go for seperate apps, thought it was my ipad 3 at first

Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

Regarding stage issues, it may be as simple as waiting 200ms before starting your scene, ie Let the flash stage size before adding anything to it, usually just takes 1 frame.

Posted 1 year ago #
Jeff

Moderating Owl
Joined: Nov '11
Posts: 1,287
Still not sure what you guys are hitting as far as placement problems, but I can say that I am building and deploying a single Starling iOS app build to iPad1, iPad2, iPad retina and iPhone 4 and not having to do anything special to get the app placed at all. (also using the latest Starling.contentScaleFactor to use 2x asset resources for iPad retina and iPhone 4)

One difference between my code and your benchmark is that instead of hardcoding stage width and height by sniffing the actual device I am doing the standard listening for flash resize in my startup class:
stage.addEventListener(flash.events.Event.RESIZE, onResize, false, 0, true);
and then storing or updating the Starling stage width/height (and viewport) on every resize event.
I have found given the potential multiple resizes that happen on startup, both on iOS and Android, (which can also occur before Starling's root object is initialized) you might be running into placement problems for your centering and stage dimensions if you don't also listen for every resize event that happens. Just a thought.
Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

Since this app does not rotate, there's no need to listen for or support resize, it would just add complexity to the demo.

Just do this in your document class:
setTimeout(init, 100);

If you do that, you don't need to both with all teh sniffing stuff either, just grab stage.stageWidth and stage.stageHeight and they'll be correct.

Posted 1 year ago #
Jeff

Moderating Owl
Joined: Nov '11
Posts: 1,287

@esDot I am not talking about adding resize support solely because of rotation, I am talking about devices that will report incorrect/invalid width/height settings during startup.

Posted 1 year ago #
ekeeper

Moderating Bird
Joined: Nov '11
Posts: 173

Jeff, thanks! I'll try to use Event.RESIZE listener.

2All: Please update your Starling Benchmark to 0.2.5 - now it will send RAM and CPU info. Update will appear in Googl Playe very soon. Thanks you in advance

https://play.google.com/store/apps/details?id=air.com.dustunited.StarlingBenchmark

Posted 1 year ago #
Thynsiia

Hatchling
Joined: Apr '12
Posts: 4

looks like setTimeout(init, 100); did the trick here thx:)

Posted 1 year ago #
esDot

Senior Bird
Joined: Sep '11
Posts: 177

@jeff - Waiting a couple frames avoids the inconsistent stage size issue completely.

Posted 1 year ago #
Chris

Competent Bird
Joined: Sep '11
Posts: 58

Thanks! I tried this on my phone -- something I haven't tested yet as I've been focusing on my tablets -- and its performance was excellent at 30fps.

Posted 1 year ago #
Jeff

Moderating Owl
Joined: Nov '11
Posts: 1,287

If you like timeouts that is fine, I prefer not to use timeouts because they are not always deterministic.

Posted 1 year ago #

RSS feed for this topic

12 3 Next »

Reply »

You must log in to post.