Performance - what are your standards?

General discussion about LÖVE, Lua, game development, puns, and unicorns.
Bananicorn
Prole
Posts: 25
Joined: Thu Apr 12, 2018 9:59 am

Performance - what are your standards?

Post by Bananicorn » Wed Feb 20, 2019 11:17 am

So by that I mean how well does your game have to run (in terms of FPS) so you consider it stable enough to release?
Do you test on real hardware or on VMs?

I personally develop on an Fujitsu Lifebook 8410[1], running Linux with just the MESA drivers, but I barely test on Windows and Mac OS, since I don't own a Mac and rarely carry my Windows laptop with me.
I generally just see that my games run above 60fps at 800x600 and stay there for most of the time, as long as they don't lag during gameplay-critical moments.

[1]https://www.cnet.com/products/fujitsu-l ... 410/specs/

User avatar
tentus
Inner party member
Posts: 1060
Joined: Sun Oct 31, 2010 7:56 pm
Location: Appalachia
Contact:

Re: Performance - what are your standards?

Post by tentus » Wed Feb 20, 2019 2:50 pm

I'll test each of the platforms eventually, but the frequency is determined by convenience. In my case, Linux is my default development environment, and then Mac gets periodic checks, and then Windows gets checked for each major milestone. In general this kind of testing is pragmatic enough.

In terms of the actual benchmarks: for most of my games I shoot for 60fps on a 1080 resolution during gameplay, on whatever medium-tier-ish laptop I can get my hands on. A convenient trick is to screencapture yourself playing the game with extensive printing happening, and then if you git a snag go back to the screencap and step through the log while also eyeballing the gameplay leading up to it. A lot of times simple logs will obfuscate the actions that led up to a snag, while a video will make them painfully obvious.
Kurosuke needs beta testers

User avatar
ivan
Party member
Posts: 1520
Joined: Fri Mar 07, 2008 1:39 pm
Contact:

Re: Performance - what are your standards?

Post by ivan » Wed Feb 20, 2019 6:45 pm

It's not really about running at high FPS, it's more about making sure the FPS is consistent.
So it's often about dealing with occasional drops in the frame rate.
I also do profiling which helps pinpoint overall bottlenecks
https://bitbucket.org/itraykov/profile.lua/src/master/
If my games can run smooth with the profiler enabled I know the performance is good.
Last edited by ivan on Fri Feb 22, 2019 1:21 pm, edited 1 time in total.

Bananicorn
Prole
Posts: 25
Joined: Thu Apr 12, 2018 9:59 am

Re: Performance - what are your standards?

Post by Bananicorn » Fri Feb 22, 2019 9:51 am

ivan wrote:
Wed Feb 20, 2019 6:45 pm
It's not really about running at high FPS, it's more about making sure the FPS is consistent.
So it's often about dealing with occasional drops in the frame rate.
I also do profiling which help pinpoint overall bottlenecks
https://bitbucket.org/itraykov/profile.lua/src/master/
If my games can run smooth with the profiler enabled I know the performance is good.
Nice profiling tool!
I'm totally gonna try that out :)

Bananicorn
Prole
Posts: 25
Joined: Thu Apr 12, 2018 9:59 am

Re: Performance - what are your standards?

Post by Bananicorn » Fri Feb 22, 2019 10:02 am

tentus wrote:
Wed Feb 20, 2019 2:50 pm
In terms of the actual benchmarks: for most of my games I shoot for 60fps on a 1080 resolution during gameplay, on whatever medium-tier-ish laptop I can get my hands on.
What do you consider a medium-tier laptop nowadays? Would mine be considered medium-tier? It can run stuff quite smoothly, I guess, but only with the right drivers^^

User avatar
ingsoc451
Citizen
Posts: 88
Joined: Sat Feb 06, 2016 9:42 pm
Location: Oceania

Re: Performance - what are your standards?

Post by ingsoc451 » Sat Feb 23, 2019 7:41 pm

It is not fast enough unless it makes my pc catch fire
A relatively stable fps count above 60 seems reasonable to me
eom

User avatar
Tjakka5
Party member
Posts: 240
Joined: Thu Dec 26, 2013 12:17 pm

Re: Performance - what are your standards?

Post by Tjakka5 » Sun Feb 24, 2019 5:22 pm

I aim to write performant code that does generate garbage, and just tries to be efficient everywhere.
If I notice I am bottlenecked by something I'll try to optimize that if I feel like that's worth it.

I use spritebatches by default. If I'm feeling fancy I might even make my own implementation using meshes and bytedata.

When I've got something running I'll test it on lower end systems as well and see if the result is acceptable.
If not, I'll try to optimize it where I can.


One good example would be in the game Sir. Dashaton.
We used a fake 3D technique that uses sprite stacking.
On my partners lower end hardware this amount of overdraw just killed performance. I think it was around 20 fps.
We optimized this by turning walls into 4 quads. They were solid anyways. This improved performance enough to call it "good enough".

We also implemented a fixed timestep (High enough to still be smooth on high refresh rate monitors) just to be save.

This was all for a game jam. For a real game I'd implement everything a lot more robust.
Check out my portfolio: http://tjakka5.sorunome.de/

User avatar
shru
Prole
Posts: 25
Joined: Mon Sep 28, 2015 3:56 am
Location: Hyperborea
Contact:

Re: Performance - what are your standards?

Post by shru » Sun Feb 24, 2019 11:28 pm

I'll elaborate on what ivan said a little bit.

You shouldn't care so much about your framerate, the more important metric is frame time. Consider a scenario where you're running your game without vertical sync on a 60Hz monitor and your FPS is 300. That's 240 frames of headroom, right? Not exactly, you can render 300 frames per second, but it'll still feel laggy if any of those frames take longer than one display refresh, ie. 16.7ms.

Unfortunately in the world of Lua you have to deal with garbage collection, which is definitely something which can cause certain frames to have a spike in processing time.

As for what I can tolerate, it depends on the pace of the game. 60+ is ideal for action games, but I don't think a lower framerate would be a dealbreaker for strategy or puzzle games, for example.
itchtwittergithub

Strela_999
Prole
Posts: 5
Joined: Sat Feb 23, 2019 1:21 pm

Re: Performance - what are your standards?

Post by Strela_999 » Mon Mar 18, 2019 5:34 pm

If it beats 24 fps on my garbage laptop, it's good to go, it means it'll hav at least 30 fps on a Nokia 3310 :ultrahappy:

User avatar
raidho36
Party member
Posts: 1919
Joined: Mon Jun 17, 2013 12:00 pm

Re: Performance - what are your standards?

Post by raidho36 » Sun Apr 07, 2019 8:30 am

30 fps on a $100 phone, 60 fps on a toaster.

The important part is actually testing everything. There are trillion hidden variables so you can't just assume that you'll have certain level of performance based on some metrics or techniques. If you only own a high end desktop for development - that won't do, guesstimations like "it's 1/10th as powerful so it'll have 1/10th the framerate" don't work. You'll have to actually buy some low end hardware, luckily it's very cheap.

Post Reply

Who is online

Users browsing this forum: No registered users and 6 guests