consumes too much CPU when it should be idle

[madmonk]

I will compile tonight and let you know...

[madmonk]

Yes, the Luajit compilation does indeed accelerate things, but...

You may remember I have a problem with luajit compilation and I get random crashes... but especially when I run a Mage and teleport to Angolwen

So basically I can't do this one!

*** glibc detected *** /home/jon/Download/t-4/bin/Debug/t-engine: free(): invalid pointer: 0x09dd3e58 ***
======= Backtrace: =========
/lib/i686/libc.so.6[0xb759b3f1]
/lib/i686/libc.so.6[0xb759d790]
/lib/i686/libc.so.6(cfree+0x70)[0xb759faa0]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80b267d]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80ba9a6]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80ba783]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809d189]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80b0d4a]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80b0e35]
[0xb6d1212a]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80a4d0e]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809ca75]
[0xb6d120c7]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80a4d0e]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809ca75]
[0xb6d120c7]
/home/jon/Download/t-4/bin/Debug/t-engine[0x80a4d0e]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809ca75]
[0xb6d120c7]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809ca57]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809cf88]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809f3cc]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809c345]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809d2dc]
/home/jon/Download/t-4/bin/Debug/t-engine[0x809f455]
/home/jon/Download/t-4/bin/Debug/t-engine[0x8079e1f]
/home/jon/Download/t-4/bin/Debug/t-engine[0x807a1c7]
/home/jon/Download/t-4/bin/Debug/t-engine[0x807b45b]
/lib/i686/libc.so.6(__libc_start_main+0xe6)[0xb7547a36]
/home/jon/Download/t-4/bin/Debug/t-engine[0x804c6d1]
======= Memory map: ========
08048000-08115000 r-xp 00000000 08:07 4819126 /home/jon/Download/t-4/bin/Debug/t-engine
08115000-08118000 rw-p 000cc000 08:07 4819126 /home/jon/Download/t-4/bin/Debug/t-engine
08118000-0811b000 rw-p 00000000 00:00 0
08ca3000-0ec97000 rw-p 00000000 00:00 0 [heap]
a4072000-a437f000 rw-p 00000000 00:00 0
a577f000-a587f000 rw-s 00000000 00:04 233769 /drm mm object (deleted)
a637f000-a647f000 rw-s 00000000 00:04 233753 /drm mm object (deleted)
a667f000-a677f000 rw-s 00000000 00:04 233749 /drm mm object (deleted)
a6a7f000-a6b7f000 rw-s 00000000 00:04 233744 /drm mm object (deleted)
a7e7f000-a7f7f000 rw-s 00000000 00:04 233716 /drm mm object (deleted)
a867f000-a877f000 rw-s 00000000 00:04 233705 /drm mm object (deleted)
a8f7f000-a907f000 rw-s 00000000 00:04 233693 /drm mm object (deleted)
a917f000-a927f000 rw-s 00000000 00:04 233690 /drm mm object (deleted)
a957f000-a967f000 rw-s 00000000 00:04 233685 /drm mm object (deleted)
a967f000-a977f000 rw-s 00000000 00:04 233683 /drm mm object (deleted)
a9b7f000-a9c7f000 rw-s 00000000 00:04 233677 /drm mm object (deleted)
a9f7f000-aa07f000 rw-s 00000000 00:04 233671 /drm mm object (deleted)
aa87f000-aa97f000 rw-s 00000000 00:04 233659 /drm mm object (deleted)
aad7f000-aae7f000 rw-s 00000000 00:04 233653 /drm mm object (deleted)
ab37f000-ab47f000 rw-s 00000000 00:04 233645 /drm mm object (deleted)
ab57f000-ab67f000 rw-s 00000000 00:04 233642 /drm mm object (deleted)
ab97f000-aba7f000 rw-s 00000000 00:04 233637 /drm mm object (deleted)
abc7f000-abd7f000 rw-s 00000000 00:04 233633 /drm mm object (deleted)
abf7f000-ac37f000 rw-s 00000000 00:04 234649 /drm mm object (deleted)
ac47f000-ac57f000 rw-s 00000000 00:04 233622 /drm mm object (deleted)
ad17f000-ad27f000 rw-s 00000000 00:04 233601 /drm mm object (deleted)
ad47f000-ad57f000 rw-s 00000000 00:04 233593 /drm mm object (deleted)
ad87f000-ad97f000 rw-s 00000000 00:04 233456 /drm mm object (deleted)
ada00000-ada40000 rwxp 00000000 00:00 0
adc30000-adc50000 rw-s 106fc3000 00:05 3865 /dev/dri/card0
add10000-add50000 rw-s 00000000 00:04 233588 /drm mm object (deleted)
add50000-ade50000 rw-s 00000000 00:04 234614 /drm mm object (deleted)
ade50000-adf50000 rw-s 00000000 00:04 233575 /drm mm object (deleted)
ae023000-ae330000 rw-p 00000000 00:00 0
ae330000-ae530000 rw-s 00000000 00:04 233535 /drm mm object (deleted)
ae530000-ae570000 rw-s 00000000 00:04 232612 /drm mm object (deleted)
ae800000-ae821000 rw-p 00000000 00:00 0
ae821000-ae900000 ---p 00000000 00:00 0
ae9da000-aea1a000 rw-s 00000000 00:04 232202 /drm mm object (deleted)
aea1a000-aee1a000 rw-s 00000000 00:04 232201 /drm mm object (deleted)
aee1a000-af4d3000 rw-p 00000000 00:00 0
af51b000-af61b000 rw-s 00000000 00:04 234383 /drm mm object (deleted)
af71b000-af81b000 rw-s 00000000 00:04 234381 /drm mm object (deleted)
af81b000-af85b000 rw-s 00000000 00:04 233766 /drm mm object (deleted)
af933000-afa33000 rw-s 00000000 00:04 234268 /drm mm object (deleted)
afb33000-afb53000 rwxp 00000000 00:00 0
afc1b000-afc3b000 rwxp 00000000 00:00 0
afc7b000-afcbb000 rw-s 00000000 00:04 233734 /drm mm object (deleted)
afd03000-afd23000 rwxp 00000000 00:00 0
afdeb000-afe2b000 rw-s 00000000 00:04 233713 /drm mm object (deleted)
affb3000-affb4000 rw-s 00000000 00:04 232906 /drm mm object (deleted)
affb4000-affb5000 rw-s 00000000 00:04 233534 /drm mm object (deleted)
affb5000-affb6000 rw-s 00000000 00:04 232585 /drm mm object (deleted)
affb6000-affb7000 rw-s 00000000 00:04 233238 /drm mm object (deleted)
affb7000-affb8000 rw-s 00000000 00:04 233806 /drm mm object (deleted)
affb8000-affb9000 rw-s 00000000 00:04 231948 /drm mm object (deleted)
affb9000-affba000 rw-s 00000000 00:04 233795 /drm mm object (deleted)
affba000-affbb000 rw-s 00000000 00:04 233074 /drm mm object (deleted)
affbb000-affdb000 rwxp 00000000 00:00 0
b00a3000-b00c3000 rw-s 00000000 00:04 231827 /drm mm object (deleted)
b0183000-b0184000 rw-s 00000000 00:04 232412 /drm mm object (deleted)
b0184000-b0185000 rw-s 00000000 00:04 231601 /drm mm object (deleted)
b0185000-b0186000 rw-s 00000000 00:04 233348 /drm mm object (deleted)
b0186000-b0187000 rw-s 00000000 00:04 233182 /drm mm object (deleted)
b0187000-b0188000 rw-s 00000000 00:04 233029 /drm mm object (deleted)
b0188000-b0189000 rw-s 00000000 00:04 232424 /drm mm object (deleted)
b0189000-b018a000 rw-s 00000000 00:04 231666 /drm mm object (deleted)
b018a000-b018b000 rw-s 00000000 00:04 232737 /drm mm object (deleted)
b018b000-b01ab000 rwxp 00000000 00:00 0
b0233000-b0333000 rw-s 00000000 00:04 234148 /drm mm object (deleted)
b0333000-b0353000 rw-s 00000000 00:04 231735 /drm mm object (deleted)
b0358000-b0359000 rw-s 00000000 00:04 233207 /drm mm object (deleted)
b0359000-b035a000 rw-s 00000000 00:04 232726 /drm mm object (deleted)
b035a000-b035b000 rw-s 00000000 00:04 232915 /drm mm object (deleted)
b035b000-b037b000 rwxp 00000000 00:00 0
b037b000-b03bb000 rw-s 00000000 00:04 233652 /drm mm object (deleted)
b03bb000-b03db000 rw-s 106283000 00:05 3865 /dev/dri/card0

Program received signal SIGABRT, Aborted.
0xffffe424 in __kernel_vsyscall ()

[darkgod]

But only in angolwen ?
How is the speed anywhere else ?

What's your computer BTW ?

[Zop]

I've noticed always noticed severe jerkiness after playing for an hour... It seems to get worse as time goes by. Everything from moving my selection in a menu to the "animated" text effects are affected. I once tried making the log file read-only, but that didn't change it. Does Lua do garbage collection badly? Is it my stuff overheating? Who knows!

[darkgod]

And if you just save & reload it goes away ?

[Final Master]

Actually, now that I've paid more attention, it seems saving IS my problem. The game randomly saves itself while playing, and always saves the game when entering/leaving the world map. Also, I'm aloud to move about and play the game while it is saving. That for sure is causing the majority of my slow down. I always remember roguelikes and tome alike that the game stops all actions while saving. Perhaps the animations of suspended abilities, the music, ect severely slow down the saving process?

On a second note, I noticed that going to the stat/talent screen uses a turn... that's not exactly correct I hope.

On a third note, every time I level up, I noticed that all suspended talents are deactivated then reactivated on their own, using up the respective number of turns. I've almost died three times now due to the 'stun' effect of forced ability use.

Edit~
I was finally able to check cpu usage and page file usage and during save, the game uses up 95 - 100 cpu and is running at 180,000 k. During idle play, it is running at 55,000k which is a crap ton compared to everything else the computer does.

[edge2054]

On a second note, I noticed that going to the stat/talent screen uses a turn... that's not exactly correct I hope.

On a third note, every time I level up, I noticed that all suspended talents are deactivated then reactivated on their own, using up the respective number of turns. I've almost died three times now due to the 'stun' effect of forced ability use.

I can confirm that the free deactivation/reactivation is now costing actions. Tested by putting an ability on cooldown and then spending a stat point. The cooldown counter went down.

[Feanor.81]

I too experience lag and slowdown after playing for a bit (sometimes just ten minutes, sometimes almost a hour), but it was happening with beta 9 too, so the new asynchronous save mode is definitely not the cause. I just quit and restart when it starts becoming annoying. (I remember checking the log one of those times and saw that ticks for second had gone down to something like 0.05)

My first guess is that the lag may have something to do with encumbered inventories, but probably it's just an impression. Also, another sensation is that characters using ranged attacks (e.g. alchemists and archers) suffer more often from this problem.

Edit: Ok, just to confirm my impressions, I started a new archer character. After playing a couple of shadowblades for a total of about 4 hours with almost no lag, the archer got very bad lag after just 5 minutes of crazy shooting to a bunch of worm masses and other nasty critters. IMO targeting system (at least, archer's one) contains some serious performance issue.

I attached the session's stdout.txt, showing how FPS and TPS progressively drop to null in a matter of minutes.

[greycat]

Just sitting in the Old Forest. Not saving, not moving, no dialogs open, nothing -- just SITTING there. You can see how much CPU it's using.

[darkgod]

Wohhaaa fvwm2 and rxvt ! Old school man !

This is after a while or always ?
What's your GFX card and do you have an hardware accelerated driver ?
If you run beta9 today, is it better ?

Thanks!

[greycat]

CPU = AMD Athlon(tm) 64 Processor 3400+
GPU = ATI Technologies Inc RV280 [Radeon 9200]

Based on some previous forum discussion, I know that this card is missing some of the features that T-Engine wants to use. For example, I don't get item shadows or animated water.

I get 1650 FPS from glxgears. And everyone says "glxgears isn't a useful benchmark, blah blah blah" but they never say what I should use instead, so that's all I know. The driver does some hardware acceleration.

The CPU chomping is constant, even when sitting at the "choose a module" screen, but it only seems to use about 40% of the CPU at the "choose a module" screen, instead of all of it.

Starting a new character under 9b, I still see it chomping on the CPU, but only about half as bad -- similar to what I see at the "choose a module" screen in 10b. It's not as noticeable in terms of lagging game play either.

[darkgod]

Hum quite weird I did not change much display code at all between the releases... hum

Can you post me the results of your glxinfo please ?

Also if you can drop by on irc.rizon.net #tome we'll do some more tests, removing parts of the display or changing them to see where it is slow.

[greycat]

Code: Select all

name of display: :0.0
display: :0  screen: 0
direct rendering: Yes
server glx vendor string: SGI
server glx version string: 1.2
server glx extensions:
    GLX_ARB_multisample, GLX_EXT_import_context, GLX_EXT_texture_from_pixmap, 
    GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_MESA_copy_sub_buffer, 
    GLX_OML_swap_method, GLX_SGI_make_current_read, GLX_SGI_swap_control, 
    GLX_SGIS_multisample, GLX_SGIX_fbconfig, GLX_SGIX_visual_select_group
client glx vendor string: SGI
client glx version string: 1.4
client glx extensions:
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_import_context, 
    GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_MESA_allocate_memory, 
    GLX_MESA_copy_sub_buffer, GLX_MESA_swap_control, 
    GLX_MESA_swap_frame_usage, GLX_OML_swap_method, GLX_OML_sync_control, 
    GLX_SGI_make_current_read, GLX_SGI_swap_control, GLX_SGI_video_sync, 
    GLX_SGIS_multisample, GLX_SGIX_fbconfig, GLX_SGIX_pbuffer, 
    GLX_SGIX_visual_select_group, GLX_EXT_texture_from_pixmap
GLX version: 1.2
GLX extensions:
    GLX_ARB_get_proc_address, GLX_ARB_multisample, GLX_EXT_import_context, 
    GLX_EXT_visual_info, GLX_EXT_visual_rating, GLX_MESA_allocate_memory, 
    GLX_MESA_copy_sub_buffer, GLX_MESA_swap_control, 
    GLX_MESA_swap_frame_usage, GLX_OML_swap_method, GLX_SGI_make_current_read, 
    GLX_SGI_swap_control, GLX_SGI_video_sync, GLX_SGIS_multisample, 
    GLX_SGIX_fbconfig, GLX_SGIX_visual_select_group
OpenGL vendor string: Tungsten Graphics, Inc.
OpenGL renderer string: Mesa DRI R200 20060602 AGP 8x x86/MMX+/3DNow!+/SSE2 TCL
OpenGL version string: 1.3 Mesa 7.0.4
OpenGL extensions:
    GL_ARB_imaging, GL_ARB_multisample, GL_ARB_multitexture, 
    GL_ARB_point_parameters, GL_ARB_point_sprite, GL_ARB_texture_border_clamp, 
    GL_ARB_texture_compression, GL_ARB_texture_cube_map, 
    GL_ARB_texture_env_add, GL_ARB_texture_env_combine, 
    GL_ARB_texture_env_crossbar, GL_ARB_texture_env_dot3, 
    GL_ARB_texture_mirrored_repeat, GL_ARB_texture_rectangle, 
    GL_ARB_transpose_matrix, GL_ARB_vertex_buffer_object, 
    GL_ARB_vertex_program, GL_ARB_window_pos, GL_EXT_abgr, GL_EXT_bgra, 
    GL_EXT_blend_color, GL_EXT_blend_equation_separate, 
    GL_EXT_blend_func_separate, GL_EXT_blend_minmax, GL_EXT_blend_subtract, 
    GL_EXT_clip_volume_hint, GL_EXT_compiled_vertex_array, GL_EXT_convolution, 
    GL_EXT_copy_texture, GL_EXT_draw_range_elements, GL_EXT_fog_coord, 
    GL_EXT_histogram, GL_EXT_multi_draw_arrays, GL_EXT_packed_pixels, 
    GL_EXT_point_parameters, GL_EXT_polygon_offset, GL_EXT_rescale_normal, 
    GL_EXT_secondary_color, GL_EXT_separate_specular_color, 
    GL_EXT_stencil_wrap, GL_EXT_subtexture, GL_EXT_texture, GL_EXT_texture3D, 
    GL_EXT_texture_edge_clamp, GL_EXT_texture_env_add, 
    GL_EXT_texture_env_combine, GL_EXT_texture_env_dot3, 
    GL_EXT_texture_filter_anisotropic, GL_EXT_texture_lod_bias, 
    GL_EXT_texture_mirror_clamp, GL_EXT_texture_object, 
    GL_EXT_texture_rectangle, GL_EXT_vertex_array, GL_APPLE_packed_pixels, 
    GL_ATI_blend_equation_separate, GL_ATI_texture_env_combine3, 
    GL_ATI_texture_mirror_once, GL_ATI_fragment_shader, GL_IBM_rasterpos_clip, 
    GL_IBM_texture_mirrored_repeat, GL_INGR_blend_func_separate, 
    GL_MESA_pack_invert, GL_MESA_ycbcr_texture, GL_MESA_window_pos, 
    GL_NV_blend_square, GL_NV_light_max_exponent, GL_NV_texture_rectangle, 
    GL_NV_texgen_reflection, GL_OES_read_format, GL_SGI_color_matrix, 
    GL_SGI_color_table, GL_SGIS_generate_mipmap, GL_SGIS_texture_border_clamp, 
    GL_SGIS_texture_edge_clamp, GL_SGIS_texture_lod, GL_SUN_multi_draw_arrays

   visual  x  bf lv rg d st colorbuffer ax dp st accumbuffer  ms  cav
 id dep cl sp sz l  ci b ro  r  g  b  a bf th cl  r  g  b  a ns b eat
----------------------------------------------------------------------
0x23 24 tc  0 32  0 r  y  .  8  8  8  8  0 24  8  0  0  0  0  0 0 None
0x24 24 tc  0 32  0 r  y  .  8  8  8  8  0 24  0  0  0  0  0  0 0 None
0x25 24 tc  0 32  0 r  y  .  8  8  8  8  0 24  8 16 16 16 16  0 0 Slow
0x26 24 tc  0 32  0 r  y  .  8  8  8  8  0 24  0 16 16 16 16  0 0 Slow
0x27 24 tc  0 32  0 r  .  .  8  8  8  8  0 24  8  0  0  0  0  0 0 None
0x28 24 tc  0 32  0 r  .  .  8  8  8  8  0 24  0  0  0  0  0  0 0 None
0x29 24 tc  0 32  0 r  .  .  8  8  8  8  0 24  8 16 16 16 16  0 0 Slow
0x2a 24 tc  0 32  0 r  .  .  8  8  8  8  0 24  0 16 16 16 16  0 0 Slow
0x2b 24 dc  0 32  0 r  y  .  8  8  8  8  0 24  8  0  0  0  0  0 0 None
0x2c 24 dc  0 32  0 r  y  .  8  8  8  8  0 24  0  0  0  0  0  0 0 None
0x2d 24 dc  0 32  0 r  y  .  8  8  8  8  0 24  8 16 16 16 16  0 0 Slow
0x2e 24 dc  0 32  0 r  y  .  8  8  8  8  0 24  0 16 16 16 16  0 0 Slow
0x2f 24 dc  0 32  0 r  .  .  8  8  8  8  0 24  8  0  0  0  0  0 0 None
0x30 24 dc  0 32  0 r  .  .  8  8  8  8  0 24  0  0  0  0  0  0 0 None
0x31 24 dc  0 32  0 r  .  .  8  8  8  8  0 24  8 16 16 16 16  0 0 Slow
0x32 24 dc  0 32  0 r  .  .  8  8  8  8  0 24  0 16 16 16 16  0 0 Slow
0x76 32 tc  0 32  0 r  .  .  8  8  8  8  0  0  0  0  0  0  0  0 0 Ncon

[darkgod]

Ahh that's good old mesa, it's not using your video driver opengl.

Try disabling the map display: Comment out lines 430 and 431 in game/modules/tome/class/Game.lua

See if this is faster, much faster, terribly faster, ...

You can also try to change the zdepth at line 31 of game/engines/default/engine/Map.lua
Set it to 1 and see if it is faster.
(This will bork display terribly, you probably will only see the ground and just partially)

[Zop]

This time around, I started seeing bits of stuttering after only 15 minutes... perhaps it was the stair scumming I had to do at the beginning...

I see 15-25% of one 3ghz cpu core... doing nothing in trollshaws... However. I do have a hymm and a chant animated... but, even off, I see the same use stats. By chance I happened to have Page Faults Delta as one of my columns in the task manager, and it shows 27-28k page faults per second... when doing nothing! I'm fairly sure that's a bad sign!